-- Logs begin at Tue 2022-07-12 15:35:44 UTC, end at Tue 2022-07-12 16:45:18 UTC. -- Jul 12 16:09:04.058019 dv-cinder-797608-56-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 12 16:09:04.065427 dv-cinder-797608-56-smb devstack@keystone.service[80365]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 12 16:09:04.068305 dv-cinder-797608-56-smb devstack@keystone.service[80365]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 16:09:04 2022] *** Jul 12 16:09:04.068305 dv-cinder-797608-56-smb devstack@keystone.service[80365]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 16:09:04.068305 dv-cinder-797608-56-smb devstack@keystone.service[80365]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 16:09:04.068305 dv-cinder-797608-56-smb devstack@keystone.service[80365]: nodename: dv-cinder-797608-56-smb Jul 12 16:09:04.068305 dv-cinder-797608-56-smb devstack@keystone.service[80365]: machine: x86_64 Jul 12 16:09:04.068305 dv-cinder-797608-56-smb devstack@keystone.service[80365]: clock source: unix Jul 12 16:09:04.068305 dv-cinder-797608-56-smb devstack@keystone.service[80365]: pcre jit disabled Jul 12 16:09:04.068305 dv-cinder-797608-56-smb devstack@keystone.service[80365]: detected number of CPU cores: 4 Jul 12 16:09:04.068305 dv-cinder-797608-56-smb devstack@keystone.service[80365]: current working directory: / Jul 12 16:09:04.068305 dv-cinder-797608-56-smb devstack@keystone.service[80365]: detected binary path: /usr/bin/uwsgi-core Jul 12 16:09:04.068984 dv-cinder-797608-56-smb devstack@keystone.service[80365]: your processes number limit is 47680 Jul 12 16:09:04.068984 dv-cinder-797608-56-smb devstack@keystone.service[80365]: your memory page size is 4096 bytes Jul 12 16:09:04.068984 dv-cinder-797608-56-smb devstack@keystone.service[80365]: detected max file descriptor number: 2048 Jul 12 16:09:04.068984 dv-cinder-797608-56-smb devstack@keystone.service[80365]: lock engine: pthread robust mutexes Jul 12 16:09:04.068984 dv-cinder-797608-56-smb devstack@keystone.service[80365]: thunder lock: enabled Jul 12 16:09:04.068984 dv-cinder-797608-56-smb devstack@keystone.service[80365]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 12 16:09:04.068984 dv-cinder-797608-56-smb devstack@keystone.service[80365]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 16:09:04.113903 dv-cinder-797608-56-smb devstack@keystone.service[80365]: Python main interpreter initialized at 0x55ada0caa9c0 Jul 12 16:09:04.113903 dv-cinder-797608-56-smb devstack@keystone.service[80365]: python threads support enabled Jul 12 16:09:04.113903 dv-cinder-797608-56-smb devstack@keystone.service[80365]: your server socket listen backlog is limited to 100 connections Jul 12 16:09:04.113903 dv-cinder-797608-56-smb devstack@keystone.service[80365]: your mercy for graceful operations on workers is 90 seconds Jul 12 16:09:04.114833 dv-cinder-797608-56-smb devstack@keystone.service[80365]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 16:09:04.114910 dv-cinder-797608-56-smb devstack@keystone.service[80365]: *** Operational MODE: preforking *** Jul 12 16:09:04.115204 dv-cinder-797608-56-smb devstack@keystone.service[80365]: *** uWSGI is running in multiple interpreter mode *** Jul 12 16:09:04.115204 dv-cinder-797608-56-smb devstack@keystone.service[80365]: spawned uWSGI master process (pid: 80365) Jul 12 16:09:04.115409 dv-cinder-797608-56-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 12 16:09:04.116547 dv-cinder-797608-56-smb devstack@keystone.service[80365]: spawned uWSGI worker 1 (pid: 80379, cores: 1) Jul 12 16:09:04.116547 dv-cinder-797608-56-smb devstack@keystone.service[80365]: spawned uWSGI worker 2 (pid: 80380, cores: 1) Jul 12 16:09:04.116547 dv-cinder-797608-56-smb devstack@keystone.service[80365]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 16:09:09.533040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 16:09:09.533040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: from cryptography.utils import int_from_bytes Jul 12 16:09:09.533763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 16:09:09.533763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: from cryptography.utils import int_from_bytes Jul 12 16:09:09.534211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 16:09:09.534211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: from cryptography.utils import int_from_bytes Jul 12 16:09:09.534336 dv-cinder-797608-56-smb devstack@keystone.service[80380]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 16:09:09.534336 dv-cinder-797608-56-smb devstack@keystone.service[80380]: from cryptography.utils import int_from_bytes Jul 12 16:09:09.583374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 16:09:09.583522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 16:09:09.583616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 16:09:09.583707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 16:09:09.583783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] command line args: [] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 16:09:09.583862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] command line args: [] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 16:09:09.584063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 16:09:09.584155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 16:09:09.584230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ================================================================================ {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 16:09:09.584303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ================================================================================ {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 16:09:09.584482 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] admin_token = **** {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.584571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] admin_token = **** {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.584740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] config_dir = [] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.584834 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] config_dir = [] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.584915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.584996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.585101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] config_source = [] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.585200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] config_source = [] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.585312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] debug = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.585407 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] debug = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.585517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.585831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.585992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.586109 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.586210 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.586317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.586418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.586523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.586630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.586739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.586847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] list_limit = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.586961 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] list_limit = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.587066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] log_config_append = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.587176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] log_config_append = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.587283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.587393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.587493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] log_dir = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.587599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] log_dir = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.587712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] log_file = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.587796 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] log_file = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.587869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.587950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.588031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.588105 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.588178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.588251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.588329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.588419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.588496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.588566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.588639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.588714 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.588851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.588944 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.589096 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.589214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.589353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.589472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.589570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.589650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.589803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.589899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.590031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.590116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.590274 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.590349 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.590517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.590609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.590787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.590865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.591271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.591357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.591481 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] publish_errors = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.591549 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] publish_errors = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.591670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.591761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.591898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.591984 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.592063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.592131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.592307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.592430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.592528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.592658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.592767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] standard_threads = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.592844 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] standard_threads = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.592974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.593059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.593245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.593332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.593411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.593488 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.593584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] use_journal = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.593668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] use_journal = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.593752 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] use_json = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.593821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] use_json = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.593953 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] use_stderr = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.594103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] use_stderr = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.594103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] use_syslog = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.594354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] use_syslog = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.594565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.594697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 16:09:09.594831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.594960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.594960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.595252 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.595252 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.595515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.595654 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.595789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.595933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.596072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.596214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.596353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.596492 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.596625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.596758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.596891 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.597032 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.597197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.597336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.597479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.597618 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.597751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.597904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.598037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.598672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.598809 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.598949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.599088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.599230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.599374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.599514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.599655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.599795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.599939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.600073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.600222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.600362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.600494 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.600626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.600768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.600901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.601035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.601224 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.601368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.601500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.601710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.601851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.601991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.602132 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.602281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.602413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.602555 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.602689 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.602820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.602952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.603085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.603218 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.603359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.603499 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.603638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.603771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.603904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.604045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.604187 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.604320 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.604453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.604585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.604717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.604856 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.605000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.605153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.605293 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.605425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.605568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.605707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.605849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.606085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.606223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.606356 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.606520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.606671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.606815 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.606959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.607099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.607239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.607373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.607506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.607647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.607788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.607934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.608087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.608311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.608490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.608637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.608771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.608917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.609051 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.609217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.609361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.609496 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.609641 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.609776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.609909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.610053 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.610187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.610327 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.610471 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.610612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.610746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.610879 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.611013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.611146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.611288 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.611453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.611600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.611735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.611735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.612004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.612148 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.612283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.612416 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.612558 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.612699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.612842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.612977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.613127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.613281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.613428 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.613565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.613709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.614474 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.614622 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.614757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.614891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.615025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.615159 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.615301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.615442 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.615577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.615712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.615845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.615979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.616190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.616337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.616471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.616610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.616744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.616878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.617019 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.617230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.617398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.617542 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.617686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.617828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.617976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.618123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.618270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.618404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.618538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.618678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.618814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.618957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.619101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.619235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.619383 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.619522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.619657 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.619798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.619941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.620076 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.620221 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.620355 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.620495 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.620638 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.620780 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.620917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.621050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.621217 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.621353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.621498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.621633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.621774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.621909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.622044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.622188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.622332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.622467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.622600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.622734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.622868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.623003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.623145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.623280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.623415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.623548 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.623683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.623817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.623969 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.624111 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.624246 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.624380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.624513 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.624647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.624789 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.624931 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.625065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.625222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.625380 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.625516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] auth.external = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.625661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] auth.external = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.625797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.625941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.626075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.626239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.626385 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.626521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.626655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] auth.password = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.626798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] auth.password = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.626939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] auth.token = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.627074 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] auth.token = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.627209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.627344 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.627478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.627624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.627774 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.627910 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.628045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.628178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.628313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.628456 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.628592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.628727 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.628861 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.629038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.629225 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] credential.caching = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.629388 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] credential.caching = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.629527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.629663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.629808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.629943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.630087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.630231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.630368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.630502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.630637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.630770 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.630905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.631048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.631183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.631317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.631452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.631587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.631731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.631875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.632011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.632154 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.632298 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.632434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.632647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.632785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.632927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.633062 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.633219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.633354 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.633502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.633650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.633793 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] federation.caching = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.633929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] federation.caching = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.634063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.634197 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.634340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.634475 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.634610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.634745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.634880 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.635013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.635156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.635292 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.635427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.635572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.635707 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.635843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.635986 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.636122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.636257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.636391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.636532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.636668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.636811 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.636947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.637082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.caching = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.637240 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.caching = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.637387 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.637521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.637668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.637805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.637940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.638083 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.638218 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.638352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.638495 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.638630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.638765 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.638900 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.639034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.639169 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.639321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.639468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.639603 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.639737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.639872 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.640006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.640152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.640289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.640423 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.640558 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.640692 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.640828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.640976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.641185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.641338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.641474 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.641617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.641753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.641899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.642035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.642170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.642305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.642439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.642583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.642718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.642859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.642996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.643141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.643276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.643419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.643555 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.643690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.643825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.643960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.644096 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.644239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.644375 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.644510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.644644 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.644779 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.644924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.645067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.645240 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.645386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.645522 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.645657 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.645792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.645936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.646073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.646207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.646342 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.646477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.646611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.646754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.646900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.647036 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.647172 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.647306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.647441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.647584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.647721 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.647855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.647990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.648125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.648261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.648404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.648540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.648675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.648820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.648955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.649090 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.649261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.649416 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.649552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.649688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.649834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.649970 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.650113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.650250 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.650385 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.650520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.650673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.650809 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.650953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.651089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.651223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.651359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.651493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.651628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.651772 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.651908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.652043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.652179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.652313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.652448 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.652602 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.652738 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.652873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.653007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.653198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.653340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.653487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.653624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.653759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.653893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.654028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.654163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.654307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.654454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.654595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.654731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.654866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.655015 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.655165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.655308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.655443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.655579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.655714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.655849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.655992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.656129 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.656263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.656410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.656546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.656681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.656824 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.656960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.657095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.657259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.657394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.657529 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.657677 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.657813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.657954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.658089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.658223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.658368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.658511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.658649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.658784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.658925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.659061 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.659196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.659414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.659556 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.659692 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.659832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.659967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.660110 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.660245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.660390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.660597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.661340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.661476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.661624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.661760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.661896 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.662031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.662166 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.662301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.662445 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] resource.caching = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.662580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] resource.caching = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.662714 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.662861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.662996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.663131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.663273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.663409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.663544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.663678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.663812 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.663947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.664090 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.664226 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.664360 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.664495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.664630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.664774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.664917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.665054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.665210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] role.caching = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.665346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] role.caching = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.665481 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] role.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.665616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] role.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.665762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.665898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.666033 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.666168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.666302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.666438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.666581 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.666728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.666863 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.666997 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.667133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.667267 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.667411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.667546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.667688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.667823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.667958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.668093 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.668236 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.668371 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.668516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.668651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.668786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.668921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.669064 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.669227 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.669364 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.669498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.669634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.669779 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.669924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.670061 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.670197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.670342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.670477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.670621 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.670756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.670891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.671025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.671025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.671279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.671279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.671557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.671698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.671840 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.671840 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.672117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.672269 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.672412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.672552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.672693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.672834 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.672974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.672974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.673281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.673424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.673565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.673705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.673846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.673846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.674135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.674283 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.674432 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.674574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.674715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.674864 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] token.caching = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.675006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.675147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.675287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] token.caching = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.675287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.675554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.675554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.675830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.675830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.676110 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.676290 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.676957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.676957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.677285 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.677427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.677570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.677710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.677850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.678002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.678144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.678285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.678426 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.678586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.678728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.678877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.679019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.679159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.679300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.679440 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.679580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.679730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.679877 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.680023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.680164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.680164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.680429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.680589 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.680733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.connection = **** {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.680733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.681020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.connection = **** {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.681196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.681353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.681496 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.681638 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.681781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.681931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.682074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.682215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.682356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.682508 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.682725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.682870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.683012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.683153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.683294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.683435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.683576 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.683726 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.683869 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.684010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.684159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.684301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.684443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.684604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.684746 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.684888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.685029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.685222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.685378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.685520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.685662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.685803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.685945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.686085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.686239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 16:09:09.686382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 16:09:09.686382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 16:09:09.699739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.699843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.699972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.700074 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.700197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.700284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.708768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.708867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.736650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.736767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.736883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.736970 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.878809 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.879237 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.927771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.927948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.928044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.928191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.992086 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.992256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.992481 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.992568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.992702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.992789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.992921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.993008 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.993162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.993251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.993450 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:09.993666 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.017614 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.017842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.017929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.018072 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.018175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.018296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.018382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.018516 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.018602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.018734 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.018828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.018947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.019031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.019162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.030491 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.030839 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.043710 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.043944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.044167 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.044253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.044392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.044479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.044611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.044696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.044827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.044921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.045044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.045150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.045347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.045564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 16:09:10.062304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.062512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 16:09:10.062799 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.062886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.063007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 16:09:10.063093 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 16:09:10.063290 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.063374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.063528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 16:09:10.063612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.063793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.063877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.064046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.064131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.064298 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.064553 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.075182 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.075460 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.075678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.075763 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.075954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.076039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.076223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.076504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.084785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.085422 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.088215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.088493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.088688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.088775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.088968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.089053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.089272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.089370 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.089560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.089701 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.089833 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.089925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.090089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.090180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.090355 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.090438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.090621 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.090704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.090888 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.090971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.091157 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.091421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.118982 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.119196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.120611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.120816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.120901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.121096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.126186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.126409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.126496 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.126687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.126847 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.127082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.134704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.134949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.135035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.135229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.139524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.139714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.139810 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.140000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.140087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.140282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.140378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.140562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.140648 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.140837 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.140922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.141109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.141235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.141396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.141480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.141663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.160741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.160934 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.161022 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.161237 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.165622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.165815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.169282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.169462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.169577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.169754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.174838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.174927 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.178513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.178602 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.182187 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.182284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.182486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.182582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.182779 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.182865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.183071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.183156 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.183350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.183446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.183623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.183716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.203550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.203677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.203831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.203962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.204095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.204227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.204356 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.204487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.212974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.213072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.214714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.214824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.214987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.215073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.218259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.218346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.218537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.218624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.218816 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.218902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.219093 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.219188 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.219366 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.219451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.232686 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.232781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.232966 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.233054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.233267 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.233381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.233549 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.233672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.233827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.233951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.235361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.235508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.235663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.235807 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.253676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.253908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.257477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.257750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.260795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.261067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.262578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.262836 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.264210 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.264486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.264582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.264769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.264855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.265082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.272662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.273103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.274304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.274719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.277638 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.277939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.278082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.278372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.278459 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.278685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.278779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.279037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.288213 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.288301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.288501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.288586 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.288778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.288865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.296744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.296838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 16:09:10.297026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.297142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.297328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.297414 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.297604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.297690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.297875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.297969 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.298254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.298339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.298530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.298615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.298800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.298885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.299079 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.299163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.299353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.299447 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.299625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.299709 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.299888 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.299971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.300155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.300241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.300419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.300504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 16:09:10.339541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ada0caa9c0 pid: 80379 (default app) Jul 12 16:09:10.339691 dv-cinder-797608-56-smb devstack@keystone.service[80380]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ada0caa9c0 pid: 80380 (default app) Jul 12 16:09:10.342935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a503898-0300-4ff0-937e-587437e7aac6 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:10.343232 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a503898-0300-4ff0-937e-587437e7aac6 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:10.343511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a503898-0300-4ff0-937e-587437e7aac6 None None] PATH_INFO: `/v3` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:10.347696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Tue Jul 12 16:09:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:18.886468 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d1f57-9d44-48a8-bcf8-375361991fcb None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:18.887028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d1f57-9d44-48a8-bcf8-375361991fcb None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:18.887028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d1f57-9d44-48a8-bcf8-375361991fcb None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:18.891307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:09:18.901221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece11d6-52ae-43dc-8d3f-9295cbf7076b None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:18.901221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece11d6-52ae-43dc-8d3f-9295cbf7076b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:18.901221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece11d6-52ae-43dc-8d3f-9295cbf7076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:18.969239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: INFO dbcounter [None req-6ece11d6-52ae-43dc-8d3f-9295cbf7076b None None] Registered counter for database keystone Jul 12 16:09:18.991382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG oslo_db.sqlalchemy.engines [None req-6ece11d6-52ae-43dc-8d3f-9295cbf7076b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:09:18.997613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writer thread running {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:09:19.177351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG passlib.handlers.bcrypt [None req-6ece11d6-52ae-43dc-8d3f-9295cbf7076b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80379) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 16:09:19.178312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG passlib.handlers.bcrypt [None req-6ece11d6-52ae-43dc-8d3f-9295cbf7076b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80379) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 16:09:19.232916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-6ece11d6-52ae-43dc-8d3f-9295cbf7076b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:19.234611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6ece11d6-52ae-43dc-8d3f-9295cbf7076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:19.355768 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 12 16:09:19.517562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d1f57-9d44-48a8-bcf8-375361991fcb None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:19.587520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: INFO dbcounter [None req-0b5d1f57-9d44-48a8-bcf8-375361991fcb None None] Registered counter for database keystone Jul 12 16:09:19.607092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG oslo_db.sqlalchemy.engines [None req-0b5d1f57-9d44-48a8-bcf8-375361991fcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 16:09:19.613252 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writer thread running {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 16:09:19.731572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d1f57-9d44-48a8-bcf8-375361991fcb None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:19.735762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166de5b7-f351-477f-8b4c-8be817b6323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:19.736428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166de5b7-f351-477f-8b4c-8be817b6323d admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:19.736715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166de5b7-f351-477f-8b4c-8be817b6323d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:19.736994 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166de5b7-f351-477f-8b4c-8be817b6323d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:19.745743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166de5b7-f351-477f-8b4c-8be817b6323d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:19.797399 dv-cinder-797608-56-smb devstack@keystone.service[80380]: WARNING keystone.common.rbac_enforcer.enforcer [None req-166de5b7-f351-477f-8b4c-8be817b6323d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 16:09:19.797743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166de5b7-f351-477f-8b4c-8be817b6323d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:19.807681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Tue Jul 12 16:09:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:09:19.813767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece11d6-52ae-43dc-8d3f-9295cbf7076b None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:19.829172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece11d6-52ae-43dc-8d3f-9295cbf7076b None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:19.833582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2526d0-b165-49c8-8285-5886a77d3b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:19.834721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2526d0-b165-49c8-8285-5886a77d3b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:19.835024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2526d0-b165-49c8-8285-5886a77d3b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:19.835309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2526d0-b165-49c8-8285-5886a77d3b00 admin admin] PATH_INFO: `/v3/projects/d20bec087d7d4867acdc2fcb7538cbf2` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:19.839387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2526d0-b165-49c8-8285-5886a77d3b00 admin admin] RBAC: Authorizing `identity:get_project(project_id=d20bec087d7d4867acdc2fcb7538cbf2)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:19.891003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bd2526d0-b165-49c8-8285-5886a77d3b00 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 16:09:19.891349 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2526d0-b165-49c8-8285-5886a77d3b00 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:19.895903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Tue Jul 12 16:09:19 2022] GET /identity/v3/projects/d20bec087d7d4867acdc2fcb7538cbf2 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:21.887359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d22b-84c3-4f07-b448-efd3da2e1a26 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:21.887882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d22b-84c3-4f07-b448-efd3da2e1a26 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:21.887981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d22b-84c3-4f07-b448-efd3da2e1a26 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:21.892072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:21.898330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a720b-0431-4432-8ed7-f05c68db7ab5 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:21.898756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a720b-0431-4432-8ed7-f05c68db7ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:21.898940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a720b-0431-4432-8ed7-f05c68db7ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:21.918279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-000a720b-0431-4432-8ed7-f05c68db7ab5 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:21.919808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-000a720b-0431-4432-8ed7-f05c68db7ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:21.927699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 16:09:21.949983 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476d22b-84c3-4f07-b448-efd3da2e1a26 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:21.962586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476d22b-84c3-4f07-b448-efd3da2e1a26 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:21.966742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc99d99-64c4-488d-842d-bca865590748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:21.967380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc99d99-64c4-488d-842d-bca865590748 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:21.967668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc99d99-64c4-488d-842d-bca865590748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:21.967948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc99d99-64c4-488d-842d-bca865590748 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:21.976245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc99d99-64c4-488d-842d-bca865590748 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:21.978085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc99d99-64c4-488d-842d-bca865590748 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:21.986825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Tue Jul 12 16:09:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:09:21.992085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a720b-0431-4432-8ed7-f05c68db7ab5 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:22.000936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a720b-0431-4432-8ed7-f05c68db7ab5 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:22.005289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92420861-db05-4b55-827e-66f023ab4212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:22.006171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92420861-db05-4b55-827e-66f023ab4212 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:22.006455 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92420861-db05-4b55-827e-66f023ab4212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:22.006728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92420861-db05-4b55-827e-66f023ab4212 admin admin] PATH_INFO: `/v3/users/8b9c6c8e314d439cb5330941f3032bd9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:22.008096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92420861-db05-4b55-827e-66f023ab4212 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b9c6c8e314d439cb5330941f3032bd9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:22.009928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92420861-db05-4b55-827e-66f023ab4212 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:22.011480 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Tue Jul 12 16:09:21 2022] GET /identity/v3/users/8b9c6c8e314d439cb5330941f3032bd9 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:24.095686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5570c4-d5e3-4267-9143-2c966ec77f36 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:24.096219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5570c4-d5e3-4267-9143-2c966ec77f36 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:24.096219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5570c4-d5e3-4267-9143-2c966ec77f36 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:24.097645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:24.102918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11797472-975c-42a0-a6ec-87a78c309302 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:24.103336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11797472-975c-42a0-a6ec-87a78c309302 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:24.103485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11797472-975c-42a0-a6ec-87a78c309302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:24.103646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345918fd-8130-4bdd-baf0-1c62182ab59c None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:24.103939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345918fd-8130-4bdd-baf0-1c62182ab59c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:24.104219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345918fd-8130-4bdd-baf0-1c62182ab59c None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:24.105499 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:09:24.110419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd895f5-f5b8-4df3-b0b7-aaa4bea15b32 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:24.110702 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd895f5-f5b8-4df3-b0b7-aaa4bea15b32 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:24.110980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd895f5-f5b8-4df3-b0b7-aaa4bea15b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:24.120547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-11797472-975c-42a0-a6ec-87a78c309302 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:24.121773 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-11797472-975c-42a0-a6ec-87a78c309302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:24.150963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG passlib.handlers.bcrypt [None req-4bd895f5-f5b8-4df3-b0b7-aaa4bea15b32 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80380) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 16:09:24.151377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG passlib.handlers.bcrypt [None req-4bd895f5-f5b8-4df3-b0b7-aaa4bea15b32 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80380) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 16:09:24.197397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-4bd895f5-f5b8-4df3-b0b7-aaa4bea15b32 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:24.198980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4bd895f5-f5b8-4df3-b0b7-aaa4bea15b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:24.201882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:24.225643 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11797472-975c-42a0-a6ec-87a78c309302 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:24.249399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:24.299625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:09:24.322871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd895f5-f5b8-4df3-b0b7-aaa4bea15b32 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:24.334780 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11797472-975c-42a0-a6ec-87a78c309302 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:24.369170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21760118-352c-4bdd-9ddc-0035918f52a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:24.369903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760118-352c-4bdd-9ddc-0035918f52a1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:24.370191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760118-352c-4bdd-9ddc-0035918f52a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:24.370474 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760118-352c-4bdd-9ddc-0035918f52a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:24.381428 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21760118-352c-4bdd-9ddc-0035918f52a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-21760118-352c-4bdd-9ddc-0035918f52a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:24.392804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:24.393774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:24.394642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:24.394642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:24.394642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:24.394642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:24.394642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:24.394642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:24.394642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:24.394642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:24.394642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:24.394642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:24.394642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:24.394642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:09:24.394642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:09:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:09:24.400181 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21760118-352c-4bdd-9ddc-0035918f52a1 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:24.423219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd895f5-f5b8-4df3-b0b7-aaa4bea15b32 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:24.426297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:24.462082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0c4a3-9658-4895-a50a-935be2b11500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:24.462991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0c4a3-9658-4895-a50a-935be2b11500 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:24.463284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0c4a3-9658-4895-a50a-935be2b11500 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:24.463567 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0c4a3-9658-4895-a50a-935be2b11500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:24.486349 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:24.505268 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21760118-352c-4bdd-9ddc-0035918f52a1 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:24.531026 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0c4a3-9658-4895-a50a-935be2b11500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:24.532565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0c4a3-9658-4895-a50a-935be2b11500 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:24.539104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecda83-09ac-4291-8e83-6dd7d4ee4bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:24.539771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecda83-09ac-4291-8e83-6dd7d4ee4bab None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:24.540058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecda83-09ac-4291-8e83-6dd7d4ee4bab None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:24.540336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecda83-09ac-4291-8e83-6dd7d4ee4bab None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:24.541082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecda83-09ac-4291-8e83-6dd7d4ee4bab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:24.541420 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecda83-09ac-4291-8e83-6dd7d4ee4bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:24.542786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecda83-09ac-4291-8e83-6dd7d4ee4bab None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:24.555087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:24.560313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecda83-09ac-4291-8e83-6dd7d4ee4bab None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:24.630416 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 16:09:24.635947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0c4a3-9658-4895-a50a-935be2b11500 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:24.638648 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:24.659302 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecda83-09ac-4291-8e83-6dd7d4ee4bab None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:24.693265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d7e45-786c-4c1a-b1d4-4a5949de67e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:24.694133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d7e45-786c-4c1a-b1d4-4a5949de67e9 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:24.694414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d7e45-786c-4c1a-b1d4-4a5949de67e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:24.694687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d7e45-786c-4c1a-b1d4-4a5949de67e9 None admin] PATH_INFO: `/v3/users/8b9c6c8e314d439cb5330941f3032bd9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:24.695880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d7e45-786c-4c1a-b1d4-4a5949de67e9 None admin] RBAC: Authorizing `identity:get_user(user_id=8b9c6c8e314d439cb5330941f3032bd9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:24.697368 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d7e45-786c-4c1a-b1d4-4a5949de67e9 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:24.698968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:24 2022] GET /identity/v3/users/8b9c6c8e314d439cb5330941f3032bd9 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:24.704179 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d7e45-786c-4c1a-b1d4-4a5949de67e9 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:24.718516 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:24.736542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0c4a3-9658-4895-a50a-935be2b11500 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:24.769089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337df33-0fe1-4d9d-b7de-e92b235c9f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:24.769915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337df33-0fe1-4d9d-b7de-e92b235c9f17 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:24.770195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337df33-0fe1-4d9d-b7de-e92b235c9f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:24.770468 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337df33-0fe1-4d9d-b7de-e92b235c9f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:24.789280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337df33-0fe1-4d9d-b7de-e92b235c9f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:24.790746 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337df33-0fe1-4d9d-b7de-e92b235c9f17 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:24.803194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d7e45-786c-4c1a-b1d4-4a5949de67e9 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-6337df33-0fe1-4d9d-b7de-e92b235c9f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:09:24.811145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:24.812068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:24.813085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:09:24.813085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:09:24.813085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:09:24.813085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:09:24.813085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:09:24.818346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337df33-0fe1-4d9d-b7de-e92b235c9f17 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:24.839708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471af1cd-559b-426b-b5be-edcb2eb30a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:24.840505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471af1cd-559b-426b-b5be-edcb2eb30a72 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:24.840788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471af1cd-559b-426b-b5be-edcb2eb30a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:24.841063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471af1cd-559b-426b-b5be-edcb2eb30a72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:24.842284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471af1cd-559b-426b-b5be-edcb2eb30a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:24.843720 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471af1cd-559b-426b-b5be-edcb2eb30a72 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:24.845473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:24.851554 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471af1cd-559b-426b-b5be-edcb2eb30a72 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:24.874159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:24.917164 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337df33-0fe1-4d9d-b7de-e92b235c9f17 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:24.929089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:24.947978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471af1cd-559b-426b-b5be-edcb2eb30a72 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:24.950369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f83084-010f-46f2-9866-d45bfb8561cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:24.951030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f83084-010f-46f2-9866-d45bfb8561cf None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:24.951314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f83084-010f-46f2-9866-d45bfb8561cf None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:24.951588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f83084-010f-46f2-9866-d45bfb8561cf None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:24.952308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f83084-010f-46f2-9866-d45bfb8561cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:24.952612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f83084-010f-46f2-9866-d45bfb8561cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:24.954033 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f83084-010f-46f2-9866-d45bfb8561cf None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:24.971222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 10/20] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:24.981500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf39dcd-a7ae-49f9-9e5c-935d8ddecf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:24.982190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf39dcd-a7ae-49f9-9e5c-935d8ddecf01 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:24.982477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf39dcd-a7ae-49f9-9e5c-935d8ddecf01 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:24.982757 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf39dcd-a7ae-49f9-9e5c-935d8ddecf01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:24.983658 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf39dcd-a7ae-49f9-9e5c-935d8ddecf01 None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.domain.id=default, user.id=8b9c6c8e314d439cb5330941f3032bd9) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:24.983977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf39dcd-a7ae-49f9-9e5c-935d8ddecf01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:24.985598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf39dcd-a7ae-49f9-9e5c-935d8ddecf01 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:24.994533 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 11/21] 10.222.0.26 () {56 vars in 1322 bytes} [Tue Jul 12 16:09:24 2022] GET /identity/v3/role_assignments?user.id=8b9c6c8e314d439cb5330941f3032bd9&scope.domain.id=default&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:27.490501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a95c55-e153-4cb3-967c-2d39e669a601 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:27.491002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a95c55-e153-4cb3-967c-2d39e669a601 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:27.491102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a95c55-e153-4cb3-967c-2d39e669a601 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:27.492625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 11/22] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:27.502546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88f398-a275-496e-8aa4-a7c99bd8a07a None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:27.503414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88f398-a275-496e-8aa4-a7c99bd8a07a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:27.503900 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88f398-a275-496e-8aa4-a7c99bd8a07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:27.530147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-dc88f398-a275-496e-8aa4-a7c99bd8a07a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:27.531815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-dc88f398-a275-496e-8aa4-a7c99bd8a07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:27.546153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9d6ec-dac4-43cf-a6f7-ba7a7160466d None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:27.546753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9d6ec-dac4-43cf-a6f7-ba7a7160466d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:27.547234 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9d6ec-dac4-43cf-a6f7-ba7a7160466d None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:27.549102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 12/23] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:27.554171 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3ca40-e4c1-4112-bd4f-482b1c5dab10 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:27.554727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3ca40-e4c1-4112-bd4f-482b1c5dab10 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:27.555277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3ca40-e4c1-4112-bd4f-482b1c5dab10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:27.585060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a1a3ca40-e4c1-4112-bd4f-482b1c5dab10 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:27.586646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a1a3ca40-e4c1-4112-bd4f-482b1c5dab10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:27.651932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 12/24] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:27.653995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56d61c-1e2f-44cf-a301-ccf6c47bcc95 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:27.654504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56d61c-1e2f-44cf-a301-ccf6c47bcc95 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:27.654983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56d61c-1e2f-44cf-a301-ccf6c47bcc95 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:27.656977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 13/25] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:27.663255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37739d-07c4-4136-8270-a77e62c2c363 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:27.663907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37739d-07c4-4136-8270-a77e62c2c363 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:27.664397 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37739d-07c4-4136-8270-a77e62c2c363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:27.684677 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-8c37739d-07c4-4136-8270-a77e62c2c363 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:27.691983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8c37739d-07c4-4136-8270-a77e62c2c363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:27.748305 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:09:27.749567 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3ca40-e4c1-4112-bd4f-482b1c5dab10 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:27.789398 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:09:27.797281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df5027-88a9-45f6-887a-e6d1320d69b3 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:27.797281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df5027-88a9-45f6-887a-e6d1320d69b3 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:27.797281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df5027-88a9-45f6-887a-e6d1320d69b3 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:27.797281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 15/28] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:27.797281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df5027-88a9-45f6-887a-e6d1320d69b3 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:27.804578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:27.831813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:27.899781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3ca40-e4c1-4112-bd4f-482b1c5dab10 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:27.932025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df5027-88a9-45f6-887a-e6d1320d69b3 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:27.941582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de047bb1-53d2-4303-a60c-a578257fd44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:27.942711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de047bb1-53d2-4303-a60c-a578257fd44d None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:27.943395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de047bb1-53d2-4303-a60c-a578257fd44d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:27.943832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de047bb1-53d2-4303-a60c-a578257fd44d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:27.961185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de047bb1-53d2-4303-a60c-a578257fd44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:27.970593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9945c4-322e-4c72-b3d4-d48d6d1532b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-de047bb1-53d2-4303-a60c-a578257fd44d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:27.971229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:27.972261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:27.973341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:27.973341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:27.973341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:27.973341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:27.973341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:27.973341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:27.973341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:27.973341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:27.973341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:27.973341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:27.973341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:27.973341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:09:27.974124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9945c4-322e-4c72-b3d4-d48d6d1532b9 None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:27.974124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9945c4-322e-4c72-b3d4-d48d6d1532b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:27.974124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9945c4-322e-4c72-b3d4-d48d6d1532b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:27.975434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9945c4-322e-4c72-b3d4-d48d6d1532b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:27.976329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 14/29] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:09:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:27.981789 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9945c4-322e-4c72-b3d4-d48d6d1532b9 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:27.982942 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b623e0e-3561-4621-8524-8d8ab4765c05 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:27.983572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b623e0e-3561-4621-8524-8d8ab4765c05 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:27.983776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b623e0e-3561-4621-8524-8d8ab4765c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:28.004935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-1b623e0e-3561-4621-8524-8d8ab4765c05 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:28.004935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1b623e0e-3561-4621-8524-8d8ab4765c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:28.074283 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 15/30] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:28.074893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b623e0e-3561-4621-8524-8d8ab4765c05 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:28.132193 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:28.203211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b623e0e-3561-4621-8524-8d8ab4765c05 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:28.206765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 16/31] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Jul 12 16:09:27 2022] POST /identity/v3/roles => generated 219 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:09:28.207861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9945c4-322e-4c72-b3d4-d48d6d1532b9 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:28.251195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed52be-c4f2-446f-8506-a5e2e4e47103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:28.252435 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed52be-c4f2-446f-8506-a5e2e4e47103 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:28.252917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed52be-c4f2-446f-8506-a5e2e4e47103 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:28.253424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed52be-c4f2-446f-8506-a5e2e4e47103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:28.268876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed52be-c4f2-446f-8506-a5e2e4e47103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:28.272585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed52be-c4f2-446f-8506-a5e2e4e47103 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:28.281702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-f9ed52be-c4f2-446f-8506-a5e2e4e47103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:09:28.298044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:28.299112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:28.300151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:09:28.300151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:09:28.300151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:09:28.300151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:09:28.302646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 16/32] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:28.303738 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed52be-c4f2-446f-8506-a5e2e4e47103 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:28.335058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9945c4-322e-4c72-b3d4-d48d6d1532b9 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:28.386547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63687998-c388-4846-a229-c0248909c3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:28.387552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63687998-c388-4846-a229-c0248909c3ee None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:28.388013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63687998-c388-4846-a229-c0248909c3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:28.388433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63687998-c388-4846-a229-c0248909c3ee None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:28.389684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63687998-c388-4846-a229-c0248909c3ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:28.390843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63687998-c388-4846-a229-c0248909c3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:28.392862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63687998-c388-4846-a229-c0248909c3ee None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:28.406379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 17/33] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:28.407593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63687998-c388-4846-a229-c0248909c3ee None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:28.430908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:28.465173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed52be-c4f2-446f-8506-a5e2e4e47103 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:28.515720 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572cc1b-95b4-4004-8fc2-63794db3e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:28.516495 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572cc1b-95b4-4004-8fc2-63794db3e7df None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:28.517260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572cc1b-95b4-4004-8fc2-63794db3e7df None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:28.517505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572cc1b-95b4-4004-8fc2-63794db3e7df None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:28.518578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572cc1b-95b4-4004-8fc2-63794db3e7df None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:28.520705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572cc1b-95b4-4004-8fc2-63794db3e7df None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:28.537930 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63687998-c388-4846-a229-c0248909c3ee None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:28.564413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:28.573416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287f884-fdce-4ef4-8aa8-bd4d90c5f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:28.574091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287f884-fdce-4ef4-8aa8-bd4d90c5f206 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:28.574381 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287f884-fdce-4ef4-8aa8-bd4d90c5f206 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:28.574662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287f884-fdce-4ef4-8aa8-bd4d90c5f206 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:28.575396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287f884-fdce-4ef4-8aa8-bd4d90c5f206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:28.575704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287f884-fdce-4ef4-8aa8-bd4d90c5f206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:28.577090 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287f884-fdce-4ef4-8aa8-bd4d90c5f206 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:28.594745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 18/34] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:28.595575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287f884-fdce-4ef4-8aa8-bd4d90c5f206 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:28.707935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287f884-fdce-4ef4-8aa8-bd4d90c5f206 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:28.734289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 17/35] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Jul 12 16:09:28 2022] POST /identity/v3/roles => generated 225 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:09:28.735256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572cc1b-95b4-4004-8fc2-63794db3e7df None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:28.752773 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49536d32-911f-46ae-be3e-68c1d3f21400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:28.753712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49536d32-911f-46ae-be3e-68c1d3f21400 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:28.754000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49536d32-911f-46ae-be3e-68c1d3f21400 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:28.757195 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49536d32-911f-46ae-be3e-68c1d3f21400 None admin] PATH_INFO: `/v3/users/8b9c6c8e314d439cb5330941f3032bd9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:28.757195 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49536d32-911f-46ae-be3e-68c1d3f21400 None admin] RBAC: Authorizing `identity:get_user(user_id=8b9c6c8e314d439cb5330941f3032bd9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:28.757878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49536d32-911f-46ae-be3e-68c1d3f21400 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:28.760625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 19/36] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:28 2022] GET /identity/v3/users/8b9c6c8e314d439cb5330941f3032bd9 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:28.768308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49536d32-911f-46ae-be3e-68c1d3f21400 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:28.842098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:28.903943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49536d32-911f-46ae-be3e-68c1d3f21400 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:28.907306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572cc1b-95b4-4004-8fc2-63794db3e7df None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:28.948976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4471904-c171-442f-b41a-d9d195f9c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:28.949777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4471904-c171-442f-b41a-d9d195f9c678 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:28.949879 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd4f82-34e3-4a07-bdc6-58d59f5268c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:28.950064 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4471904-c171-442f-b41a-d9d195f9c678 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:28.950345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4471904-c171-442f-b41a-d9d195f9c678 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:28.950612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd4f82-34e3-4a07-bdc6-58d59f5268c9 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:28.951298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd4f82-34e3-4a07-bdc6-58d59f5268c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:28.951298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd4f82-34e3-4a07-bdc6-58d59f5268c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:28.951449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4471904-c171-442f-b41a-d9d195f9c678 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:28.955691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd4f82-34e3-4a07-bdc6-58d59f5268c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:28.955833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4471904-c171-442f-b41a-d9d195f9c678 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:28.955909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd4f82-34e3-4a07-bdc6-58d59f5268c9 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:28.956318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 20/37] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:28.961637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebeed7-9037-4c5e-84d9-e428eba915fd None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:28.961932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebeed7-9037-4c5e-84d9-e428eba915fd None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:28.962217 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebeed7-9037-4c5e-84d9-e428eba915fd None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:28.963585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 21/38] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:28.964287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebeed7-9037-4c5e-84d9-e428eba915fd None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:29.065715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:29.072419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 18/39] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:09:28 2022] POST /identity/v3/projects => generated 301 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:09:29.077194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebeed7-9037-4c5e-84d9-e428eba915fd None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:29.077473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff8bcc-1b6d-484a-a05e-27507ebf1afe None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:29.077473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff8bcc-1b6d-484a-a05e-27507ebf1afe None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:29.077473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff8bcc-1b6d-484a-a05e-27507ebf1afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:29.096465 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-bdff8bcc-1b6d-484a-a05e-27507ebf1afe None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:29.098183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bdff8bcc-1b6d-484a-a05e-27507ebf1afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:29.101848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:29.115553 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5337a69-a72c-433f-8d18-6b50ee44eeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:29.116524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5337a69-a72c-433f-8d18-6b50ee44eeac None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:29.116828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5337a69-a72c-433f-8d18-6b50ee44eeac None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:29.117084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5337a69-a72c-433f-8d18-6b50ee44eeac None admin] PATH_INFO: `/v3/domains/default/users/8b9c6c8e314d439cb5330941f3032bd9/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:29.119345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5337a69-a72c-433f-8d18-6b50ee44eeac None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8b9c6c8e314d439cb5330941f3032bd9, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:29.120926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5337a69-a72c-433f-8d18-6b50ee44eeac None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:29.175079 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 19/40] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:29.176226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483ac96-ab75-4ffd-a825-c87666654a73 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:29.176519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483ac96-ab75-4ffd-a825-c87666654a73 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:29.176808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483ac96-ab75-4ffd-a825-c87666654a73 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:29.178424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 20/41] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:29.183645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6a47a-3fea-4072-98cb-899e1d90e22a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:29.183943 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6a47a-3fea-4072-98cb-899e1d90e22a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:29.184235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6a47a-3fea-4072-98cb-899e1d90e22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:29.203558 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e5f6a47a-3fea-4072-98cb-899e1d90e22a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:29.204786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e5f6a47a-3fea-4072-98cb-899e1d90e22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:29.225316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 22/42] 10.222.0.26 () {58 vars in 1361 bytes} [Tue Jul 12 16:09:28 2022] PUT /identity/v3/domains/default/users/8b9c6c8e314d439cb5330941f3032bd9/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:09:29.226158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5337a69-a72c-433f-8d18-6b50ee44eeac None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:29.310177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:09:29.335271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6a47a-3fea-4072-98cb-899e1d90e22a None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:29.410295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:29.460906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6a47a-3fea-4072-98cb-899e1d90e22a None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:29.484742 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5337a69-a72c-433f-8d18-6b50ee44eeac None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:29.496118 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe078bd-91ff-4767-b733-b19ff72fef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:29.496924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe078bd-91ff-4767-b733-b19ff72fef6e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:29.497241 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe078bd-91ff-4767-b733-b19ff72fef6e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:29.497525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe078bd-91ff-4767-b733-b19ff72fef6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:29.498718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe078bd-91ff-4767-b733-b19ff72fef6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:29.500183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe078bd-91ff-4767-b733-b19ff72fef6e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:29.501860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 22/44] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:29.507811 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe078bd-91ff-4767-b733-b19ff72fef6e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:29.524415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d0ca9-7804-4f88-becd-11708654991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:29.525585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d0ca9-7804-4f88-becd-11708654991e None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:29.526024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d0ca9-7804-4f88-becd-11708654991e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:29.526310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d0ca9-7804-4f88-becd-11708654991e None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:29.527072 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d0ca9-7804-4f88-becd-11708654991e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:29.528468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d0ca9-7804-4f88-becd-11708654991e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:29.597447 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 23/45] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Jul 12 16:09:29 2022] POST /identity/v3/roles => generated 223 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:09:29.620463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe078bd-91ff-4767-b733-b19ff72fef6e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:29.651658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:29.663667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49185b1-f88d-4a3a-af4d-fdaf6717bca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:29.663667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49185b1-f88d-4a3a-af4d-fdaf6717bca8 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:29.663667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49185b1-f88d-4a3a-af4d-fdaf6717bca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:29.663667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49185b1-f88d-4a3a-af4d-fdaf6717bca8 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:29.664108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49185b1-f88d-4a3a-af4d-fdaf6717bca8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:29.665268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49185b1-f88d-4a3a-af4d-fdaf6717bca8 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:29.746420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:09:29 2022] POST /identity/v3/projects => generated 312 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:09:31.277186 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4e0d-2fa9-4b29-a6d5-ffa9422f9d32 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:31.277734 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4e0d-2fa9-4b29-a6d5-ffa9422f9d32 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:31.277734 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4e0d-2fa9-4b29-a6d5-ffa9422f9d32 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:31.279124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 24/47] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:31.284530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fb1d6-55ba-4ffa-b2f6-dc5c2ee4e824 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:31.284932 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fb1d6-55ba-4ffa-b2f6-dc5c2ee4e824 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:31.285094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fb1d6-55ba-4ffa-b2f6-dc5c2ee4e824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:31.409132 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-bd4fb1d6-55ba-4ffa-b2f6-dc5c2ee4e824 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:31.410432 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bd4fb1d6-55ba-4ffa-b2f6-dc5c2ee4e824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:31.480207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:31.502491 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4e0d-2fa9-4b29-a6d5-ffa9422f9d32 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:31.548034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:31.605380 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4e0d-2fa9-4b29-a6d5-ffa9422f9d32 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:31.639866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ebb90-5987-40cd-9bf4-26e0ad1980a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:31.640658 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ebb90-5987-40cd-9bf4-26e0ad1980a5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:31.640947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ebb90-5987-40cd-9bf4-26e0ad1980a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:31.641255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ebb90-5987-40cd-9bf4-26e0ad1980a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:31.651303 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ebb90-5987-40cd-9bf4-26e0ad1980a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-0f4ebb90-5987-40cd-9bf4-26e0ad1980a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:31.658995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:31.659865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:31.660788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:31.660788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:31.660788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:31.660788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:31.660788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:31.660788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:31.660788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:31.660788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:31.660788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:31.660788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:31.660788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:31.660788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:09:31.660788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 25/49] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:09:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:31.666058 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fb1d6-55ba-4ffa-b2f6-dc5c2ee4e824 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:31.765265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fb1d6-55ba-4ffa-b2f6-dc5c2ee4e824 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:31.775882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:31.798397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16004c-69a7-43ba-9480-af9e257d1ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:31.798999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16004c-69a7-43ba-9480-af9e257d1ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:31.799283 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16004c-69a7-43ba-9480-af9e257d1ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:31.799555 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16004c-69a7-43ba-9480-af9e257d1ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:31.800414 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16004c-69a7-43ba-9480-af9e257d1ea5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:31.800771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16004c-69a7-43ba-9480-af9e257d1ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:31.802918 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16004c-69a7-43ba-9480-af9e257d1ea5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:31.814856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 25/50] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:31.821209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ebb90-5987-40cd-9bf4-26e0ad1980a5 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:31.860254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609bee4-e5ca-4c8f-bb37-455e03fb8be7 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:31.860539 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609bee4-e5ca-4c8f-bb37-455e03fb8be7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:31.860830 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609bee4-e5ca-4c8f-bb37-455e03fb8be7 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:31.862422 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 26/51] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:09:31.867890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e0bb9-3a9f-4366-92a2-b09a5b08d83b None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:31.868181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e0bb9-3a9f-4366-92a2-b09a5b08d83b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:31.868462 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e0bb9-3a9f-4366-92a2-b09a5b08d83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:31.885518 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-b25e0bb9-3a9f-4366-92a2-b09a5b08d83b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:31.886811 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b25e0bb9-3a9f-4366-92a2-b09a5b08d83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:31.923145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ebb90-5987-40cd-9bf4-26e0ad1980a5 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:31.924747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:31.953731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 27/52] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:09:31.957350 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ee20d-61bb-49f7-9b96-5efdc6318695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:31.958240 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee20d-61bb-49f7-9b96-5efdc6318695 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:31.959104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee20d-61bb-49f7-9b96-5efdc6318695 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:31.959392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee20d-61bb-49f7-9b96-5efdc6318695 None admin] PATH_INFO: `/v3/users/8b9c6c8e314d439cb5330941f3032bd9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:31.960639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ee20d-61bb-49f7-9b96-5efdc6318695 None admin] RBAC: Authorizing `identity:get_user(user_id=8b9c6c8e314d439cb5330941f3032bd9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:31.962182 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ee20d-61bb-49f7-9b96-5efdc6318695 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:31.968417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:31 2022] GET /identity/v3/users/8b9c6c8e314d439cb5330941f3032bd9 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:31.969174 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e0bb9-3a9f-4366-92a2-b09a5b08d83b None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:31.977237 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ee20d-61bb-49f7-9b96-5efdc6318695 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:32.071952 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e0bb9-3a9f-4366-92a2-b09a5b08d83b None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:32.073500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:32.077551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ee20d-61bb-49f7-9b96-5efdc6318695 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:32.106029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7af605-718c-489e-8b76-e2664ee497bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:32.106836 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7af605-718c-489e-8b76-e2664ee497bb None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:32.107121 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7af605-718c-489e-8b76-e2664ee497bb None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:32.107398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7af605-718c-489e-8b76-e2664ee497bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:32.108571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7af605-718c-489e-8b76-e2664ee497bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:32.110098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7af605-718c-489e-8b76-e2664ee497bb None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:32.111520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b5c12-17ba-48af-a6e9-5ef2eef1546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:32.111724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 28/54] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:32.112326 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b5c12-17ba-48af-a6e9-5ef2eef1546c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:32.112616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b5c12-17ba-48af-a6e9-5ef2eef1546c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:32.112979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b5c12-17ba-48af-a6e9-5ef2eef1546c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:32.114221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b5c12-17ba-48af-a6e9-5ef2eef1546c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:32.115767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b5c12-17ba-48af-a6e9-5ef2eef1546c None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:32.117573 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:32.117673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7af605-718c-489e-8b76-e2664ee497bb None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:32.123996 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b5c12-17ba-48af-a6e9-5ef2eef1546c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:32.164910 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:32.219059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7af605-718c-489e-8b76-e2664ee497bb None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:32.225279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b5c12-17ba-48af-a6e9-5ef2eef1546c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:32.252848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb508e3-58e9-45c7-beb1-5066219f538b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:32.253531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb508e3-58e9-45c7-beb1-5066219f538b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:32.253817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb508e3-58e9-45c7-beb1-5066219f538b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:32.254100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb508e3-58e9-45c7-beb1-5066219f538b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:32.254933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb508e3-58e9-45c7-beb1-5066219f538b None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.domain.id=default, user.id=8b9c6c8e314d439cb5330941f3032bd9) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:32.255288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb508e3-58e9-45c7-beb1-5066219f538b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:32.257275 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb508e3-58e9-45c7-beb1-5066219f538b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:32.259267 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53286d-5120-42fd-beac-61ed949efc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:32.259928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53286d-5120-42fd-beac-61ed949efc71 None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:32.260220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53286d-5120-42fd-beac-61ed949efc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:32.260503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53286d-5120-42fd-beac-61ed949efc71 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:32.261311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53286d-5120-42fd-beac-61ed949efc71 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:32.262756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53286d-5120-42fd-beac-61ed949efc71 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:32.265894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 29/56] 10.222.0.26 () {56 vars in 1322 bytes} [Tue Jul 12 16:09:32 2022] GET /identity/v3/role_assignments?user.id=8b9c6c8e314d439cb5330941f3032bd9&scope.domain.id=default&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:32.345312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 28/57] 10.222.0.26 () {60 vars in 1140 bytes} [Tue Jul 12 16:09:32 2022] POST /identity/v3/projects => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:09:34.363261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f7e1d-7640-4259-835e-4aa66e054d0f None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:34.363772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f7e1d-7640-4259-835e-4aa66e054d0f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:34.363880 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f7e1d-7640-4259-835e-4aa66e054d0f None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:34.365301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 30/58] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:34.370417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f295c4-c56a-4e2d-ab37-23fa8615ee7a None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:34.370818 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f295c4-c56a-4e2d-ab37-23fa8615ee7a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:34.370987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f295c4-c56a-4e2d-ab37-23fa8615ee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:34.388612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-99f295c4-c56a-4e2d-ab37-23fa8615ee7a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:34.390290 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-99f295c4-c56a-4e2d-ab37-23fa8615ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:34.456694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 29/59] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:34.481832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f7e1d-7640-4259-835e-4aa66e054d0f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:34.517551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:34.581858 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f7e1d-7640-4259-835e-4aa66e054d0f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:34.614088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d295120-6ee0-4bc0-8e55-67d1ee73646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:34.615352 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d295120-6ee0-4bc0-8e55-67d1ee73646a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:34.615636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d295120-6ee0-4bc0-8e55-67d1ee73646a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:34.615914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d295120-6ee0-4bc0-8e55-67d1ee73646a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:34.617098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d295120-6ee0-4bc0-8e55-67d1ee73646a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:34.618594 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d295120-6ee0-4bc0-8e55-67d1ee73646a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:34.620193 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 31/60] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:34.625788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f295c4-c56a-4e2d-ab37-23fa8615ee7a None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:34.646659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:34.721485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f295c4-c56a-4e2d-ab37-23fa8615ee7a None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:34.754204 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d66a2-5137-457c-a282-49c5165dffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:34.754871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d66a2-5137-457c-a282-49c5165dffd4 None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:34.755744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d66a2-5137-457c-a282-49c5165dffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:34.756037 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d66a2-5137-457c-a282-49c5165dffd4 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:34.756755 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d66a2-5137-457c-a282-49c5165dffd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:34.758302 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d66a2-5137-457c-a282-49c5165dffd4 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:34.853119 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 30/61] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:09:34 2022] POST /identity/v3/users => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:09:38.025599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd95dd8-844d-4589-bc7c-52f9c2774fad None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.026619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd95dd8-844d-4589-bc7c-52f9c2774fad None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.027158 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd95dd8-844d-4589-bc7c-52f9c2774fad None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.028746 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 32/62] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:38.034095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a7731-5ecb-4d7a-8734-7059b768b6b9 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.034931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a7731-5ecb-4d7a-8734-7059b768b6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.035416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a7731-5ecb-4d7a-8734-7059b768b6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.038775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dad50-8362-46f2-96e1-27eabd88eb7d None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.039303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dad50-8362-46f2-96e1-27eabd88eb7d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.039789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dad50-8362-46f2-96e1-27eabd88eb7d None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.041364 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 33/63] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:09:38.046206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64bc1d-bee2-467a-a3bf-3486f0c00560 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.046741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64bc1d-bee2-467a-a3bf-3486f0c00560 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.047242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64bc1d-bee2-467a-a3bf-3486f0c00560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.075747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-8c5a7731-5ecb-4d7a-8734-7059b768b6b9 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:38.076966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ba64bc1d-bee2-467a-a3bf-3486f0c00560 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:38.078404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8c5a7731-5ecb-4d7a-8734-7059b768b6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:38.079773 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ba64bc1d-bee2-467a-a3bf-3486f0c00560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:38.188010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 31/64] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:38.207409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 34/65] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:09:38.223120 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a7731-5ecb-4d7a-8734-7059b768b6b9 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:38.231395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:38.250889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64bc1d-bee2-467a-a3bf-3486f0c00560 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:38.297792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:38.347958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a7731-5ecb-4d7a-8734-7059b768b6b9 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:38.388918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4998a-1770-48b5-8a31-77e3c4ba3aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:38.390981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64bc1d-bee2-467a-a3bf-3486f0c00560 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:38.391847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4998a-1770-48b5-8a31-77e3c4ba3aea None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.392371 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4998a-1770-48b5-8a31-77e3c4ba3aea None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.392936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4998a-1770-48b5-8a31-77e3c4ba3aea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.407552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4998a-1770-48b5-8a31-77e3c4ba3aea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-9dc4998a-1770-48b5-8a31-77e3c4ba3aea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:38.417842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:38.418916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:38.419917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:38.419917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:38.419917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:38.419917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:38.419917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:38.419917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:38.419917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:38.419917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:38.419917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:38.419917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:38.419917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:38.419917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:09:38.422528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 32/66] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:38.424313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649772d-6d93-4df7-9f07-f6e6f5da7e61 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.424766 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649772d-6d93-4df7-9f07-f6e6f5da7e61 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.425593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649772d-6d93-4df7-9f07-f6e6f5da7e61 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.428300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 33/67] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:38.431256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649772d-6d93-4df7-9f07-f6e6f5da7e61 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:38.439638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bbed3-62a9-440d-8611-fb7cc810c8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:38.441865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bbed3-62a9-440d-8611-fb7cc810c8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.442170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bbed3-62a9-440d-8611-fb7cc810c8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.443508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bbed3-62a9-440d-8611-fb7cc810c8f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.456186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bbed3-62a9-440d-8611-fb7cc810c8f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-0d3bbed3-62a9-440d-8611-fb7cc810c8f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:38.464791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:38.465794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:38.466561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:38.466561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:38.466561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:38.466561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:38.466561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:38.466561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:38.466561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:38.466561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:38.466561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:38.466561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:38.466561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:38.466561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:09:38.466561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 35/68] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:09:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:09:38.467767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18b2ef-09cf-45b2-a70f-bce82e6d14d7 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.472795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18b2ef-09cf-45b2-a70f-bce82e6d14d7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.473148 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18b2ef-09cf-45b2-a70f-bce82e6d14d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.490692 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-0f18b2ef-09cf-45b2-a70f-bce82e6d14d7 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:38.491894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0f18b2ef-09cf-45b2-a70f-bce82e6d14d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:38.509031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:38.546307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649772d-6d93-4df7-9f07-f6e6f5da7e61 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:38.566680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 36/69] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:38.566680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18b2ef-09cf-45b2-a70f-bce82e6d14d7 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:38.580947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f3684-b055-46c8-8ff3-1c6e9a967237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:38.581648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f3684-b055-46c8-8ff3-1c6e9a967237 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.581935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f3684-b055-46c8-8ff3-1c6e9a967237 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.582213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f3684-b055-46c8-8ff3-1c6e9a967237 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.582964 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f3684-b055-46c8-8ff3-1c6e9a967237 None admin] RBAC: Adding query filter params (name=member) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:38.583301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f3684-b055-46c8-8ff3-1c6e9a967237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:38.584692 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f3684-b055-46c8-8ff3-1c6e9a967237 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:38.593211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 34/70] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:09:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:38.594484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138850be-4064-4058-afba-827319aead73 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.594771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138850be-4064-4058-afba-827319aead73 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.595052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138850be-4064-4058-afba-827319aead73 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.596281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 35/71] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:38.597356 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e6ca9-4195-4388-a3a3-6f1c4f823d2a None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.597703 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e6ca9-4195-4388-a3a3-6f1c4f823d2a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.597988 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e6ca9-4195-4388-a3a3-6f1c4f823d2a None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.599737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 36/72] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:38.600426 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e6ca9-4195-4388-a3a3-6f1c4f823d2a None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:38.604814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:38.680620 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18b2ef-09cf-45b2-a70f-bce82e6d14d7 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:38.701030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e6ca9-4195-4388-a3a3-6f1c4f823d2a None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:38.714405 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640161-463e-4b30-9448-9eb23610de11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:38.715084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640161-463e-4b30-9448-9eb23610de11 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.715370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640161-463e-4b30-9448-9eb23610de11 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.715651 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640161-463e-4b30-9448-9eb23610de11 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.716406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64640161-463e-4b30-9448-9eb23610de11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:38.716716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64640161-463e-4b30-9448-9eb23610de11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:38.718151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64640161-463e-4b30-9448-9eb23610de11 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:38.726637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:38.727429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640161-463e-4b30-9448-9eb23610de11 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:38.727692 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:38.735385 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f37e0-cc26-4d59-8020-0868d605abf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:38.741449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f37e0-cc26-4d59-8020-0868d605abf5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.741449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f37e0-cc26-4d59-8020-0868d605abf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.741449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f37e0-cc26-4d59-8020-0868d605abf5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.748113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f37e0-cc26-4d59-8020-0868d605abf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-5b3f37e0-cc26-4d59-8020-0868d605abf5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:38.756798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:38.757719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:38.758696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:38.758696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:38.758696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:38.758696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:38.758696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:38.758696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:38.758696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:38.758696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:38.758696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:38.758696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:38.758696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:09:38.758696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:09:38.758696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 37/74] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:09:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:38.759915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccce8c-8b93-4ba2-bc82-aaa181dc6ce9 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.759915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccce8c-8b93-4ba2-bc82-aaa181dc6ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.760308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccce8c-8b93-4ba2-bc82-aaa181dc6ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.778875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-99ccce8c-8b93-4ba2-bc82-aaa181dc6ce9 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:38.780072 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-99ccce8c-8b93-4ba2-bc82-aaa181dc6ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:38.816634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:38.833029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640161-463e-4b30-9448-9eb23610de11 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:38.846109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 38/75] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:38.847369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba01f5-ad9d-4d63-a29e-bea3e2bdd01e None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.847660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba01f5-ad9d-4d63-a29e-bea3e2bdd01e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.847941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba01f5-ad9d-4d63-a29e-bea3e2bdd01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.866603 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93e9b3-f4aa-4e82-8b74-d63f1f35a58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:38.867485 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93e9b3-f4aa-4e82-8b74-d63f1f35a58e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:38.867772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93e9b3-f4aa-4e82-8b74-d63f1f35a58e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:38.868052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93e9b3-f4aa-4e82-8b74-d63f1f35a58e None admin] PATH_INFO: `/v3/users/431fd4cf20d349dd949ec11cf87197e2` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:38.876793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-f8ba01f5-ad9d-4d63-a29e-bea3e2bdd01e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:38.878019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f8ba01f5-ad9d-4d63-a29e-bea3e2bdd01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:38.883311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93e9b3-f4aa-4e82-8b74-d63f1f35a58e None admin] RBAC: Authorizing `identity:get_user(user_id=431fd4cf20d349dd949ec11cf87197e2)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:38.884779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93e9b3-f4aa-4e82-8b74-d63f1f35a58e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:38.886504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 38/76] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:38 2022] GET /identity/v3/users/431fd4cf20d349dd949ec11cf87197e2 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:38.887351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93e9b3-f4aa-4e82-8b74-d63f1f35a58e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:38.944798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 39/77] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:38.945755 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba01f5-ad9d-4d63-a29e-bea3e2bdd01e None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:38.994355 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93e9b3-f4aa-4e82-8b74-d63f1f35a58e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:38.995258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:39.027378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a59dd-f5cc-443b-b749-8b205195460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:39.028253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a59dd-f5cc-443b-b749-8b205195460f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:39.028540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a59dd-f5cc-443b-b749-8b205195460f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:39.028815 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a59dd-f5cc-443b-b749-8b205195460f None admin] PATH_INFO: `/v3/users/8b9c6c8e314d439cb5330941f3032bd9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:39.030161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a59dd-f5cc-443b-b749-8b205195460f None admin] RBAC: Authorizing `identity:get_user(user_id=8b9c6c8e314d439cb5330941f3032bd9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:39.031612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a59dd-f5cc-443b-b749-8b205195460f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:39.033428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 39/78] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:38 2022] GET /identity/v3/users/8b9c6c8e314d439cb5330941f3032bd9 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:39.034184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a59dd-f5cc-443b-b749-8b205195460f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:39.044687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba01f5-ad9d-4d63-a29e-bea3e2bdd01e None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:39.050634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:39.078206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d04d3-5701-48c7-a762-b5f959949cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:39.078882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d04d3-5701-48c7-a762-b5f959949cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:39.079171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d04d3-5701-48c7-a762-b5f959949cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:39.079453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d04d3-5701-48c7-a762-b5f959949cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:39.080214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d04d3-5701-48c7-a762-b5f959949cb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:39.080513 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d04d3-5701-48c7-a762-b5f959949cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:39.081938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d04d3-5701-48c7-a762-b5f959949cb7 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:39.090457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 40/79] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:09:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:39.091401 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d04d3-5701-48c7-a762-b5f959949cb7 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:39.138117 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a59dd-f5cc-443b-b749-8b205195460f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:39.172586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e86ff8-7935-49b8-8d61-6d6635e108b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:39.173475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e86ff8-7935-49b8-8d61-6d6635e108b3 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:39.173763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e86ff8-7935-49b8-8d61-6d6635e108b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:39.174040 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e86ff8-7935-49b8-8d61-6d6635e108b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:39.175217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e86ff8-7935-49b8-8d61-6d6635e108b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:39.176681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e86ff8-7935-49b8-8d61-6d6635e108b3 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:39.178339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 40/80] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:39.179107 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e86ff8-7935-49b8-8d61-6d6635e108b3 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:39.191954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d04d3-5701-48c7-a762-b5f959949cb7 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:39.202224 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:39.226732 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f7bd8-a89b-4624-a918-ad9345aaea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:39.227372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f7bd8-a89b-4624-a918-ad9345aaea79 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:39.227682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f7bd8-a89b-4624-a918-ad9345aaea79 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:39.227990 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f7bd8-a89b-4624-a918-ad9345aaea79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:39.259245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:39.280080 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e86ff8-7935-49b8-8d61-6d6635e108b3 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:39.294450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f7bd8-a89b-4624-a918-ad9345aaea79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:39.295927 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f7bd8-a89b-4624-a918-ad9345aaea79 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:39.313709 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2733b1-4e80-47cb-ac0f-ceaf9fec2775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:39.314503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2733b1-4e80-47cb-ac0f-ceaf9fec2775 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:39.314793 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2733b1-4e80-47cb-ac0f-ceaf9fec2775 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:39.315075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2733b1-4e80-47cb-ac0f-ceaf9fec2775 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:39.325823 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2733b1-4e80-47cb-ac0f-ceaf9fec2775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-8d2733b1-4e80-47cb-ac0f-ceaf9fec2775 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:39.334188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:39.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:39.335817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:39.335817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:39.335817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:39.335817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:39.335817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:39.335817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:39.335817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:39.335817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:39.335817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:39.335817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:39.335817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:39.335817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:09:39.335817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 41/81] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:39.336983 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2733b1-4e80-47cb-ac0f-ceaf9fec2775 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:39.394056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 41/82] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:09:39.395091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f7bd8-a89b-4624-a918-ad9345aaea79 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:39.406641 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:39.440117 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2733b1-4e80-47cb-ac0f-ceaf9fec2775 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:39.476580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b44f22-f742-463c-8da9-af0a844407db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:39.477260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44f22-f742-463c-8da9-af0a844407db None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:39.477551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44f22-f742-463c-8da9-af0a844407db None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:39.477828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44f22-f742-463c-8da9-af0a844407db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:39.486639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:39.494712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f7bd8-a89b-4624-a918-ad9345aaea79 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:39.528185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad81018-efca-480c-a4dd-bb01ec45dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:39.529058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad81018-efca-480c-a4dd-bb01ec45dc48 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:39.529447 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad81018-efca-480c-a4dd-bb01ec45dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:39.529732 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad81018-efca-480c-a4dd-bb01ec45dc48 None admin] PATH_INFO: `/v3/users/431fd4cf20d349dd949ec11cf87197e2` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:39.530920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad81018-efca-480c-a4dd-bb01ec45dc48 None admin] RBAC: Authorizing `identity:get_user(user_id=431fd4cf20d349dd949ec11cf87197e2)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:39.532378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad81018-efca-480c-a4dd-bb01ec45dc48 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:39.534030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 42/83] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:39 2022] GET /identity/v3/users/431fd4cf20d349dd949ec11cf87197e2 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:39.534771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad81018-efca-480c-a4dd-bb01ec45dc48 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:39.545457 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b44f22-f742-463c-8da9-af0a844407db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:39.546940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b44f22-f742-463c-8da9-af0a844407db None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:39.613157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:39.634034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad81018-efca-480c-a4dd-bb01ec45dc48 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:39.644976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 42/84] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:09:39.646362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b44f22-f742-463c-8da9-af0a844407db None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:39.672537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d600a5e-f16b-42a7-86c0-da808c94a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:39.673238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d600a5e-f16b-42a7-86c0-da808c94a476 None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:39.673531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d600a5e-f16b-42a7-86c0-da808c94a476 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:39.673814 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d600a5e-f16b-42a7-86c0-da808c94a476 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:39.674538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d600a5e-f16b-42a7-86c0-da808c94a476 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:39.675989 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d600a5e-f16b-42a7-86c0-da808c94a476 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:39.684463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:39.741971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b44f22-f742-463c-8da9-af0a844407db None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:39.774129 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacc7ab-cfb9-43db-945c-34cf0f218832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:39.774795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacc7ab-cfb9-43db-945c-34cf0f218832 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:39.775084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacc7ab-cfb9-43db-945c-34cf0f218832 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:39.775365 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacc7ab-cfb9-43db-945c-34cf0f218832 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:39.776114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacc7ab-cfb9-43db-945c-34cf0f218832 None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:39.776426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacc7ab-cfb9-43db-945c-34cf0f218832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:39.777890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacc7ab-cfb9-43db-945c-34cf0f218832 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:39.786583 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 43/85] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:09:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:39.787441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacc7ab-cfb9-43db-945c-34cf0f218832 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:39.813486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 43/86] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:09:39 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:09:39.814316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d600a5e-f16b-42a7-86c0-da808c94a476 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:39.894634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:39.903285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacc7ab-cfb9-43db-945c-34cf0f218832 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:39.965882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d600a5e-f16b-42a7-86c0-da808c94a476 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:39.970222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dae90b-a9d4-45e6-acbd-51f1c5cdd80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:39.971096 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dae90b-a9d4-45e6-acbd-51f1c5cdd80e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:39.971382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dae90b-a9d4-45e6-acbd-51f1c5cdd80e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:39.971659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dae90b-a9d4-45e6-acbd-51f1c5cdd80e None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:39.972873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dae90b-a9d4-45e6-acbd-51f1c5cdd80e None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:39.975039 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dae90b-a9d4-45e6-acbd-51f1c5cdd80e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:39.976577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 44/87] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:39 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:39.977382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dae90b-a9d4-45e6-acbd-51f1c5cdd80e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:40.006613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf913a73-ac35-48bb-a01c-740b071ed94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:40.007280 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf913a73-ac35-48bb-a01c-740b071ed94e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:40.007574 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf913a73-ac35-48bb-a01c-740b071ed94e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:40.007859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf913a73-ac35-48bb-a01c-740b071ed94e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:40.016941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:40.095853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf913a73-ac35-48bb-a01c-740b071ed94e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:40.097640 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf913a73-ac35-48bb-a01c-740b071ed94e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:40.111663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dae90b-a9d4-45e6-acbd-51f1c5cdd80e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:40.154571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e71b6-c84e-4e37-a2ec-fffb5b0ee165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:40.155402 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e71b6-c84e-4e37-a2ec-fffb5b0ee165 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:40.155687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e71b6-c84e-4e37-a2ec-fffb5b0ee165 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:40.155957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e71b6-c84e-4e37-a2ec-fffb5b0ee165 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:40.157257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e71b6-c84e-4e37-a2ec-fffb5b0ee165 None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:40.158730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e71b6-c84e-4e37-a2ec-fffb5b0ee165 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:40.160431 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 45/88] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:39 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:40.161842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e71b6-c84e-4e37-a2ec-fffb5b0ee165 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:40.209873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 44/89] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:09:40.210739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf913a73-ac35-48bb-a01c-740b071ed94e None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:40.213186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:40.249225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:40.304873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e71b6-c84e-4e37-a2ec-fffb5b0ee165 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:40.331469 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf913a73-ac35-48bb-a01c-740b071ed94e None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:40.353572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936192b0-51b4-4497-b397-752b449855f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:40.355341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936192b0-51b4-4497-b397-752b449855f5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:40.355842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936192b0-51b4-4497-b397-752b449855f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:40.356605 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936192b0-51b4-4497-b397-752b449855f5 None admin] PATH_INFO: `/v3/users/431fd4cf20d349dd949ec11cf87197e2` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:40.359913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936192b0-51b4-4497-b397-752b449855f5 None admin] RBAC: Authorizing `identity:get_user(user_id=431fd4cf20d349dd949ec11cf87197e2)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:40.362190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936192b0-51b4-4497-b397-752b449855f5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:40.365632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 46/90] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:40 2022] GET /identity/v3/users/431fd4cf20d349dd949ec11cf87197e2 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:40.366612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936192b0-51b4-4497-b397-752b449855f5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:40.380224 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926cabd-f6e9-443d-bbed-49bee1df6128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:40.380925 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926cabd-f6e9-443d-bbed-49bee1df6128 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:40.381211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926cabd-f6e9-443d-bbed-49bee1df6128 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:40.381518 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926cabd-f6e9-443d-bbed-49bee1df6128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:40.382350 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926cabd-f6e9-443d-bbed-49bee1df6128 None admin] RBAC: Adding query filter params (role.id=1b578241384b4a3698242fde91cc1769, scope.project.id=504ceb17b43e4a218dd7fddd35a66432, user.id=431fd4cf20d349dd949ec11cf87197e2) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:40.382665 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926cabd-f6e9-443d-bbed-49bee1df6128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:40.384120 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926cabd-f6e9-443d-bbed-49bee1df6128 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:40.390264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 45/91] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:09:40 2022] GET /identity/v3/role_assignments?user.id=431fd4cf20d349dd949ec11cf87197e2&scope.project.id=504ceb17b43e4a218dd7fddd35a66432&role.id=1b578241384b4a3698242fde91cc1769 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:40.391148 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926cabd-f6e9-443d-bbed-49bee1df6128 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:40.515074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936192b0-51b4-4497-b397-752b449855f5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:40.519789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:40.558613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b17dda-5647-4e89-b4dc-36abadd5dbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:40.559957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b17dda-5647-4e89-b4dc-36abadd5dbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:40.560553 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b17dda-5647-4e89-b4dc-36abadd5dbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:40.561043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b17dda-5647-4e89-b4dc-36abadd5dbe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:40.562182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b17dda-5647-4e89-b4dc-36abadd5dbe7 None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=504ceb17b43e4a218dd7fddd35a66432, user.id=8b9c6c8e314d439cb5330941f3032bd9) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:40.562740 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b17dda-5647-4e89-b4dc-36abadd5dbe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:40.564434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b17dda-5647-4e89-b4dc-36abadd5dbe7 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:40.573189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 47/92] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:09:40 2022] GET /identity/v3/role_assignments?user.id=8b9c6c8e314d439cb5330941f3032bd9&scope.project.id=504ceb17b43e4a218dd7fddd35a66432&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:40.574641 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b17dda-5647-4e89-b4dc-36abadd5dbe7 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:40.591585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:40.597539 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926cabd-f6e9-443d-bbed-49bee1df6128 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:40.645262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea08554-22e6-4af6-bbad-090222139518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:40.647044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea08554-22e6-4af6-bbad-090222139518 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:40.647809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea08554-22e6-4af6-bbad-090222139518 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:40.648269 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea08554-22e6-4af6-bbad-090222139518 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:40.650659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea08554-22e6-4af6-bbad-090222139518 None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:40.652166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea08554-22e6-4af6-bbad-090222139518 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:40.654044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 46/93] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:40 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:40.660186 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea08554-22e6-4af6-bbad-090222139518 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:40.712198 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b17dda-5647-4e89-b4dc-36abadd5dbe7 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:40.762004 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8f69-111d-4fee-a644-200adc372eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:40.763434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8f69-111d-4fee-a644-200adc372eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:40.764193 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8f69-111d-4fee-a644-200adc372eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:40.764696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8f69-111d-4fee-a644-200adc372eb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:40.776495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea08554-22e6-4af6-bbad-090222139518 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:40.814665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:40.816944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1a2df-a002-490c-b075-ba9b2a2fab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:40.818220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1a2df-a002-490c-b075-ba9b2a2fab5b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:40.818520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1a2df-a002-490c-b075-ba9b2a2fab5b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:40.818802 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1a2df-a002-490c-b075-ba9b2a2fab5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:40.819680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1a2df-a002-490c-b075-ba9b2a2fab5b None admin] RBAC: Adding query filter params (role.id=8eb72f5f99cf44e09c674c32be4bbb9d, scope.project.id=504ceb17b43e4a218dd7fddd35a66432, user.id=431fd4cf20d349dd949ec11cf87197e2) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:40.819999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1a2df-a002-490c-b075-ba9b2a2fab5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:40.821518 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1a2df-a002-490c-b075-ba9b2a2fab5b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:40.828085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 47/94] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:09:40 2022] GET /identity/v3/role_assignments?user.id=431fd4cf20d349dd949ec11cf87197e2&scope.project.id=504ceb17b43e4a218dd7fddd35a66432&role.id=8eb72f5f99cf44e09c674c32be4bbb9d => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:40.858419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c8f69-111d-4fee-a644-200adc372eb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:40.860308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c8f69-111d-4fee-a644-200adc372eb6 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:40.975804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 48/95] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:09:40.981712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1a2df-a002-490c-b075-ba9b2a2fab5b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:41.026882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:41.125340 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1a2df-a002-490c-b075-ba9b2a2fab5b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:41.166023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45820739-3069-4aaf-bca3-86b679f76842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:41.166905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45820739-3069-4aaf-bca3-86b679f76842 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:41.167197 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45820739-3069-4aaf-bca3-86b679f76842 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:41.167478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45820739-3069-4aaf-bca3-86b679f76842 None admin] PATH_INFO: `/v3/projects/1dc84b4ea0124c068fa0526c182d02f6` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:41.172353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45820739-3069-4aaf-bca3-86b679f76842 None admin] RBAC: Authorizing `identity:get_project(project_id=1dc84b4ea0124c068fa0526c182d02f6)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:41.173841 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45820739-3069-4aaf-bca3-86b679f76842 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:41.175980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 48/96] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:40 2022] GET /identity/v3/projects/1dc84b4ea0124c068fa0526c182d02f6 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:41.183510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8f69-111d-4fee-a644-200adc372eb6 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:41.274957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:41.319635 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8f69-111d-4fee-a644-200adc372eb6 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:41.360645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a2845-7f53-47ca-927d-95da11a838fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:41.361703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a2845-7f53-47ca-927d-95da11a838fd None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:41.362198 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a2845-7f53-47ca-927d-95da11a838fd None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:41.362685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a2845-7f53-47ca-927d-95da11a838fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:41.363749 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a2845-7f53-47ca-927d-95da11a838fd None admin] RBAC: Adding query filter params (role.id=1b578241384b4a3698242fde91cc1769, scope.project.id=1dc84b4ea0124c068fa0526c182d02f6, user.id=431fd4cf20d349dd949ec11cf87197e2) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:41.364293 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a2845-7f53-47ca-927d-95da11a838fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:41.366045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a2845-7f53-47ca-927d-95da11a838fd None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:41.372207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 49/97] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:09:41 2022] GET /identity/v3/role_assignments?user.id=431fd4cf20d349dd949ec11cf87197e2&scope.project.id=1dc84b4ea0124c068fa0526c182d02f6&role.id=1b578241384b4a3698242fde91cc1769 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:42.582256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfe3cd-7e01-4cdd-a035-9cdfb5a9c68b None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:42.583306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfe3cd-7e01-4cdd-a035-9cdfb5a9c68b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:42.583800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfe3cd-7e01-4cdd-a035-9cdfb5a9c68b None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:42.585700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 49/98] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:42.590524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd8b04-1dc3-4c71-a5d3-dfc130f98d6f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:42.590932 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd8b04-1dc3-4c71-a5d3-dfc130f98d6f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:42.591163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd8b04-1dc3-4c71-a5d3-dfc130f98d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:42.608879 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-68fd8b04-1dc3-4c71-a5d3-dfc130f98d6f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:42.610382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-68fd8b04-1dc3-4c71-a5d3-dfc130f98d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:42.697890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 50/99] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:42.713560 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e1feb-d919-41db-bc7a-5c57a9b04117 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:42.714116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e1feb-d919-41db-bc7a-5c57a9b04117 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:42.714598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e1feb-d919-41db-bc7a-5c57a9b04117 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:42.716184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 50/100] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:42.726906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dc845-435d-4ed8-a181-06f48637bf78 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:42.727472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dc845-435d-4ed8-a181-06f48637bf78 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:42.728741 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e1feb-d919-41db-bc7a-5c57a9b04117 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:42.732882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dc845-435d-4ed8-a181-06f48637bf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:42.768709 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-c69dc845-435d-4ed8-a181-06f48637bf78 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:42.770457 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c69dc845-435d-4ed8-a181-06f48637bf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:42.894136 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:42.922556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:42.923761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 51/101] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:42.933745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e1feb-d919-41db-bc7a-5c57a9b04117 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:42.959213 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dc845-435d-4ed8-a181-06f48637bf78 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:42.997625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43af9c0-02b3-4c5f-b594-8fc8cd54f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:42.998771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43af9c0-02b3-4c5f-b594-8fc8cd54f39c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:42.999281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43af9c0-02b3-4c5f-b594-8fc8cd54f39c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:42.999757 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43af9c0-02b3-4c5f-b594-8fc8cd54f39c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:43.022627 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43af9c0-02b3-4c5f-b594-8fc8cd54f39c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-c43af9c0-02b3-4c5f-b594-8fc8cd54f39c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:43.030740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:43.031605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:43.032361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:43.032361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:43.032361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:43.032361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:43.032361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:43.032361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:43.032361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:43.032361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:43.032361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:43.032361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:43.032361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:09:43.032361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:09:43.042504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 51/102] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:09:43.050393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43af9c0-02b3-4c5f-b594-8fc8cd54f39c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:43.194123 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dc845-435d-4ed8-a181-06f48637bf78 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:43.240107 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51370d-fd31-4c3c-8eb3-8ca127dfff7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:43.240915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51370d-fd31-4c3c-8eb3-8ca127dfff7e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:43.241232 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51370d-fd31-4c3c-8eb3-8ca127dfff7e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:43.241510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51370d-fd31-4c3c-8eb3-8ca127dfff7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:43.242698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51370d-fd31-4c3c-8eb3-8ca127dfff7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:43.244169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51370d-fd31-4c3c-8eb3-8ca127dfff7e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:43.245994 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 52/103] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:43.248847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43af9c0-02b3-4c5f-b594-8fc8cd54f39c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:43.251260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51370d-fd31-4c3c-8eb3-8ca127dfff7e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:43.319208 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:43.350493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d07a9f-f02d-4141-a9a2-9792d5c7f5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:43.351179 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d07a9f-f02d-4141-a9a2-9792d5c7f5aa None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:43.351467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d07a9f-f02d-4141-a9a2-9792d5c7f5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:43.351781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d07a9f-f02d-4141-a9a2-9792d5c7f5aa None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:43.352470 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51370d-fd31-4c3c-8eb3-8ca127dfff7e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:43.352578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d07a9f-f02d-4141-a9a2-9792d5c7f5aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:43.352806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d07a9f-f02d-4141-a9a2-9792d5c7f5aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:43.354293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d07a9f-f02d-4141-a9a2-9792d5c7f5aa None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:43.372363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 52/104] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:09:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:43.378663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d07a9f-f02d-4141-a9a2-9792d5c7f5aa None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:43.387248 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5f6c8-3d25-497d-9fe1-3bd088075027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:43.387919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5f6c8-3d25-497d-9fe1-3bd088075027 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:43.388208 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5f6c8-3d25-497d-9fe1-3bd088075027 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:43.388485 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5f6c8-3d25-497d-9fe1-3bd088075027 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:43.389241 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5f6c8-3d25-497d-9fe1-3bd088075027 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:43.390707 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5f6c8-3d25-497d-9fe1-3bd088075027 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:43.433489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:43.475016 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 53/105] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:09:43 2022] POST /identity/v3/projects => generated 302 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:09:43.550162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d07a9f-f02d-4141-a9a2-9792d5c7f5aa None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:43.599471 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d84ee-a709-46c4-83ad-67329c084f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:43.600377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d84ee-a709-46c4-83ad-67329c084f42 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:43.600663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d84ee-a709-46c4-83ad-67329c084f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:43.600943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d84ee-a709-46c4-83ad-67329c084f42 None admin] PATH_INFO: `/v3/users/92d3ed20d22c4209b303a7594560f4fb` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:43.616455 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d84ee-a709-46c4-83ad-67329c084f42 None admin] RBAC: Authorizing `identity:get_user(user_id=92d3ed20d22c4209b303a7594560f4fb)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:43.618023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d84ee-a709-46c4-83ad-67329c084f42 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:43.620252 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 53/106] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:43 2022] GET /identity/v3/users/92d3ed20d22c4209b303a7594560f4fb => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:43.625435 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5f6c8-3d25-497d-9fe1-3bd088075027 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:43.755677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5f6c8-3d25-497d-9fe1-3bd088075027 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:43.769573 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:43.797928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210159dc-1090-48ac-beb8-b39a88f37950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:43.798613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210159dc-1090-48ac-beb8-b39a88f37950 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:43.798900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210159dc-1090-48ac-beb8-b39a88f37950 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:43.799178 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210159dc-1090-48ac-beb8-b39a88f37950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:43.877890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210159dc-1090-48ac-beb8-b39a88f37950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:43.879393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210159dc-1090-48ac-beb8-b39a88f37950 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:43.931159 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8065d4-6314-4573-97c5-208560059ae7 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:43.931504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8065d4-6314-4573-97c5-208560059ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:43.931733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8065d4-6314-4573-97c5-208560059ae7 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:43.933103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 54/107] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:43.939070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6e842-a6b0-4015-8fb8-6978af15c71f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:43.939361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6e842-a6b0-4015-8fb8-6978af15c71f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:43.939646 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6e842-a6b0-4015-8fb8-6978af15c71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:43.962698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-f9c6e842-a6b0-4015-8fb8-6978af15c71f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:43.963897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f9c6e842-a6b0-4015-8fb8-6978af15c71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:44.072350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 54/108] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 16:09:44.074363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84853e80-87cc-497b-b5c2-5e3266f82327 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:44.074954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84853e80-87cc-497b-b5c2-5e3266f82327 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:44.075408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84853e80-87cc-497b-b5c2-5e3266f82327 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:44.076928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 55/109] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:44.082429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d245-822a-4701-b518-61b95312ab42 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:44.083121 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d245-822a-4701-b518-61b95312ab42 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:44.084102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d245-822a-4701-b518-61b95312ab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:44.108989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a628d245-822a-4701-b518-61b95312ab42 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:44.110693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a628d245-822a-4701-b518-61b95312ab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:44.116040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 55/110] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:09:44.117134 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6e842-a6b0-4015-8fb8-6978af15c71f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:44.123888 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:44.129293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:44.207280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 56/111] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:44.209463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ea25b-8c8b-47e6-9657-00cbdeb27c92 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:44.209903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ea25b-8c8b-47e6-9657-00cbdeb27c92 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:44.210378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ea25b-8c8b-47e6-9657-00cbdeb27c92 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:44.211917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 57/112] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:44.216660 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ea25b-8c8b-47e6-9657-00cbdeb27c92 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:44.231136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6e842-a6b0-4015-8fb8-6978af15c71f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:44.270597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d68b8-d8ab-41d1-ad22-2dab47bd73ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:44.271737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d68b8-d8ab-41d1-ad22-2dab47bd73ca None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:44.272222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d68b8-d8ab-41d1-ad22-2dab47bd73ca None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:44.272612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d68b8-d8ab-41d1-ad22-2dab47bd73ca None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:44.274095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d68b8-d8ab-41d1-ad22-2dab47bd73ca None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:44.275763 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d68b8-d8ab-41d1-ad22-2dab47bd73ca None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:44.277799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 56/113] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:44 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:44.279396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315d556-46fd-4fb8-bf6e-495842a56e95 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:44.279899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315d556-46fd-4fb8-bf6e-495842a56e95 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:44.280453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315d556-46fd-4fb8-bf6e-495842a56e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:44.298704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-6315d556-46fd-4fb8-bf6e-495842a56e95 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:44.300377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6315d556-46fd-4fb8-bf6e-495842a56e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:44.336917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ea25b-8c8b-47e6-9657-00cbdeb27c92 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:44.374847 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbff5e3-8fdb-4834-91b9-0534afd9009e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:44.375886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 57/114] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:44.375993 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbff5e3-8fdb-4834-91b9-0534afd9009e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:44.375993 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbff5e3-8fdb-4834-91b9-0534afd9009e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:44.376262 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbff5e3-8fdb-4834-91b9-0534afd9009e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:44.376521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315d556-46fd-4fb8-bf6e-495842a56e95 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:44.388098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:44.394121 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbff5e3-8fdb-4834-91b9-0534afd9009e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-1cbff5e3-8fdb-4834-91b9-0534afd9009e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:44.403547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:44.404434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 58/115] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:44.405675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbff5e3-8fdb-4834-91b9-0534afd9009e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:44.409275 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:44.491035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315d556-46fd-4fb8-bf6e-495842a56e95 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:44.526806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbff5e3-8fdb-4834-91b9-0534afd9009e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:44.527687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f09c9d-297e-4a6b-8b19-951e47f86e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:44.528496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f09c9d-297e-4a6b-8b19-951e47f86e87 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:44.528785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f09c9d-297e-4a6b-8b19-951e47f86e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:44.529064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f09c9d-297e-4a6b-8b19-951e47f86e87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:44.539657 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f09c9d-297e-4a6b-8b19-951e47f86e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-e5f09c9d-297e-4a6b-8b19-951e47f86e87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:44.547384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:44.548291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:44.549075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:44.549075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:44.549075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:44.549075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:44.549075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:44.549075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:44.549075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:44.549075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:44.549075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:44.549075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:44.549075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:44.549075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:09:44.549075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 58/116] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:44.550392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce6fc9-e5fc-4788-8ac6-4ef89d3c6366 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:44.550392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce6fc9-e5fc-4788-8ac6-4ef89d3c6366 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:44.550392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce6fc9-e5fc-4788-8ac6-4ef89d3c6366 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:44.552349 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 59/117] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:44.552893 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce6fc9-e5fc-4788-8ac6-4ef89d3c6366 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:44.571139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e2ac-e5b3-4098-a844-22dd55f65c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:44.571772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e2ac-e5b3-4098-a844-22dd55f65c4a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:44.572070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e2ac-e5b3-4098-a844-22dd55f65c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:44.572349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e2ac-e5b3-4098-a844-22dd55f65c4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:44.573231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e2ac-e5b3-4098-a844-22dd55f65c4a None admin] RBAC: Adding query filter params (role.id=3f956eee424f40eda9501bcc798b6b18, scope.project.id=504ceb17b43e4a218dd7fddd35a66432, user.id=92d3ed20d22c4209b303a7594560f4fb) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:44.573575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e2ac-e5b3-4098-a844-22dd55f65c4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:44.575029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e2ac-e5b3-4098-a844-22dd55f65c4a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:44.580758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 59/118] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:09:44 2022] GET /identity/v3/role_assignments?user.id=92d3ed20d22c4209b303a7594560f4fb&scope.project.id=504ceb17b43e4a218dd7fddd35a66432&role.id=3f956eee424f40eda9501bcc798b6b18 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:44.581399 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e2ac-e5b3-4098-a844-22dd55f65c4a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:44.654905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:44.689306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:44.713043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce6fc9-e5fc-4788-8ac6-4ef89d3c6366 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:44.734908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e2ac-e5b3-4098-a844-22dd55f65c4a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:44.763246 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bd627-c005-4dd4-896b-317edd0af52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:44.764669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bd627-c005-4dd4-896b-317edd0af52a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:44.765423 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bd627-c005-4dd4-896b-317edd0af52a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:44.766310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bd627-c005-4dd4-896b-317edd0af52a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:44.771004 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a888f2-de3d-43b6-884d-32afa065352b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:44.771685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a888f2-de3d-43b6-884d-32afa065352b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:44.772033 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a888f2-de3d-43b6-884d-32afa065352b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:44.772318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a888f2-de3d-43b6-884d-32afa065352b None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:44.773211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a888f2-de3d-43b6-884d-32afa065352b None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:44.773469 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a888f2-de3d-43b6-884d-32afa065352b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:44.774934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a888f2-de3d-43b6-884d-32afa065352b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:44.780818 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bd627-c005-4dd4-896b-317edd0af52a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-608bd627-c005-4dd4-896b-317edd0af52a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:44.790795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:44.791892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:44.792648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:44.792648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:44.792648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:44.792648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:44.792648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:44.792648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:44.792648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:44.792648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:44.792648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:44.792648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:44.792648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:09:44.792648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:09:44.795115 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 60/120] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:09:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:44.795434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 60/120] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:09:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:44.796336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bd627-c005-4dd4-896b-317edd0af52a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:44.796809 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538d31-c2a0-433f-baad-bc72ac3b4422 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:44.797143 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538d31-c2a0-433f-baad-bc72ac3b4422 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:44.801278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538d31-c2a0-433f-baad-bc72ac3b4422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:44.821635 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-15538d31-c2a0-433f-baad-bc72ac3b4422 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:44.822850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-15538d31-c2a0-433f-baad-bc72ac3b4422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:44.902264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 61/121] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:44.903461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15538d31-c2a0-433f-baad-bc72ac3b4422 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:44.956228 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bd627-c005-4dd4-896b-317edd0af52a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:44.983678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:44.993091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b395f-88be-4d61-9a1b-7260ceb9d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:44.994065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b395f-88be-4d61-9a1b-7260ceb9d776 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:44.994518 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b395f-88be-4d61-9a1b-7260ceb9d776 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:44.994960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b395f-88be-4d61-9a1b-7260ceb9d776 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:44.995231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:44.997936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b395f-88be-4d61-9a1b-7260ceb9d776 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:44.997936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b395f-88be-4d61-9a1b-7260ceb9d776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:44.998353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b395f-88be-4d61-9a1b-7260ceb9d776 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:45.008498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 61/122] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:45.013867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b395f-88be-4d61-9a1b-7260ceb9d776 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:45.039940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15538d31-c2a0-433f-baad-bc72ac3b4422 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:45.076506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041be92e-f355-4980-9d0f-99095aba3bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:45.077182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041be92e-f355-4980-9d0f-99095aba3bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:45.077497 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041be92e-f355-4980-9d0f-99095aba3bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:45.077747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041be92e-f355-4980-9d0f-99095aba3bf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:45.078498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041be92e-f355-4980-9d0f-99095aba3bf9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:45.078859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041be92e-f355-4980-9d0f-99095aba3bf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:45.080394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041be92e-f355-4980-9d0f-99095aba3bf9 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:45.088882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 62/123] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:09:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:45.089560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041be92e-f355-4980-9d0f-99095aba3bf9 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:45.118764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b395f-88be-4d61-9a1b-7260ceb9d776 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:45.162030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284bd73-e24a-4df9-85f2-0620b9bab1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:45.163012 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284bd73-e24a-4df9-85f2-0620b9bab1bb None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:45.163310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284bd73-e24a-4df9-85f2-0620b9bab1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:45.163593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284bd73-e24a-4df9-85f2-0620b9bab1bb None admin] PATH_INFO: `/v3/users/431fd4cf20d349dd949ec11cf87197e2` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:45.164944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284bd73-e24a-4df9-85f2-0620b9bab1bb None admin] RBAC: Authorizing `identity:get_user(user_id=431fd4cf20d349dd949ec11cf87197e2)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:45.166541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284bd73-e24a-4df9-85f2-0620b9bab1bb None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:45.168485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 62/124] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:45 2022] GET /identity/v3/users/431fd4cf20d349dd949ec11cf87197e2 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:45.169057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284bd73-e24a-4df9-85f2-0620b9bab1bb None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:45.207110 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041be92e-f355-4980-9d0f-99095aba3bf9 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:45.228275 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:45.231536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:45.242892 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61142034-65ed-4fbd-9486-58061aab75a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:45.243547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61142034-65ed-4fbd-9486-58061aab75a2 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:45.243942 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61142034-65ed-4fbd-9486-58061aab75a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:45.244285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61142034-65ed-4fbd-9486-58061aab75a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:45.255630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61142034-65ed-4fbd-9486-58061aab75a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-61142034-65ed-4fbd-9486-58061aab75a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:45.263658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:45.264768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:45.265737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:45.265737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:45.265737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:45.265737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:45.265737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:45.265737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:45.265737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:45.265737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:45.265737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:45.265737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:45.265737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:45.265737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:09:45.266418 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 63/125] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:45.267040 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61142034-65ed-4fbd-9486-58061aab75a2 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:45.282871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284bd73-e24a-4df9-85f2-0620b9bab1bb None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:45.322468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fcd80-5190-4984-9e21-07c25589c11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:45.323839 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fcd80-5190-4984-9e21-07c25589c11e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:45.324319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fcd80-5190-4984-9e21-07c25589c11e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:45.324792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fcd80-5190-4984-9e21-07c25589c11e None admin] PATH_INFO: `/v3/users/8b9c6c8e314d439cb5330941f3032bd9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:45.326272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fcd80-5190-4984-9e21-07c25589c11e None admin] RBAC: Authorizing `identity:get_user(user_id=8b9c6c8e314d439cb5330941f3032bd9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:45.327979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fcd80-5190-4984-9e21-07c25589c11e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:45.330594 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 63/126] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:45 2022] GET /identity/v3/users/8b9c6c8e314d439cb5330941f3032bd9 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:45.331558 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fcd80-5190-4984-9e21-07c25589c11e None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:45.380505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61142034-65ed-4fbd-9486-58061aab75a2 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:45.418371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b956f7c-7cce-4db0-a0b6-d23a156162dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:45.419420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956f7c-7cce-4db0-a0b6-d23a156162dd None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:45.419710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956f7c-7cce-4db0-a0b6-d23a156162dd None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:45.420003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956f7c-7cce-4db0-a0b6-d23a156162dd None admin] PATH_INFO: `/v3/users/431fd4cf20d349dd949ec11cf87197e2` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:45.421318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b956f7c-7cce-4db0-a0b6-d23a156162dd None admin] RBAC: Authorizing `identity:get_user(user_id=431fd4cf20d349dd949ec11cf87197e2)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:45.422848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b956f7c-7cce-4db0-a0b6-d23a156162dd None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:45.424669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 64/127] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:45 2022] GET /identity/v3/users/431fd4cf20d349dd949ec11cf87197e2 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:45.425463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b956f7c-7cce-4db0-a0b6-d23a156162dd None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:45.452822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fcd80-5190-4984-9e21-07c25589c11e None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:45.480729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:45.487099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:45.495394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab3881-3780-4da9-a945-da583c9d8d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:45.496788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab3881-3780-4da9-a945-da583c9d8d3a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:45.497444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab3881-3780-4da9-a945-da583c9d8d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:45.498238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab3881-3780-4da9-a945-da583c9d8d3a None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:45.500071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab3881-3780-4da9-a945-da583c9d8d3a None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:45.502361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab3881-3780-4da9-a945-da583c9d8d3a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:45.504453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 64/128] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:45 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:45.506024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab3881-3780-4da9-a945-da583c9d8d3a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:45.539927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b956f7c-7cce-4db0-a0b6-d23a156162dd None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:45.575560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea80573-866e-46df-8efc-4a85a4ac9b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:45.576332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea80573-866e-46df-8efc-4a85a4ac9b5b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:45.576626 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea80573-866e-46df-8efc-4a85a4ac9b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:45.576904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea80573-866e-46df-8efc-4a85a4ac9b5b None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:45.577896 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea80573-866e-46df-8efc-4a85a4ac9b5b None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:45.578209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea80573-866e-46df-8efc-4a85a4ac9b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:45.579742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea80573-866e-46df-8efc-4a85a4ac9b5b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:45.588881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 65/129] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:09:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:45.589823 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea80573-866e-46df-8efc-4a85a4ac9b5b None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:45.636638 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab3881-3780-4da9-a945-da583c9d8d3a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:45.675185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59cbca-39d0-49c8-94c7-e77a6e303cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:45.676083 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59cbca-39d0-49c8-94c7-e77a6e303cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:45.676365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59cbca-39d0-49c8-94c7-e77a6e303cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:45.676628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59cbca-39d0-49c8-94c7-e77a6e303cc1 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:45.678599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59cbca-39d0-49c8-94c7-e77a6e303cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:45.680461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59cbca-39d0-49c8-94c7-e77a6e303cc1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:45.682323 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 65/130] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:45 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:45.683072 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59cbca-39d0-49c8-94c7-e77a6e303cc1 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:45.719772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea80573-866e-46df-8efc-4a85a4ac9b5b None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:45.732937 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:45.761655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:45.763668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68feecd-ecd8-41d6-b6d8-f42e2b5ad9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:45.765553 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68feecd-ecd8-41d6-b6d8-f42e2b5ad9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:45.766327 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68feecd-ecd8-41d6-b6d8-f42e2b5ad9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:45.766804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68feecd-ecd8-41d6-b6d8-f42e2b5ad9e8 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:45.768304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68feecd-ecd8-41d6-b6d8-f42e2b5ad9e8 None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:45.771242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68feecd-ecd8-41d6-b6d8-f42e2b5ad9e8 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:45.773666 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 66/131] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:45 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:45.775424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68feecd-ecd8-41d6-b6d8-f42e2b5ad9e8 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:45.808111 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59cbca-39d0-49c8-94c7-e77a6e303cc1 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:45.847050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030db65-54de-4b66-883d-2d53e89948ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:45.848147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030db65-54de-4b66-883d-2d53e89948ab None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:45.848537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030db65-54de-4b66-883d-2d53e89948ab None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:45.849946 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030db65-54de-4b66-883d-2d53e89948ab None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432/users/431fd4cf20d349dd949ec11cf87197e2/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:45.852360 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030db65-54de-4b66-883d-2d53e89948ab None admin] RBAC: Authorizing `identity:create_grant(project_id=504ceb17b43e4a218dd7fddd35a66432, user_id=431fd4cf20d349dd949ec11cf87197e2, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:45.854506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030db65-54de-4b66-883d-2d53e89948ab None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:45.901586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68feecd-ecd8-41d6-b6d8-f42e2b5ad9e8 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:45.936650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccb10f-cce4-4bea-a0ca-2c2320e62569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:45.937560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccb10f-cce4-4bea-a0ca-2c2320e62569 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:45.937854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccb10f-cce4-4bea-a0ca-2c2320e62569 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:45.938144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccb10f-cce4-4bea-a0ca-2c2320e62569 None admin] PATH_INFO: `/v3/users/431fd4cf20d349dd949ec11cf87197e2` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:45.939334 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccb10f-cce4-4bea-a0ca-2c2320e62569 None admin] RBAC: Authorizing `identity:get_user(user_id=431fd4cf20d349dd949ec11cf87197e2)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:45.941047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccb10f-cce4-4bea-a0ca-2c2320e62569 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:45.943309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 67/132] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:45 2022] GET /identity/v3/users/431fd4cf20d349dd949ec11cf87197e2 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:45.944021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccb10f-cce4-4bea-a0ca-2c2320e62569 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:45.962016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 66/133] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:09:45 2022] PUT /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432/users/431fd4cf20d349dd949ec11cf87197e2/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:09:45.963012 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030db65-54de-4b66-883d-2d53e89948ab None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:46.013081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:46.079245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccb10f-cce4-4bea-a0ca-2c2320e62569 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:46.123017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030db65-54de-4b66-883d-2d53e89948ab None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:46.126550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6abc1-6e4a-4b34-96c9-fa80d1da2ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:46.127642 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6abc1-6e4a-4b34-96c9-fa80d1da2ead None admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:46.127931 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6abc1-6e4a-4b34-96c9-fa80d1da2ead None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:46.128211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6abc1-6e4a-4b34-96c9-fa80d1da2ead None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432/users/8b9c6c8e314d439cb5330941f3032bd9/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:46.132677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6abc1-6e4a-4b34-96c9-fa80d1da2ead None admin] RBAC: Authorizing `identity:create_grant(project_id=504ceb17b43e4a218dd7fddd35a66432, user_id=8b9c6c8e314d439cb5330941f3032bd9, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:46.134551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6abc1-6e4a-4b34-96c9-fa80d1da2ead None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:46.148104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:46.162623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae6252-68eb-4356-99fa-4cfd01a7300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:46.163527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae6252-68eb-4356-99fa-4cfd01a7300f None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:46.163823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae6252-68eb-4356-99fa-4cfd01a7300f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:46.164108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae6252-68eb-4356-99fa-4cfd01a7300f None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432/users/431fd4cf20d349dd949ec11cf87197e2/roles/8eb72f5f99cf44e09c674c32be4bbb9d` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:46.166502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae6252-68eb-4356-99fa-4cfd01a7300f None admin] RBAC: Authorizing `identity:create_grant(project_id=504ceb17b43e4a218dd7fddd35a66432, user_id=431fd4cf20d349dd949ec11cf87197e2, role_id=8eb72f5f99cf44e09c674c32be4bbb9d)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:46.168013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae6252-68eb-4356-99fa-4cfd01a7300f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:46.225335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 68/134] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:09:45 2022] PUT /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432/users/8b9c6c8e314d439cb5330941f3032bd9/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:09:46.226990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bed9f5-1c4b-4d44-828b-a7d8ec519942 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:46.227505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bed9f5-1c4b-4d44-828b-a7d8ec519942 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:46.227999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bed9f5-1c4b-4d44-828b-a7d8ec519942 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:46.229911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 69/135] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:46.230926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bed9f5-1c4b-4d44-828b-a7d8ec519942 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:46.255660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 67/136] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:09:45 2022] PUT /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432/users/431fd4cf20d349dd949ec11cf87197e2/roles/8eb72f5f99cf44e09c674c32be4bbb9d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:09:46.257029 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac7f3d-35f2-438d-a2f2-f4c239c9e63f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:46.257496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac7f3d-35f2-438d-a2f2-f4c239c9e63f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:46.257793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac7f3d-35f2-438d-a2f2-f4c239c9e63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:46.292729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-30ac7f3d-35f2-438d-a2f2-f4c239c9e63f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:46.292729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-30ac7f3d-35f2-438d-a2f2-f4c239c9e63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:46.355384 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bed9f5-1c4b-4d44-828b-a7d8ec519942 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:46.364999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:46.417018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82618bdd-a09e-42bc-9ed9-4c674fe83d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:46.418378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618bdd-a09e-42bc-9ed9-4c674fe83d1f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:46.418870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 68/137] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:46.419382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618bdd-a09e-42bc-9ed9-4c674fe83d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:46.419946 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618bdd-a09e-42bc-9ed9-4c674fe83d1f None admin] PATH_INFO: `/v3/projects/1dc84b4ea0124c068fa0526c182d02f6` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:46.421632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82618bdd-a09e-42bc-9ed9-4c674fe83d1f None admin] RBAC: Authorizing `identity:get_project(project_id=1dc84b4ea0124c068fa0526c182d02f6)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:46.423349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82618bdd-a09e-42bc-9ed9-4c674fe83d1f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:46.425809 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 70/138] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:46 2022] GET /identity/v3/projects/1dc84b4ea0124c068fa0526c182d02f6 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:46.433580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac7f3d-35f2-438d-a2f2-f4c239c9e63f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:46.462461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82618bdd-a09e-42bc-9ed9-4c674fe83d1f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:46.618219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac7f3d-35f2-438d-a2f2-f4c239c9e63f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:46.622152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82618bdd-a09e-42bc-9ed9-4c674fe83d1f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:46.630964 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:46.654940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8df1c-6fbd-4dd9-8a52-52eef6e090ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:46.656214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8df1c-6fbd-4dd9-8a52-52eef6e090ff None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:46.656720 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8df1c-6fbd-4dd9-8a52-52eef6e090ff None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:46.657241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8df1c-6fbd-4dd9-8a52-52eef6e090ff None admin] PATH_INFO: `/v3/projects/1dc84b4ea0124c068fa0526c182d02f6/users/431fd4cf20d349dd949ec11cf87197e2/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:46.659653 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8df1c-6fbd-4dd9-8a52-52eef6e090ff None admin] RBAC: Authorizing `identity:create_grant(project_id=1dc84b4ea0124c068fa0526c182d02f6, user_id=431fd4cf20d349dd949ec11cf87197e2, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:46.661313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad11245-1b2f-4d98-9bf4-2dac4815c202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:46.661824 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8df1c-6fbd-4dd9-8a52-52eef6e090ff None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:46.662174 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad11245-1b2f-4d98-9bf4-2dac4815c202 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:46.662466 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad11245-1b2f-4d98-9bf4-2dac4815c202 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:46.662744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad11245-1b2f-4d98-9bf4-2dac4815c202 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:46.663932 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad11245-1b2f-4d98-9bf4-2dac4815c202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:46.665423 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad11245-1b2f-4d98-9bf4-2dac4815c202 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:46.667055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 71/139] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:46.673376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad11245-1b2f-4d98-9bf4-2dac4815c202 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:46.720852 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:46.737321 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 69/140] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:09:46 2022] PUT /identity/v3/projects/1dc84b4ea0124c068fa0526c182d02f6/users/431fd4cf20d349dd949ec11cf87197e2/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:09:46.790885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad11245-1b2f-4d98-9bf4-2dac4815c202 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:46.825422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53da90-b458-4c0c-aa84-690888a220a1 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:46.826100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53da90-b458-4c0c-aa84-690888a220a1 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:46.826655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53da90-b458-4c0c-aa84-690888a220a1 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:46.828352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 70/141] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:09:46.842897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17499b-23ff-431d-8f0b-5aecc1c637a0 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:46.843533 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17499b-23ff-431d-8f0b-5aecc1c637a0 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:46.844271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17499b-23ff-431d-8f0b-5aecc1c637a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:46.858410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfde8a0-0826-44e8-aa14-fc13306db33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:46.859927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfde8a0-0826-44e8-aa14-fc13306db33b None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:46.859927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfde8a0-0826-44e8-aa14-fc13306db33b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:46.860744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfde8a0-0826-44e8-aa14-fc13306db33b None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:46.861555 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfde8a0-0826-44e8-aa14-fc13306db33b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:46.865632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfde8a0-0826-44e8-aa14-fc13306db33b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:46.871608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-2c17499b-23ff-431d-8f0b-5aecc1c637a0 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:46.872757 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2c17499b-23ff-431d-8f0b-5aecc1c637a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:46.969600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 71/142] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:46.997785 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 72/143] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:09:46 2022] POST /identity/v3/users => generated 283 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:09:46.998220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17499b-23ff-431d-8f0b-5aecc1c637a0 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:47.118465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:47.127673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17499b-23ff-431d-8f0b-5aecc1c637a0 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:47.172082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267e294-e8f8-4c9c-a959-caa9928e2f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:47.172908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267e294-e8f8-4c9c-a959-caa9928e2f8d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:47.173224 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267e294-e8f8-4c9c-a959-caa9928e2f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:47.173512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267e294-e8f8-4c9c-a959-caa9928e2f8d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:47.191579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267e294-e8f8-4c9c-a959-caa9928e2f8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-d267e294-e8f8-4c9c-a959-caa9928e2f8d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:47.204213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:47.205185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:47.205991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:47.205991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:47.205991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:47.205991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:47.205991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:47.205991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:47.205991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:47.205991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:47.205991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:47.205991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:47.205991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:09:47.205991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:09:47.205991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 72/144] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:47.213392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfde8a0-0826-44e8-aa14-fc13306db33b None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:47.348241 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:47.352256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfde8a0-0826-44e8-aa14-fc13306db33b None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:47.396615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76271fd-1b19-43e5-adef-e64b03b2fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:47.397234 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76271fd-1b19-43e5-adef-e64b03b2fa3d None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:47.397526 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76271fd-1b19-43e5-adef-e64b03b2fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:47.397804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76271fd-1b19-43e5-adef-e64b03b2fa3d None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:47.398570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76271fd-1b19-43e5-adef-e64b03b2fa3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:47.398877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76271fd-1b19-43e5-adef-e64b03b2fa3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:47.400285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76271fd-1b19-43e5-adef-e64b03b2fa3d None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:47.409065 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 73/145] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:09:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:47.418213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267e294-e8f8-4c9c-a959-caa9928e2f8d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:47.563432 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267e294-e8f8-4c9c-a959-caa9928e2f8d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:47.626825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60d6a8-eeef-4eee-8080-b184741504aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:47.627709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60d6a8-eeef-4eee-8080-b184741504aa None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:47.627990 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60d6a8-eeef-4eee-8080-b184741504aa None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:47.628269 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60d6a8-eeef-4eee-8080-b184741504aa None admin] PATH_INFO: `/v3/users/92d3ed20d22c4209b303a7594560f4fb` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:47.633840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60d6a8-eeef-4eee-8080-b184741504aa None admin] RBAC: Authorizing `identity:get_user(user_id=92d3ed20d22c4209b303a7594560f4fb)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:47.635309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60d6a8-eeef-4eee-8080-b184741504aa None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:47.637144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 73/146] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:47 2022] GET /identity/v3/users/92d3ed20d22c4209b303a7594560f4fb => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:47.642491 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76271fd-1b19-43e5-adef-e64b03b2fa3d None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:47.760679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76271fd-1b19-43e5-adef-e64b03b2fa3d None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:47.802943 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aaf79e-48bb-438b-bc6e-e832655fbdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:47.803833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaf79e-48bb-438b-bc6e-e832655fbdab None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:47.804119 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaf79e-48bb-438b-bc6e-e832655fbdab None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:47.804402 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaf79e-48bb-438b-bc6e-e832655fbdab None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:47.805650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aaf79e-48bb-438b-bc6e-e832655fbdab None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:47.807114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aaf79e-48bb-438b-bc6e-e832655fbdab None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:47.809153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 74/147] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:47 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:47.814481 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60d6a8-eeef-4eee-8080-b184741504aa None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:47.844600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:47.928164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60d6a8-eeef-4eee-8080-b184741504aa None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:47.966920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0947843-865e-4e93-9411-bf00c474752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:47.967816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0947843-865e-4e93-9411-bf00c474752d None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:47.968103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0947843-865e-4e93-9411-bf00c474752d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:47.968380 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0947843-865e-4e93-9411-bf00c474752d None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432/users/92d3ed20d22c4209b303a7594560f4fb/roles/3f956eee424f40eda9501bcc798b6b18` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:47.975096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0947843-865e-4e93-9411-bf00c474752d None admin] RBAC: Authorizing `identity:create_grant(project_id=504ceb17b43e4a218dd7fddd35a66432, user_id=92d3ed20d22c4209b303a7594560f4fb, role_id=3f956eee424f40eda9501bcc798b6b18)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:47.976519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0947843-865e-4e93-9411-bf00c474752d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:48.063900 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 74/148] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:09:47 2022] PUT /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432/users/92d3ed20d22c4209b303a7594560f4fb/roles/3f956eee424f40eda9501bcc798b6b18 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:09:49.178599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2dcfd-3342-446d-a6a0-7ba5906abfed None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:49.179106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2dcfd-3342-446d-a6a0-7ba5906abfed None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:49.179219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2dcfd-3342-446d-a6a0-7ba5906abfed None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:49.180678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 75/149] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:49.194897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be3971-b295-41f0-9b29-e8c3bb85b836 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:49.195382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be3971-b295-41f0-9b29-e8c3bb85b836 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:49.195476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be3971-b295-41f0-9b29-e8c3bb85b836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:49.222189 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a0be3971-b295-41f0-9b29-e8c3bb85b836 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:49.223399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a0be3971-b295-41f0-9b29-e8c3bb85b836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:49.313200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 75/150] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:49.329521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22409e5-ab85-4609-93a5-ec488f96b086 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:49.329817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22409e5-ab85-4609-93a5-ec488f96b086 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:49.330102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22409e5-ab85-4609-93a5-ec488f96b086 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:49.331478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 76/151] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:49.336651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5ab45-70fd-4877-8f2c-543c94fa14a1 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:49.336952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5ab45-70fd-4877-8f2c-543c94fa14a1 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:49.337277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5ab45-70fd-4877-8f2c-543c94fa14a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:49.342545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22409e5-ab85-4609-93a5-ec488f96b086 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:49.358997 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-d4f5ab45-70fd-4877-8f2c-543c94fa14a1 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:49.360189 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d4f5ab45-70fd-4877-8f2c-543c94fa14a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:49.381558 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:49.382795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:49.502734 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 76/152] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:49.504182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22409e5-ab85-4609-93a5-ec488f96b086 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:49.538218 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5ab45-70fd-4877-8f2c-543c94fa14a1 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:49.554964 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b04b7-fea9-4840-8af0-918317150027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:49.555764 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b04b7-fea9-4840-8af0-918317150027 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:49.556047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b04b7-fea9-4840-8af0-918317150027 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:49.556320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b04b7-fea9-4840-8af0-918317150027 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:49.577632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b04b7-fea9-4840-8af0-918317150027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-a03b04b7-fea9-4840-8af0-918317150027 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:49.589480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:49.590359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:49.591130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:49.591130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:49.591130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:49.591130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:49.591130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:49.591130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:49.591130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:49.591130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:49.591130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:49.591130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:49.591130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:49.591130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:09:49.591130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 77/153] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:09:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:09:49.605179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b04b7-fea9-4840-8af0-918317150027 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:49.687457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5ab45-70fd-4877-8f2c-543c94fa14a1 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:49.742845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6873c9d-8f46-4993-bac7-75446d4eec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:49.743578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6873c9d-8f46-4993-bac7-75446d4eec74 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:49.743863 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6873c9d-8f46-4993-bac7-75446d4eec74 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:49.744139 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6873c9d-8f46-4993-bac7-75446d4eec74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:49.768458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6873c9d-8f46-4993-bac7-75446d4eec74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-f6873c9d-8f46-4993-bac7-75446d4eec74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:49.777338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:49.778424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:49.779306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:49.779306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:49.779306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:49.779306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:49.779306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:49.779306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:49.779306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:49.779306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:49.779306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:49.779306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:49.779306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:49.779306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:09:49.779306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 77/154] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:09:49.787764 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:49.791122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6873c9d-8f46-4993-bac7-75446d4eec74 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:49.808306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b04b7-fea9-4840-8af0-918317150027 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:49.821510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:49.868436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e81d0-d44f-4bbe-96eb-23e1edc1f2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:49.869191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e81d0-d44f-4bbe-96eb-23e1edc1f2af None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:49.869511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e81d0-d44f-4bbe-96eb-23e1edc1f2af None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:49.869845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e81d0-d44f-4bbe-96eb-23e1edc1f2af None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:49.870609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e81d0-d44f-4bbe-96eb-23e1edc1f2af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:49.870916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e81d0-d44f-4bbe-96eb-23e1edc1f2af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:49.872316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e81d0-d44f-4bbe-96eb-23e1edc1f2af None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:49.891579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 78/155] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:49.895387 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872d9bf-2e24-499f-9736-46ac321edef1 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:49.896625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872d9bf-2e24-499f-9736-46ac321edef1 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:49.896913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872d9bf-2e24-499f-9736-46ac321edef1 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:49.899192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 79/156] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:49.899778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872d9bf-2e24-499f-9736-46ac321edef1 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:49.951976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6873c9d-8f46-4993-bac7-75446d4eec74 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:50.024769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157258b6-eed8-40b9-add6-f339666c9020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:50.025844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157258b6-eed8-40b9-add6-f339666c9020 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:50.026344 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157258b6-eed8-40b9-add6-f339666c9020 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:50.026817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157258b6-eed8-40b9-add6-f339666c9020 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:50.027791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157258b6-eed8-40b9-add6-f339666c9020 None admin] RBAC: Adding query filter params (name=member) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:50.029411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157258b6-eed8-40b9-add6-f339666c9020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:50.031770 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157258b6-eed8-40b9-add6-f339666c9020 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:50.050758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 78/157] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:09:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:50.052390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d78845-0d82-42d6-bde3-b6b97f7d2503 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:50.054546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d78845-0d82-42d6-bde3-b6b97f7d2503 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:50.056569 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d78845-0d82-42d6-bde3-b6b97f7d2503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:50.092007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-44d78845-0d82-42d6-bde3-b6b97f7d2503 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:50.093585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-44d78845-0d82-42d6-bde3-b6b97f7d2503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:50.122373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872d9bf-2e24-499f-9736-46ac321edef1 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:50.174751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd9aaa-a662-4f95-b827-4506700b2607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:50.175980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd9aaa-a662-4f95-b827-4506700b2607 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:50.176486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd9aaa-a662-4f95-b827-4506700b2607 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:50.177006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd9aaa-a662-4f95-b827-4506700b2607 None admin] PATH_INFO: `/v3/users/8b9c6c8e314d439cb5330941f3032bd9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:50.178435 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd9aaa-a662-4f95-b827-4506700b2607 None admin] RBAC: Authorizing `identity:get_user(user_id=8b9c6c8e314d439cb5330941f3032bd9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:50.180125 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd9aaa-a662-4f95-b827-4506700b2607 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:50.182591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 80/158] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:49 2022] GET /identity/v3/users/8b9c6c8e314d439cb5330941f3032bd9 => generated 247 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:50.183574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd9aaa-a662-4f95-b827-4506700b2607 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:50.205494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:50.213743 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 79/159] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:50.214690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d78845-0d82-42d6-bde3-b6b97f7d2503 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:50.218087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:50.350480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd9aaa-a662-4f95-b827-4506700b2607 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:50.355524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d78845-0d82-42d6-bde3-b6b97f7d2503 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:50.408781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d85aa-69ad-4278-b012-4b70b6814f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:50.409011 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4cf5f-ea51-4add-9fef-f58f45f87066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:50.409584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4cf5f-ea51-4add-9fef-f58f45f87066 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:50.409701 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d85aa-69ad-4278-b012-4b70b6814f6e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:50.409870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4cf5f-ea51-4add-9fef-f58f45f87066 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:50.409977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d85aa-69ad-4278-b012-4b70b6814f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:50.410145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4cf5f-ea51-4add-9fef-f58f45f87066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:50.410243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d85aa-69ad-4278-b012-4b70b6814f6e None admin] PATH_INFO: `/v3/users/431fd4cf20d349dd949ec11cf87197e2` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:50.413830 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d85aa-69ad-4278-b012-4b70b6814f6e None admin] RBAC: Authorizing `identity:get_user(user_id=431fd4cf20d349dd949ec11cf87197e2)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:50.415420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d85aa-69ad-4278-b012-4b70b6814f6e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:50.417271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 81/160] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:50 2022] GET /identity/v3/users/431fd4cf20d349dd949ec11cf87197e2 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:50.418066 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d85aa-69ad-4278-b012-4b70b6814f6e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:50.524359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:50.527936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4cf5f-ea51-4add-9fef-f58f45f87066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:50.529673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4cf5f-ea51-4add-9fef-f58f45f87066 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:50.610501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:50.632906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d85aa-69ad-4278-b012-4b70b6814f6e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:50.668032 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458a9d2-6672-4daf-8472-c22a0dd2ca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:50.668840 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458a9d2-6672-4daf-8472-c22a0dd2ca6d None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:50.669139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458a9d2-6672-4daf-8472-c22a0dd2ca6d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:50.669425 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458a9d2-6672-4daf-8472-c22a0dd2ca6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:50.679966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458a9d2-6672-4daf-8472-c22a0dd2ca6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-e458a9d2-6672-4daf-8472-c22a0dd2ca6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:50.698396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:50.699320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:50.700095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:50.700095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:50.700095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:50.700095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:50.700095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:50.700095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:50.700095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:50.700095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:50.700095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:50.700095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:50.700095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:09:50.700095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:09:50.700095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 82/161] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:09:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:50.700761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458a9d2-6672-4daf-8472-c22a0dd2ca6d None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:50.751898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 80/162] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:09:50.753613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eb44a-ced8-4ae0-9e28-5d05b8e5fd8b None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:50.754138 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eb44a-ced8-4ae0-9e28-5d05b8e5fd8b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:50.754617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eb44a-ced8-4ae0-9e28-5d05b8e5fd8b None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:50.756644 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 81/163] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:50.763713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036eb44a-ced8-4ae0-9e28-5d05b8e5fd8b None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:50.914445 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458a9d2-6672-4daf-8472-c22a0dd2ca6d None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:50.985866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa97bf2-ed49-406a-90f6-3c7c0e501e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:50.989614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa97bf2-ed49-406a-90f6-3c7c0e501e0d None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:50.989614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa97bf2-ed49-406a-90f6-3c7c0e501e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:50.989614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa97bf2-ed49-406a-90f6-3c7c0e501e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:51.018182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:51.046601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:51.055889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036eb44a-ced8-4ae0-9e28-5d05b8e5fd8b None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:51.120643 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa97bf2-ed49-406a-90f6-3c7c0e501e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:51.122140 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa97bf2-ed49-406a-90f6-3c7c0e501e0d None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:51.141888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf28eaf-bff0-4e7d-b19b-0bd61c97c633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:51.142581 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf28eaf-bff0-4e7d-b19b-0bd61c97c633 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:51.142876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf28eaf-bff0-4e7d-b19b-0bd61c97c633 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:51.143153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf28eaf-bff0-4e7d-b19b-0bd61c97c633 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:51.143929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf28eaf-bff0-4e7d-b19b-0bd61c97c633 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:51.144238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf28eaf-bff0-4e7d-b19b-0bd61c97c633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:51.145703 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf28eaf-bff0-4e7d-b19b-0bd61c97c633 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:51.162565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 82/164] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:09:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:51.163862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9af4f-e95c-45d6-9a0d-47d4206a2661 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:51.164155 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9af4f-e95c-45d6-9a0d-47d4206a2661 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:51.164437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9af4f-e95c-45d6-9a0d-47d4206a2661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:51.195069 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-cda9af4f-e95c-45d6-9a0d-47d4206a2661 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:51.196193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-cda9af4f-e95c-45d6-9a0d-47d4206a2661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:51.328029 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 83/165] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:51.328771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9af4f-e95c-45d6-9a0d-47d4206a2661 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:51.357032 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 83/166] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:09:51.358070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa97bf2-ed49-406a-90f6-3c7c0e501e0d None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:51.420703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:51.508273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa97bf2-ed49-406a-90f6-3c7c0e501e0d None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:51.559371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f449d3-dc46-4b89-8cb2-2de0662c9537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:51.560019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:51.560258 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f449d3-dc46-4b89-8cb2-2de0662c9537 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:51.560546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f449d3-dc46-4b89-8cb2-2de0662c9537 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:51.560828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f449d3-dc46-4b89-8cb2-2de0662c9537 None admin] PATH_INFO: `/v3/users/431fd4cf20d349dd949ec11cf87197e2` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:51.566025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f449d3-dc46-4b89-8cb2-2de0662c9537 None admin] RBAC: Authorizing `identity:get_user(user_id=431fd4cf20d349dd949ec11cf87197e2)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:51.567567 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f449d3-dc46-4b89-8cb2-2de0662c9537 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:51.569629 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 84/167] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:51 2022] GET /identity/v3/users/431fd4cf20d349dd949ec11cf87197e2 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:51.576727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f449d3-dc46-4b89-8cb2-2de0662c9537 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:51.576854 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9af4f-e95c-45d6-9a0d-47d4206a2661 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:51.652065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c46df-eadb-4f73-a7a3-e89b2d811f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:51.652943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c46df-eadb-4f73-a7a3-e89b2d811f05 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:51.653259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c46df-eadb-4f73-a7a3-e89b2d811f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:51.653533 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c46df-eadb-4f73-a7a3-e89b2d811f05 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:51.654980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c46df-eadb-4f73-a7a3-e89b2d811f05 None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:51.656431 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c46df-eadb-4f73-a7a3-e89b2d811f05 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:51.658168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 84/168] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:51 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:51.658927 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c46df-eadb-4f73-a7a3-e89b2d811f05 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:51.761852 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f449d3-dc46-4b89-8cb2-2de0662c9537 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:51.777136 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:51.798429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd63d85-1b8a-4285-bddd-a3310a401ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:51.799706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd63d85-1b8a-4285-bddd-a3310a401ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:51.800325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd63d85-1b8a-4285-bddd-a3310a401ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:51.800902 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd63d85-1b8a-4285-bddd-a3310a401ea4 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:51.802881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd63d85-1b8a-4285-bddd-a3310a401ea4 None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:51.804560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd63d85-1b8a-4285-bddd-a3310a401ea4 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:51.806499 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 85/169] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:51 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:51.807529 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd63d85-1b8a-4285-bddd-a3310a401ea4 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:51.830000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c46df-eadb-4f73-a7a3-e89b2d811f05 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:51.875449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f7c4c-08a9-42c7-b5f7-4ad65272a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:51.876378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f7c4c-08a9-42c7-b5f7-4ad65272a06e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:51.876672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f7c4c-08a9-42c7-b5f7-4ad65272a06e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:51.876949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f7c4c-08a9-42c7-b5f7-4ad65272a06e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:51.891347 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f7c4c-08a9-42c7-b5f7-4ad65272a06e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-d79f7c4c-08a9-42c7-b5f7-4ad65272a06e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:51.900845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:51.902024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:51.902845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:51.902845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:51.902845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:51.902845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:51.902845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:51.902845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:51.902845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:51.902845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:51.902845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:51.902845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:51.902845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:51.902845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:09:51.902845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 85/170] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:51.903536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4350-d80d-4965-ab44-d1686f035877 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:51.904012 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4350-d80d-4965-ab44-d1686f035877 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:51.904109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4350-d80d-4965-ab44-d1686f035877 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:51.905396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 86/171] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:51.906151 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4350-d80d-4965-ab44-d1686f035877 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:51.922660 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd63d85-1b8a-4285-bddd-a3310a401ea4 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:51.929556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:51.965133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8510f96-51c1-4428-9075-5891d039fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:51.965790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510f96-51c1-4428-9075-5891d039fcff None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:51.966068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510f96-51c1-4428-9075-5891d039fcff None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:51.966345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510f96-51c1-4428-9075-5891d039fcff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.013791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4350-d80d-4965-ab44-d1686f035877 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:52.018287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:52.036048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8510f96-51c1-4428-9075-5891d039fcff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:52.037681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8510f96-51c1-4428-9075-5891d039fcff None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:52.046245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2c500-8bc5-498b-b1d6-20c13f24ac56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:52.046901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2c500-8bc5-498b-b1d6-20c13f24ac56 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.047187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2c500-8bc5-498b-b1d6-20c13f24ac56 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.047608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2c500-8bc5-498b-b1d6-20c13f24ac56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.048452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2c500-8bc5-498b-b1d6-20c13f24ac56 None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=504ceb17b43e4a218dd7fddd35a66432, user.id=8b9c6c8e314d439cb5330941f3032bd9) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:52.048767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2c500-8bc5-498b-b1d6-20c13f24ac56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:52.050224 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2c500-8bc5-498b-b1d6-20c13f24ac56 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:52.056542 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 87/172] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:09:51 2022] GET /identity/v3/role_assignments?user.id=8b9c6c8e314d439cb5330941f3032bd9&scope.project.id=504ceb17b43e4a218dd7fddd35a66432&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:52.057773 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189efae-66e0-4a39-958d-371d9b4d3bee None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.058063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189efae-66e0-4a39-958d-371d9b4d3bee None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.058340 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189efae-66e0-4a39-958d-371d9b4d3bee None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.059584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 88/173] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:52.062315 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189efae-66e0-4a39-958d-371d9b4d3bee None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:52.148941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 86/174] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:09:52.150631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5933fcc-7f76-4746-847a-7e525dd3606c None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.150923 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5933fcc-7f76-4746-847a-7e525dd3606c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.151206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5933fcc-7f76-4746-847a-7e525dd3606c None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.152504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 87/175] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:52.157683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42544e-8713-4664-ae1c-487b734e35fe None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.157972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42544e-8713-4664-ae1c-487b734e35fe None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.158254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42544e-8713-4664-ae1c-487b734e35fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.172246 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:52.181525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-bf42544e-8713-4664-ae1c-487b734e35fe None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:52.187781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bf42544e-8713-4664-ae1c-487b734e35fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:52.191037 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189efae-66e0-4a39-958d-371d9b4d3bee None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:52.239128 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b98de0-9d91-40b3-af62-96613e728d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:52.240300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b98de0-9d91-40b3-af62-96613e728d44 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.240947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b98de0-9d91-40b3-af62-96613e728d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.241276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b98de0-9d91-40b3-af62-96613e728d44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.242403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b98de0-9d91-40b3-af62-96613e728d44 None admin] RBAC: Adding query filter params (role.id=1b578241384b4a3698242fde91cc1769, scope.project.id=504ceb17b43e4a218dd7fddd35a66432, user.id=431fd4cf20d349dd949ec11cf87197e2) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:52.242718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b98de0-9d91-40b3-af62-96613e728d44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:52.244595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b98de0-9d91-40b3-af62-96613e728d44 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:52.251234 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 89/176] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:09:52 2022] GET /identity/v3/role_assignments?user.id=431fd4cf20d349dd949ec11cf87197e2&scope.project.id=504ceb17b43e4a218dd7fddd35a66432&role.id=1b578241384b4a3698242fde91cc1769 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:52.251827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b98de0-9d91-40b3-af62-96613e728d44 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:52.261870 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 88/177] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:52.263381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812382a-6dd8-4729-86d0-0e125c586740 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.263671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812382a-6dd8-4729-86d0-0e125c586740 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.264003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812382a-6dd8-4729-86d0-0e125c586740 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.265343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 89/178] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:52.266396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9799147-2fea-49dd-b582-0bf8bcf06215 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.266689 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9799147-2fea-49dd-b582-0bf8bcf06215 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.266950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9799147-2fea-49dd-b582-0bf8bcf06215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.286604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e9799147-2fea-49dd-b582-0bf8bcf06215 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:52.287811 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e9799147-2fea-49dd-b582-0bf8bcf06215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:52.296827 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:52.376712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b98de0-9d91-40b3-af62-96613e728d44 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:52.381834 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 90/179] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:52.382848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9799147-2fea-49dd-b582-0bf8bcf06215 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:52.420913 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef5b1b-33a6-45c2-a5c6-05aaa6375435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:52.421622 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef5b1b-33a6-45c2-a5c6-05aaa6375435 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.421902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef5b1b-33a6-45c2-a5c6-05aaa6375435 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.422176 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef5b1b-33a6-45c2-a5c6-05aaa6375435 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.422932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef5b1b-33a6-45c2-a5c6-05aaa6375435 None admin] RBAC: Adding query filter params (name=member) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:52.423237 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef5b1b-33a6-45c2-a5c6-05aaa6375435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:52.424605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef5b1b-33a6-45c2-a5c6-05aaa6375435 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:52.435122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 90/180] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:09:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:52.436888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a49423-ea91-4d39-9e9d-67fe345668e8 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.437629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a49423-ea91-4d39-9e9d-67fe345668e8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.437918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a49423-ea91-4d39-9e9d-67fe345668e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.459438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-55a49423-ea91-4d39-9e9d-67fe345668e8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:52.460631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-55a49423-ea91-4d39-9e9d-67fe345668e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:52.464629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:52.513717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9799147-2fea-49dd-b582-0bf8bcf06215 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:52.532296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 91/181] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:52.533776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cefc06-6642-47d9-8541-b37931930fd1 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.534071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cefc06-6642-47d9-8541-b37931930fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.534346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cefc06-6642-47d9-8541-b37931930fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.548666 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5c69f-7e97-4d38-9dff-a0d2cc8a1763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:52.549552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5c69f-7e97-4d38-9dff-a0d2cc8a1763 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.549832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5c69f-7e97-4d38-9dff-a0d2cc8a1763 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.550100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5c69f-7e97-4d38-9dff-a0d2cc8a1763 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.551247 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5c69f-7e97-4d38-9dff-a0d2cc8a1763 None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:52.551345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-28cefc06-6642-47d9-8541-b37931930fd1 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:52.552496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-28cefc06-6642-47d9-8541-b37931930fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:52.552739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5c69f-7e97-4d38-9dff-a0d2cc8a1763 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:52.554736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 91/182] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:52 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:52.555977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5c69f-7e97-4d38-9dff-a0d2cc8a1763 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:52.567690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:52.627243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 92/183] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:52.637361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cefc06-6642-47d9-8541-b37931930fd1 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:52.657106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5c69f-7e97-4d38-9dff-a0d2cc8a1763 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:52.690456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a351166-805f-4f0e-af21-11c90e55dbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:52.691250 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351166-805f-4f0e-af21-11c90e55dbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.691534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351166-805f-4f0e-af21-11c90e55dbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.691811 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351166-805f-4f0e-af21-11c90e55dbd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.701977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a351166-805f-4f0e-af21-11c90e55dbd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:52.702674 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-3a351166-805f-4f0e-af21-11c90e55dbd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:52.710249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:52.711151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:52.711947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:52.711947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:52.711947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:52.711947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:52.711947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:52.711947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:52.711947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:52.711947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:52.711947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:52.711947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:52.711947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:52.711947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:09:52.711947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 92/184] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:52.712620 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a351166-805f-4f0e-af21-11c90e55dbd3 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:52.737522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cefc06-6642-47d9-8541-b37931930fd1 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:52.771293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40b79a-3f58-4717-9b36-d5c98f896c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:52.772092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40b79a-3f58-4717-9b36-d5c98f896c26 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.772376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40b79a-3f58-4717-9b36-d5c98f896c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.772648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40b79a-3f58-4717-9b36-d5c98f896c26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.780913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:52.782587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40b79a-3f58-4717-9b36-d5c98f896c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-2f40b79a-3f58-4717-9b36-d5c98f896c26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:52.791209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:52.792125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:52.792916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:52.792916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:52.792916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:52.792916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:52.792916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:52.792916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:52.792916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:52.792916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:52.792916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:52.792916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:52.792916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:09:52.792916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:09:52.792916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 93/185] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:09:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:52.793850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40b79a-3f58-4717-9b36-d5c98f896c26 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:52.815837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a351166-805f-4f0e-af21-11c90e55dbd3 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:52.850744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c794be-9b44-4e0b-b044-73331cf7e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:52.851625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c794be-9b44-4e0b-b044-73331cf7e7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.851910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c794be-9b44-4e0b-b044-73331cf7e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.852194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c794be-9b44-4e0b-b044-73331cf7e7e2 None admin] PATH_INFO: `/v3/users/431fd4cf20d349dd949ec11cf87197e2` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.853423 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c794be-9b44-4e0b-b044-73331cf7e7e2 None admin] RBAC: Authorizing `identity:get_user(user_id=431fd4cf20d349dd949ec11cf87197e2)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:52.854874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c794be-9b44-4e0b-b044-73331cf7e7e2 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:52.856507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 93/186] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:52 2022] GET /identity/v3/users/431fd4cf20d349dd949ec11cf87197e2 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:52.858058 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c794be-9b44-4e0b-b044-73331cf7e7e2 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:52.900284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40b79a-3f58-4717-9b36-d5c98f896c26 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:52.928588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:52.934191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecafa5-111a-42a1-8948-c4e2ce34de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:52.934936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecafa5-111a-42a1-8948-c4e2ce34de1d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:52.935231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecafa5-111a-42a1-8948-c4e2ce34de1d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:52.935513 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecafa5-111a-42a1-8948-c4e2ce34de1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:52.936354 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecafa5-111a-42a1-8948-c4e2ce34de1d None admin] RBAC: Adding query filter params (role.id=8eb72f5f99cf44e09c674c32be4bbb9d, scope.project.id=504ceb17b43e4a218dd7fddd35a66432, user.id=431fd4cf20d349dd949ec11cf87197e2) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:52.936676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecafa5-111a-42a1-8948-c4e2ce34de1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:52.938150 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecafa5-111a-42a1-8948-c4e2ce34de1d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:52.944743 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 94/187] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:09:52 2022] GET /identity/v3/role_assignments?user.id=431fd4cf20d349dd949ec11cf87197e2&scope.project.id=504ceb17b43e4a218dd7fddd35a66432&role.id=8eb72f5f99cf44e09c674c32be4bbb9d => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:52.948223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecafa5-111a-42a1-8948-c4e2ce34de1d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:52.962785 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c794be-9b44-4e0b-b044-73331cf7e7e2 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:53.006144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee70097-349a-4d65-8176-89121ca2720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:53.007329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee70097-349a-4d65-8176-89121ca2720b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:53.007437 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee70097-349a-4d65-8176-89121ca2720b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:53.007629 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee70097-349a-4d65-8176-89121ca2720b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:53.016303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:53.022036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee70097-349a-4d65-8176-89121ca2720b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-6ee70097-349a-4d65-8176-89121ca2720b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:53.030189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:53.031210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:53.032037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:53.032037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:53.032037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:53.032037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:53.032037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:53.032037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:53.032037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:53.032037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:53.032037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:53.032037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:53.032037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:09:53.032037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:09:53.032037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 94/188] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:53.032743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee70097-349a-4d65-8176-89121ca2720b None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:53.062952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecafa5-111a-42a1-8948-c4e2ce34de1d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:53.105332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a6d2b-c220-4f7e-a0f7-652353b2fcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:53.106827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a6d2b-c220-4f7e-a0f7-652353b2fcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:53.106827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a6d2b-c220-4f7e-a0f7-652353b2fcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:53.106827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a6d2b-c220-4f7e-a0f7-652353b2fcb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:53.108142 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a6d2b-c220-4f7e-a0f7-652353b2fcb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:53.109516 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a6d2b-c220-4f7e-a0f7-652353b2fcb4 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:53.113157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 95/189] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:53.113157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a6d2b-c220-4f7e-a0f7-652353b2fcb4 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:53.152664 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee70097-349a-4d65-8176-89121ca2720b None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:53.185147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:53.190474 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e277fee-d281-4cbf-878c-28837faed0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:53.191142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e277fee-d281-4cbf-878c-28837faed0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:53.191426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e277fee-d281-4cbf-878c-28837faed0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:53.191703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e277fee-d281-4cbf-878c-28837faed0b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:53.193047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e277fee-d281-4cbf-878c-28837faed0b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:53.193418 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e277fee-d281-4cbf-878c-28837faed0b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:53.200691 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e277fee-d281-4cbf-878c-28837faed0b2 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:53.202917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 95/190] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:53.203708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e277fee-d281-4cbf-878c-28837faed0b2 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:53.226726 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a6d2b-c220-4f7e-a0f7-652353b2fcb4 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:53.260701 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc6c2a-c2de-46b7-bf70-365c7fdb2cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:53.261403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc6c2a-c2de-46b7-bf70-365c7fdb2cfc None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:53.261690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc6c2a-c2de-46b7-bf70-365c7fdb2cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:53.262173 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc6c2a-c2de-46b7-bf70-365c7fdb2cfc None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:53.262290 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:53.262728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc6c2a-c2de-46b7-bf70-365c7fdb2cfc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:53.263041 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc6c2a-c2de-46b7-bf70-365c7fdb2cfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:53.264416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc6c2a-c2de-46b7-bf70-365c7fdb2cfc None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:53.272429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 96/191] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:09:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:53.273355 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc6c2a-c2de-46b7-bf70-365c7fdb2cfc None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:53.305006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e277fee-d281-4cbf-878c-28837faed0b2 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:53.338692 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28141b7-1d0a-4f31-892c-729925ade8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:53.339561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28141b7-1d0a-4f31-892c-729925ade8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:53.339849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28141b7-1d0a-4f31-892c-729925ade8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:53.340123 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28141b7-1d0a-4f31-892c-729925ade8f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:53.372452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc6c2a-c2de-46b7-bf70-365c7fdb2cfc None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:53.395026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:53.405407 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f7e7d-4c78-46fe-9b95-c75dbc187f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:53.406068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f7e7d-4c78-46fe-9b95-c75dbc187f7a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:53.406325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28141b7-1d0a-4f31-892c-729925ade8f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:53.406728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f7e7d-4c78-46fe-9b95-c75dbc187f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:53.406728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f7e7d-4c78-46fe-9b95-c75dbc187f7a None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:53.407347 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f7e7d-4c78-46fe-9b95-c75dbc187f7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:53.407657 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f7e7d-4c78-46fe-9b95-c75dbc187f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:53.407810 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28141b7-1d0a-4f31-892c-729925ade8f2 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:53.409024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f7e7d-4c78-46fe-9b95-c75dbc187f7a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:53.418629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 97/192] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:09:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:53.419400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f7e7d-4c78-46fe-9b95-c75dbc187f7a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:53.466904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:53.509100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 96/193] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:09:53.509967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28141b7-1d0a-4f31-892c-729925ade8f2 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:53.519419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f7e7d-4c78-46fe-9b95-c75dbc187f7a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:53.554093 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948883b-99ba-47c8-84bb-0342cd6a8f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:53.554757 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948883b-99ba-47c8-84bb-0342cd6a8f00 None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:53.555092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948883b-99ba-47c8-84bb-0342cd6a8f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:53.555324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948883b-99ba-47c8-84bb-0342cd6a8f00 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:53.556043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948883b-99ba-47c8-84bb-0342cd6a8f00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:53.557509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948883b-99ba-47c8-84bb-0342cd6a8f00 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:53.610696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28141b7-1d0a-4f31-892c-729925ade8f2 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:53.629602 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 98/194] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:09:53 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:09:53.631061 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948883b-99ba-47c8-84bb-0342cd6a8f00 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:53.655589 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51c0a5-de90-42d0-aed3-c9bd13fd167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:53.656499 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51c0a5-de90-42d0-aed3-c9bd13fd167d None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:53.656778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51c0a5-de90-42d0-aed3-c9bd13fd167d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:53.657685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51c0a5-de90-42d0-aed3-c9bd13fd167d None admin] PATH_INFO: `/v3/users/d2473c3b3ddd4428b22706836dd8ade1` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:53.676084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51c0a5-de90-42d0-aed3-c9bd13fd167d None admin] RBAC: Authorizing `identity:get_user(user_id=d2473c3b3ddd4428b22706836dd8ade1)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:53.677721 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51c0a5-de90-42d0-aed3-c9bd13fd167d None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:53.684652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 97/195] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:53 2022] GET /identity/v3/users/d2473c3b3ddd4428b22706836dd8ade1 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:53.684652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51c0a5-de90-42d0-aed3-c9bd13fd167d None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:53.687495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:53.709131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:53.754107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948883b-99ba-47c8-84bb-0342cd6a8f00 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:53.794745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e4bc4-e158-47ad-9fd3-8c33c5d2de54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:53.795482 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e4bc4-e158-47ad-9fd3-8c33c5d2de54 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:53.795822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e4bc4-e158-47ad-9fd3-8c33c5d2de54 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:53.796744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e4bc4-e158-47ad-9fd3-8c33c5d2de54 None admin] PATH_INFO: `/v3/users/d2473c3b3ddd4428b22706836dd8ade1` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:53.797933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e4bc4-e158-47ad-9fd3-8c33c5d2de54 None admin] RBAC: Authorizing `identity:get_user(user_id=d2473c3b3ddd4428b22706836dd8ade1)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:53.799381 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e4bc4-e158-47ad-9fd3-8c33c5d2de54 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:53.801035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 99/196] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:53 2022] GET /identity/v3/users/d2473c3b3ddd4428b22706836dd8ade1 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:53.801955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e4bc4-e158-47ad-9fd3-8c33c5d2de54 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:53.808175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51c0a5-de90-42d0-aed3-c9bd13fd167d None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:53.845839 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5ff80-1cac-41cd-b918-c1f148f0a0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:53.846726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5ff80-1cac-41cd-b918-c1f148f0a0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:53.847017 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5ff80-1cac-41cd-b918-c1f148f0a0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:53.847298 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5ff80-1cac-41cd-b918-c1f148f0a0b2 None admin] PATH_INFO: `/v3/users/92d3ed20d22c4209b303a7594560f4fb` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:53.849621 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5ff80-1cac-41cd-b918-c1f148f0a0b2 None admin] RBAC: Authorizing `identity:get_user(user_id=92d3ed20d22c4209b303a7594560f4fb)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:53.851720 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5ff80-1cac-41cd-b918-c1f148f0a0b2 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:53.853573 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 98/197] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:53 2022] GET /identity/v3/users/92d3ed20d22c4209b303a7594560f4fb => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:53.854280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5ff80-1cac-41cd-b918-c1f148f0a0b2 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:53.930130 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e4bc4-e158-47ad-9fd3-8c33c5d2de54 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:53.946820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:53.962667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:53.972734 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649faa5a-6df8-4448-ba99-1b1b5646b360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:53.973770 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649faa5a-6df8-4448-ba99-1b1b5646b360 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:53.974059 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649faa5a-6df8-4448-ba99-1b1b5646b360 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:53.974338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649faa5a-6df8-4448-ba99-1b1b5646b360 None admin] PATH_INFO: `/v3/projects/1dc84b4ea0124c068fa0526c182d02f6` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:53.975556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649faa5a-6df8-4448-ba99-1b1b5646b360 None admin] RBAC: Authorizing `identity:get_project(project_id=1dc84b4ea0124c068fa0526c182d02f6)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:53.977006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649faa5a-6df8-4448-ba99-1b1b5646b360 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:53.979166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 100/198] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:53 2022] GET /identity/v3/projects/1dc84b4ea0124c068fa0526c182d02f6 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:53.979975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649faa5a-6df8-4448-ba99-1b1b5646b360 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:53.980720 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5ff80-1cac-41cd-b918-c1f148f0a0b2 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:54.036342 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182e342-ce5b-4032-8e23-f2d92eb03d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:54.037307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e342-ce5b-4032-8e23-f2d92eb03d5b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:54.037730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e342-ce5b-4032-8e23-f2d92eb03d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:54.038263 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e342-ce5b-4032-8e23-f2d92eb03d5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:54.110767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649faa5a-6df8-4448-ba99-1b1b5646b360 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:54.123118 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182e342-ce5b-4032-8e23-f2d92eb03d5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:54.125042 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182e342-ce5b-4032-8e23-f2d92eb03d5b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:54.150345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddd248-d976-4a87-b26b-dc302b55434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:54.151338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddd248-d976-4a87-b26b-dc302b55434c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:54.151819 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddd248-d976-4a87-b26b-dc302b55434c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:54.152315 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddd248-d976-4a87-b26b-dc302b55434c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:54.202828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:54.231127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddd248-d976-4a87-b26b-dc302b55434c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:54.233095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddd248-d976-4a87-b26b-dc302b55434c None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:54.238725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:54.264106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 99/199] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:09:54.264106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182e342-ce5b-4032-8e23-f2d92eb03d5b None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:54.357720 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 101/200] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:09:54.359208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddd248-d976-4a87-b26b-dc302b55434c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:54.382707 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182e342-ce5b-4032-8e23-f2d92eb03d5b None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:54.418977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dea547-77db-4387-88f5-fd45f1bb11fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:54.420554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dea547-77db-4387-88f5-fd45f1bb11fa None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:54.421203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dea547-77db-4387-88f5-fd45f1bb11fa None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:54.421834 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dea547-77db-4387-88f5-fd45f1bb11fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:54.469001 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:54.494124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddd248-d976-4a87-b26b-dc302b55434c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:54.501846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:54.519032 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dea547-77db-4387-88f5-fd45f1bb11fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:54.521607 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dea547-77db-4387-88f5-fd45f1bb11fa None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:54.530851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c663fb-9edf-46dc-bd9c-9789439c2bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:54.531689 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c663fb-9edf-46dc-bd9c-9789439c2bff None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:54.532039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c663fb-9edf-46dc-bd9c-9789439c2bff None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:54.532382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c663fb-9edf-46dc-bd9c-9789439c2bff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:54.533635 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c663fb-9edf-46dc-bd9c-9789439c2bff None admin] RBAC: Adding query filter params (role.id=1b578241384b4a3698242fde91cc1769, scope.project.id=1dc84b4ea0124c068fa0526c182d02f6, user.id=431fd4cf20d349dd949ec11cf87197e2) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:54.534015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c663fb-9edf-46dc-bd9c-9789439c2bff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:54.535517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c663fb-9edf-46dc-bd9c-9789439c2bff None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:54.542698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 102/201] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:09:54 2022] GET /identity/v3/role_assignments?user.id=431fd4cf20d349dd949ec11cf87197e2&scope.project.id=1dc84b4ea0124c068fa0526c182d02f6&role.id=1b578241384b4a3698242fde91cc1769 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:54.549073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c663fb-9edf-46dc-bd9c-9789439c2bff None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:54.664362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 100/202] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:09:54.668589 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dea547-77db-4387-88f5-fd45f1bb11fa None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:54.767530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c663fb-9edf-46dc-bd9c-9789439c2bff None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:54.809867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:54.812808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c492d-da15-4f53-bca5-f2bdabca0c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:54.814013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c492d-da15-4f53-bca5-f2bdabca0c81 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:54.814517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c492d-da15-4f53-bca5-f2bdabca0c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:54.815258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c492d-da15-4f53-bca5-f2bdabca0c81 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:54.816739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c492d-da15-4f53-bca5-f2bdabca0c81 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:54.820175 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c492d-da15-4f53-bca5-f2bdabca0c81 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:54.823306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 103/203] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:54 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:54.824307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c492d-da15-4f53-bca5-f2bdabca0c81 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:54.833673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dea547-77db-4387-88f5-fd45f1bb11fa None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:54.841100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:54.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40778a7-1183-4ca0-8483-61b2140a4304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:54.884070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40778a7-1183-4ca0-8483-61b2140a4304 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:54.884420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40778a7-1183-4ca0-8483-61b2140a4304 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:54.884784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40778a7-1183-4ca0-8483-61b2140a4304 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:54.886399 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40778a7-1183-4ca0-8483-61b2140a4304 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:54.897154 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40778a7-1183-4ca0-8483-61b2140a4304 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:54.897154 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 101/204] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:54 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:54.897154 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40778a7-1183-4ca0-8483-61b2140a4304 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:54.958882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c492d-da15-4f53-bca5-f2bdabca0c81 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:55.003599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1586b-a1c1-45bb-802c-377c16d35696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:55.005744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1586b-a1c1-45bb-802c-377c16d35696 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:55.006026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1586b-a1c1-45bb-802c-377c16d35696 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:55.006300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1586b-a1c1-45bb-802c-377c16d35696 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:55.009104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1586b-a1c1-45bb-802c-377c16d35696 None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:55.012851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1586b-a1c1-45bb-802c-377c16d35696 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:55.012851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 104/205] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:54 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:55.013066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1586b-a1c1-45bb-802c-377c16d35696 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:55.049049 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40778a7-1183-4ca0-8483-61b2140a4304 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:55.102946 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d8914-8af4-4681-94a1-24f20b8884b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:55.104163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d8914-8af4-4681-94a1-24f20b8884b5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:55.104457 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d8914-8af4-4681-94a1-24f20b8884b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:55.104734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d8914-8af4-4681-94a1-24f20b8884b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:55.105605 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d8914-8af4-4681-94a1-24f20b8884b5 None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=9140784043094850b716a45f8a921768, user.id=d2473c3b3ddd4428b22706836dd8ade1) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:55.105930 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d8914-8af4-4681-94a1-24f20b8884b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:55.107958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d8914-8af4-4681-94a1-24f20b8884b5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:55.117184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 102/206] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:09:54 2022] GET /identity/v3/role_assignments?user.id=d2473c3b3ddd4428b22706836dd8ade1&scope.project.id=9140784043094850b716a45f8a921768&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:55.118289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d8914-8af4-4681-94a1-24f20b8884b5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:55.125056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:55.153097 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:55.173838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1586b-a1c1-45bb-802c-377c16d35696 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:55.250345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5097f-2e5f-41a8-8c13-34eef5ffabdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:55.251561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5097f-2e5f-41a8-8c13-34eef5ffabdf None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:55.251851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5097f-2e5f-41a8-8c13-34eef5ffabdf None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:55.252133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5097f-2e5f-41a8-8c13-34eef5ffabdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:55.252995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5097f-2e5f-41a8-8c13-34eef5ffabdf None admin] RBAC: Adding query filter params (role.id=8eb72f5f99cf44e09c674c32be4bbb9d, scope.project.id=9140784043094850b716a45f8a921768, user.id=d2473c3b3ddd4428b22706836dd8ade1) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:55.253328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5097f-2e5f-41a8-8c13-34eef5ffabdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:55.254859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5097f-2e5f-41a8-8c13-34eef5ffabdf None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:55.261630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 105/207] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:09:55 2022] GET /identity/v3/role_assignments?user.id=d2473c3b3ddd4428b22706836dd8ade1&scope.project.id=9140784043094850b716a45f8a921768&role.id=8eb72f5f99cf44e09c674c32be4bbb9d => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:55.321220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d8914-8af4-4681-94a1-24f20b8884b5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:55.362301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77244af9-52ca-4f42-80b1-65a5b20aedca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:55.363362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77244af9-52ca-4f42-80b1-65a5b20aedca None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:55.363841 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77244af9-52ca-4f42-80b1-65a5b20aedca None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:55.364905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77244af9-52ca-4f42-80b1-65a5b20aedca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:55.365978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77244af9-52ca-4f42-80b1-65a5b20aedca None admin] RBAC: Adding query filter params (role.id=3f956eee424f40eda9501bcc798b6b18, scope.project.id=504ceb17b43e4a218dd7fddd35a66432, user.id=92d3ed20d22c4209b303a7594560f4fb) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:55.366490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77244af9-52ca-4f42-80b1-65a5b20aedca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:55.368210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77244af9-52ca-4f42-80b1-65a5b20aedca None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:55.375620 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 103/208] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:09:55 2022] GET /identity/v3/role_assignments?user.id=92d3ed20d22c4209b303a7594560f4fb&scope.project.id=504ceb17b43e4a218dd7fddd35a66432&role.id=3f956eee424f40eda9501bcc798b6b18 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:55.902938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0ab7f-703a-4700-9d53-3817beae0955 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:55.903476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0ab7f-703a-4700-9d53-3817beae0955 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:55.903476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0ab7f-703a-4700-9d53-3817beae0955 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:55.905031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 106/209] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:55.911780 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417cb6f-a137-4ebc-97dd-8e881c02755c None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:55.912625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417cb6f-a137-4ebc-97dd-8e881c02755c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:55.913097 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417cb6f-a137-4ebc-97dd-8e881c02755c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:55.924226 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213ea7e-45d2-4c4f-97a3-6b9899f7c594 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:55.927291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213ea7e-45d2-4c4f-97a3-6b9899f7c594 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:55.927291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213ea7e-45d2-4c4f-97a3-6b9899f7c594 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:55.927291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 107/210] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:09:55.932230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e7cc-bd65-46ee-b849-f6d29b4e6203 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:55.932520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e7cc-bd65-46ee-b849-f6d29b4e6203 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:55.932802 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e7cc-bd65-46ee-b849-f6d29b4e6203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:55.959300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a417cb6f-a137-4ebc-97dd-8e881c02755c None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:55.959711 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-9bb7e7cc-bd65-46ee-b849-f6d29b4e6203 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:55.960502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a417cb6f-a137-4ebc-97dd-8e881c02755c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:55.963070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9bb7e7cc-bd65-46ee-b849-f6d29b4e6203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:56.038629 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 104/211] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:09:56.047621 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 108/212] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:09:56.062663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417cb6f-a137-4ebc-97dd-8e881c02755c None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:56.075575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7e7cc-bd65-46ee-b849-f6d29b4e6203 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:56.079242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:56.174623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:56.178670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417cb6f-a137-4ebc-97dd-8e881c02755c None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:56.216088 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7e7cc-bd65-46ee-b849-f6d29b4e6203 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:56.219240 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401f211-0e9a-4b3e-b539-8453338ab163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:56.220005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401f211-0e9a-4b3e-b539-8453338ab163 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:56.220357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401f211-0e9a-4b3e-b539-8453338ab163 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:56.220705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401f211-0e9a-4b3e-b539-8453338ab163 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:56.232370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401f211-0e9a-4b3e-b539-8453338ab163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-e401f211-0e9a-4b3e-b539-8453338ab163 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:56.241161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:56.242031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:56.242813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:56.242813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:56.242813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:56.242813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:56.242813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:56.242813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:56.242813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:56.242813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:56.242813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:56.242813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:56.242813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:09:56.242813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:09:56.242813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 105/213] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:56.249839 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401f211-0e9a-4b3e-b539-8453338ab163 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:56.262273 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1144b0-0d94-40bb-a9eb-33efc5dc8833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:56.263390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1144b0-0d94-40bb-a9eb-33efc5dc8833 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:56.263390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1144b0-0d94-40bb-a9eb-33efc5dc8833 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:56.263659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1144b0-0d94-40bb-a9eb-33efc5dc8833 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:56.264782 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1144b0-0d94-40bb-a9eb-33efc5dc8833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:56.266260 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1144b0-0d94-40bb-a9eb-33efc5dc8833 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:56.268092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 109/214] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:56.273448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1144b0-0d94-40bb-a9eb-33efc5dc8833 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:56.339556 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:56.376535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401f211-0e9a-4b3e-b539-8453338ab163 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:56.396896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1144b0-0d94-40bb-a9eb-33efc5dc8833 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:56.423635 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33351518-bdb3-46cd-b01d-b312fe669224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:56.424341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33351518-bdb3-46cd-b01d-b312fe669224 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:56.424684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33351518-bdb3-46cd-b01d-b312fe669224 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:56.424906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33351518-bdb3-46cd-b01d-b312fe669224 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:56.425729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33351518-bdb3-46cd-b01d-b312fe669224 None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:56.426042 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33351518-bdb3-46cd-b01d-b312fe669224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:56.428421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33351518-bdb3-46cd-b01d-b312fe669224 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:56.439403 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 106/215] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:09:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:56.445799 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33351518-bdb3-46cd-b01d-b312fe669224 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:56.449072 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5988b-d77d-4034-b951-88d02326763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:56.453026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5988b-d77d-4034-b951-88d02326763e None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:56.453556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5988b-d77d-4034-b951-88d02326763e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:56.454031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5988b-d77d-4034-b951-88d02326763e None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:56.456448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5988b-d77d-4034-b951-88d02326763e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:56.458558 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5988b-d77d-4034-b951-88d02326763e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:56.471319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:56.554780 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33351518-bdb3-46cd-b01d-b312fe669224 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:56.564512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 110/216] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:09:56 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:09:56.599871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227970c5-6005-40e9-96ea-2453d1c155d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:56.600788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227970c5-6005-40e9-96ea-2453d1c155d1 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:56.601070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227970c5-6005-40e9-96ea-2453d1c155d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:56.601536 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227970c5-6005-40e9-96ea-2453d1c155d1 None admin] PATH_INFO: `/v3/users/4818491a51e848bf976e97b296d37b52` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:56.603679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:56.618733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227970c5-6005-40e9-96ea-2453d1c155d1 None admin] RBAC: Authorizing `identity:get_user(user_id=4818491a51e848bf976e97b296d37b52)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:56.622048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227970c5-6005-40e9-96ea-2453d1c155d1 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:56.622575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 107/217] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:56 2022] GET /identity/v3/users/4818491a51e848bf976e97b296d37b52 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:56.628167 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5988b-d77d-4034-b951-88d02326763e None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:56.741393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5988b-d77d-4034-b951-88d02326763e None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:56.776166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b5706-c2a8-44b4-8c0a-df478cb82e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:56.777197 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5706-c2a8-44b4-8c0a-df478cb82e65 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:56.777683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5706-c2a8-44b4-8c0a-df478cb82e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:56.778167 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5706-c2a8-44b4-8c0a-df478cb82e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:56.842649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:56.850949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b5706-c2a8-44b4-8c0a-df478cb82e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:56.856903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b5706-c2a8-44b4-8c0a-df478cb82e65 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:56.969924 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 111/218] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:09:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:09:56.976216 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227970c5-6005-40e9-96ea-2453d1c155d1 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:57.082618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227970c5-6005-40e9-96ea-2453d1c155d1 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:57.120104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258e0ad-a0e8-451e-b0af-d76610b1be27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:57.120971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258e0ad-a0e8-451e-b0af-d76610b1be27 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:57.121286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258e0ad-a0e8-451e-b0af-d76610b1be27 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:57.121621 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258e0ad-a0e8-451e-b0af-d76610b1be27 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:57.122830 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258e0ad-a0e8-451e-b0af-d76610b1be27 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:57.124307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258e0ad-a0e8-451e-b0af-d76610b1be27 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:57.126214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 108/219] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:56 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:57.132085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b5706-c2a8-44b4-8c0a-df478cb82e65 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:57.241170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:57.247517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b5706-c2a8-44b4-8c0a-df478cb82e65 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:57.285272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fff7e1-27a0-4846-bd47-f2934601d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:57.286502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fff7e1-27a0-4846-bd47-f2934601d19c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:57.286788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fff7e1-27a0-4846-bd47-f2934601d19c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:57.287063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fff7e1-27a0-4846-bd47-f2934601d19c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:57.287909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fff7e1-27a0-4846-bd47-f2934601d19c None admin] RBAC: Adding query filter params (role.id=1b578241384b4a3698242fde91cc1769, scope.project.id=9140784043094850b716a45f8a921768, user.id=4818491a51e848bf976e97b296d37b52) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:57.288222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fff7e1-27a0-4846-bd47-f2934601d19c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:57.289696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fff7e1-27a0-4846-bd47-f2934601d19c None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:57.295699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 112/220] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:09:57 2022] GET /identity/v3/role_assignments?user.id=4818491a51e848bf976e97b296d37b52&scope.project.id=9140784043094850b716a45f8a921768&role.id=1b578241384b4a3698242fde91cc1769 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:57.444415 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8bdeb-40b2-4000-ae47-f280ed90eec9 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:57.444619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8bdeb-40b2-4000-ae47-f280ed90eec9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:57.445174 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8bdeb-40b2-4000-ae47-f280ed90eec9 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:57.447072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 109/221] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:57.456770 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c555fa-f9ea-4178-8332-57d065546c26 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:57.457064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c555fa-f9ea-4178-8332-57d065546c26 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:57.457373 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c555fa-f9ea-4178-8332-57d065546c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:57.485293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-10c555fa-f9ea-4178-8332-57d065546c26 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:57.486509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-10c555fa-f9ea-4178-8332-57d065546c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:57.566020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 113/222] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:57.609630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8bdeb-40b2-4000-ae47-f280ed90eec9 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:57.644438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e420fd-a0e9-45e7-aa63-68b4f121931a None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:57.645066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e420fd-a0e9-45e7-aa63-68b4f121931a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:57.646164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e420fd-a0e9-45e7-aa63-68b4f121931a None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:57.647773 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 114/223] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:57.652895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d016f1-2ac2-430a-b6e5-9ed840e7ac6e None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:57.653468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d016f1-2ac2-430a-b6e5-9ed840e7ac6e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:57.654049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d016f1-2ac2-430a-b6e5-9ed840e7ac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:57.687033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e4d016f1-2ac2-430a-b6e5-9ed840e7ac6e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:57.688232 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e4d016f1-2ac2-430a-b6e5-9ed840e7ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:57.704687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:57.748492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8bdeb-40b2-4000-ae47-f280ed90eec9 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:57.785156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51011db-6b51-48f2-a702-a12eb53ea09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:57.786397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51011db-6b51-48f2-a702-a12eb53ea09a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:57.786884 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51011db-6b51-48f2-a702-a12eb53ea09a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:57.787361 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51011db-6b51-48f2-a702-a12eb53ea09a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:57.798401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51011db-6b51-48f2-a702-a12eb53ea09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-c51011db-6b51-48f2-a702-a12eb53ea09a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:57.807050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:57.807980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:57.808791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:57.808791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:57.808791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:57.808791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:57.808791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:57.808791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:57.808791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:57.808791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:57.808791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:57.808791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:57.808791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:09:57.808791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:09:57.811280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 110/224] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:09:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:57.818119 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51011db-6b51-48f2-a702-a12eb53ea09a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:57.850843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 115/225] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:09:57.888798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d016f1-2ac2-430a-b6e5-9ed840e7ac6e None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:57.925437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:57.927808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51011db-6b51-48f2-a702-a12eb53ea09a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:57.950136 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:57.965307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec81b7-680e-47b2-a52e-917918da6b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:57.966244 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec81b7-680e-47b2-a52e-917918da6b28 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:57.966696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec81b7-680e-47b2-a52e-917918da6b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:57.967156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec81b7-680e-47b2-a52e-917918da6b28 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:57.968076 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec81b7-680e-47b2-a52e-917918da6b28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:57.968549 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec81b7-680e-47b2-a52e-917918da6b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:57.970134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec81b7-680e-47b2-a52e-917918da6b28 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:57.987082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 111/226] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:57.993995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec81b7-680e-47b2-a52e-917918da6b28 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:58.027766 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d016f1-2ac2-430a-b6e5-9ed840e7ac6e None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:58.111030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec81b7-680e-47b2-a52e-917918da6b28 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:58.137881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1e03d-27b2-432c-8d8c-9fc63a7701d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:58.138633 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e03d-27b2-432c-8d8c-9fc63a7701d0 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:58.138919 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e03d-27b2-432c-8d8c-9fc63a7701d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:58.139196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e03d-27b2-432c-8d8c-9fc63a7701d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:58.147766 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0481d28-eb9e-4ede-94e7-e8499690a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:58.148917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0481d28-eb9e-4ede-94e7-e8499690a346 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:58.149420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0481d28-eb9e-4ede-94e7-e8499690a346 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:58.149950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0481d28-eb9e-4ede-94e7-e8499690a346 None admin] PATH_INFO: `/v3/users/d2473c3b3ddd4428b22706836dd8ade1` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:58.151357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0481d28-eb9e-4ede-94e7-e8499690a346 None admin] RBAC: Authorizing `identity:get_user(user_id=d2473c3b3ddd4428b22706836dd8ade1)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:58.153023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0481d28-eb9e-4ede-94e7-e8499690a346 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:58.159469 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 112/227] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:57 2022] GET /identity/v3/users/d2473c3b3ddd4428b22706836dd8ade1 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:58.161442 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0481d28-eb9e-4ede-94e7-e8499690a346 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:58.172548 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1e03d-27b2-432c-8d8c-9fc63a7701d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-68b1e03d-27b2-432c-8d8c-9fc63a7701d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:58.188094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:58.189009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:58.190528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:58.190528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:58.190528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:58.190528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:58.190528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:58.190528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:58.190528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:58.190528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:58.190528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:58.190528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:58.190528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:09:58.190528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:09:58.190528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 116/228] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:09:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:09:58.196304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1e03d-27b2-432c-8d8c-9fc63a7701d0 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:58.225217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:58.297488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:58.325922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0481d28-eb9e-4ede-94e7-e8499690a346 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:58.331312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1e03d-27b2-432c-8d8c-9fc63a7701d0 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:58.365443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb152d2-50b1-4c76-95bc-a19ee112caf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:58.366377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb152d2-50b1-4c76-95bc-a19ee112caf9 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:58.366659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb152d2-50b1-4c76-95bc-a19ee112caf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:58.366974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb152d2-50b1-4c76-95bc-a19ee112caf9 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:58.368178 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb152d2-50b1-4c76-95bc-a19ee112caf9 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:58.369693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb152d2-50b1-4c76-95bc-a19ee112caf9 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:58.371406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 113/229] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:58 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:58.377242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb152d2-50b1-4c76-95bc-a19ee112caf9 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:58.422433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96709bb2-9121-4fbf-a25f-b9e464b9b420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:58.423131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96709bb2-9121-4fbf-a25f-b9e464b9b420 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:58.423418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96709bb2-9121-4fbf-a25f-b9e464b9b420 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:58.423695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96709bb2-9121-4fbf-a25f-b9e464b9b420 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:58.424457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96709bb2-9121-4fbf-a25f-b9e464b9b420 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:58.424765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96709bb2-9121-4fbf-a25f-b9e464b9b420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:58.426194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96709bb2-9121-4fbf-a25f-b9e464b9b420 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:58.444143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 117/230] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:09:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:58.450417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96709bb2-9121-4fbf-a25f-b9e464b9b420 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:58.493086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb152d2-50b1-4c76-95bc-a19ee112caf9 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:58.513058 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:58.532551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959b54f-4916-4e50-9c9b-3f1b1cbb9d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:58.533481 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959b54f-4916-4e50-9c9b-3f1b1cbb9d95 None admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:58.534076 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959b54f-4916-4e50-9c9b-3f1b1cbb9d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:58.534302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959b54f-4916-4e50-9c9b-3f1b1cbb9d95 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768/users/d2473c3b3ddd4428b22706836dd8ade1/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:58.537145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959b54f-4916-4e50-9c9b-3f1b1cbb9d95 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140784043094850b716a45f8a921768, user_id=d2473c3b3ddd4428b22706836dd8ade1, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:58.539162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959b54f-4916-4e50-9c9b-3f1b1cbb9d95 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:58.618067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96709bb2-9121-4fbf-a25f-b9e464b9b420 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:58.623346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 114/231] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:09:58 2022] PUT /identity/v3/projects/9140784043094850b716a45f8a921768/users/d2473c3b3ddd4428b22706836dd8ade1/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:09:58.665146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57919b2c-65aa-43f9-a3ec-563a2ef98c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:58.666068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57919b2c-65aa-43f9-a3ec-563a2ef98c0a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:58.666354 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57919b2c-65aa-43f9-a3ec-563a2ef98c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:58.666629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57919b2c-65aa-43f9-a3ec-563a2ef98c0a None admin] PATH_INFO: `/v3/users/d2473c3b3ddd4428b22706836dd8ade1` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:58.668097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57919b2c-65aa-43f9-a3ec-563a2ef98c0a None admin] RBAC: Authorizing `identity:get_user(user_id=d2473c3b3ddd4428b22706836dd8ade1)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:58.669707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57919b2c-65aa-43f9-a3ec-563a2ef98c0a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:58.671827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 118/232] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:09:58 2022] GET /identity/v3/users/d2473c3b3ddd4428b22706836dd8ade1 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:58.677844 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959b54f-4916-4e50-9c9b-3f1b1cbb9d95 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:58.810430 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959b54f-4916-4e50-9c9b-3f1b1cbb9d95 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:58.847149 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd6a8e-8c60-4ba6-a9ac-5d95c9f5181f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:58.848080 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6a8e-8c60-4ba6-a9ac-5d95c9f5181f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:58.848929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6a8e-8c60-4ba6-a9ac-5d95c9f5181f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:58.849245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6a8e-8c60-4ba6-a9ac-5d95c9f5181f None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:58.850457 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd6a8e-8c60-4ba6-a9ac-5d95c9f5181f None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:58.851939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd6a8e-8c60-4ba6-a9ac-5d95c9f5181f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:58.853985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 115/233] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:09:58 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:58.859441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57919b2c-65aa-43f9-a3ec-563a2ef98c0a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:58.875266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:59.053592 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57919b2c-65aa-43f9-a3ec-563a2ef98c0a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:59.103738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d46239-0ad1-420c-ba0b-93a516ebc017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:59.104862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d46239-0ad1-420c-ba0b-93a516ebc017 None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:59.105319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d46239-0ad1-420c-ba0b-93a516ebc017 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:59.105736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d46239-0ad1-420c-ba0b-93a516ebc017 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768/users/d2473c3b3ddd4428b22706836dd8ade1/roles/8eb72f5f99cf44e09c674c32be4bbb9d` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:59.108220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d46239-0ad1-420c-ba0b-93a516ebc017 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140784043094850b716a45f8a921768, user_id=d2473c3b3ddd4428b22706836dd8ade1, role_id=8eb72f5f99cf44e09c674c32be4bbb9d)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:59.109856 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d46239-0ad1-420c-ba0b-93a516ebc017 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:59.232328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9a4a1-d1de-4fac-89c3-c4ad38ec33c6 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:59.232328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9a4a1-d1de-4fac-89c3-c4ad38ec33c6 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:59.232328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9a4a1-d1de-4fac-89c3-c4ad38ec33c6 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:59.232328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 116/234] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:59.238878 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbf5ea-0938-4da7-8bcd-2d8adbd7415c None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:59.239395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbf5ea-0938-4da7-8bcd-2d8adbd7415c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:59.239843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbf5ea-0938-4da7-8bcd-2d8adbd7415c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:59.250473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 119/235] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:09:58 2022] PUT /identity/v3/projects/9140784043094850b716a45f8a921768/users/d2473c3b3ddd4428b22706836dd8ade1/roles/8eb72f5f99cf44e09c674c32be4bbb9d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:09:59.267118 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a7dbf5ea-0938-4da7-8bcd-2d8adbd7415c None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:59.268770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a7dbf5ea-0938-4da7-8bcd-2d8adbd7415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:59.337393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:59.370806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 117/236] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:09:59.412990 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d46239-0ad1-420c-ba0b-93a516ebc017 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:59.422806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321d2a3-9bb3-4058-a49d-43d224198aea None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:59.423096 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321d2a3-9bb3-4058-a49d-43d224198aea None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:59.423383 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321d2a3-9bb3-4058-a49d-43d224198aea None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:59.425835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 118/237] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:09:59.431652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc635-9af7-4711-8284-99e05e65e080 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:59.431941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc635-9af7-4711-8284-99e05e65e080 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:59.432586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc635-9af7-4711-8284-99e05e65e080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:59.468884 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-3b8cc635-9af7-4711-8284-99e05e65e080 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:59.471003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3b8cc635-9af7-4711-8284-99e05e65e080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:09:59.514603 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:59.550095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d46239-0ad1-420c-ba0b-93a516ebc017 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:59.590545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6f1b2-9035-476f-8617-d75aa8021491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:59.591690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6f1b2-9035-476f-8617-d75aa8021491 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:59.592158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6f1b2-9035-476f-8617-d75aa8021491 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:59.592616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6f1b2-9035-476f-8617-d75aa8021491 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:59.605671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6f1b2-9035-476f-8617-d75aa8021491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-0ed6f1b2-9035-476f-8617-d75aa8021491 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:09:59.615538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:09:59.616443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:09:59.617289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:09:59.617289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:09:59.617289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:09:59.617289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:09:59.617289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:09:59.617289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:09:59.617289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:09:59.617289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:09:59.617289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:09:59.617289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:09:59.617289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:09:59.617289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:09:59.619844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 120/238] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:09:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:09:59.626074 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6f1b2-9035-476f-8617-d75aa8021491 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:59.633227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 119/239] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:09:59.656305 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cc635-9af7-4711-8284-99e05e65e080 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:59.817346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6f1b2-9035-476f-8617-d75aa8021491 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:59.835864 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cc635-9af7-4711-8284-99e05e65e080 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:09:59.854272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:59.888507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:09:59.890300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d8ea8-42ee-45e6-b00f-4c4ec00ce1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:59.894971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d8ea8-42ee-45e6-b00f-4c4ec00ce1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:59.894971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d8ea8-42ee-45e6-b00f-4c4ec00ce1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:59.894971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d8ea8-42ee-45e6-b00f-4c4ec00ce1e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:59.894971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d8ea8-42ee-45e6-b00f-4c4ec00ce1e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:59.895885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d8ea8-42ee-45e6-b00f-4c4ec00ce1e1 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:59.897184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544873f0-76ff-4f8c-ab22-205210705263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:09:59.897728 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 120/240] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:09:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:09:59.898577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544873f0-76ff-4f8c-ab22-205210705263 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:59.899046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544873f0-76ff-4f8c-ab22-205210705263 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:59.899504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544873f0-76ff-4f8c-ab22-205210705263 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:59.900461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544873f0-76ff-4f8c-ab22-205210705263 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:09:59.900949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544873f0-76ff-4f8c-ab22-205210705263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:09:59.902409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fed1a-f8c4-4e33-a2ca-8b7f8f5b51c5 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:59.902716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544873f0-76ff-4f8c-ab22-205210705263 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:09:59.902820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fed1a-f8c4-4e33-a2ca-8b7f8f5b51c5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:59.903011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fed1a-f8c4-4e33-a2ca-8b7f8f5b51c5 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:59.909329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 121/241] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:09:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:09:59.910137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fed1a-f8c4-4e33-a2ca-8b7f8f5b51c5 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:09:59.916617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 121/242] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:09:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:09:59.918367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ac2c-fe87-4c8f-8ff4-9a12a101a4a6 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:09:59.918875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ac2c-fe87-4c8f-8ff4-9a12a101a4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:09:59.919386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ac2c-fe87-4c8f-8ff4-9a12a101a4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:09:59.939023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-aa70ac2c-fe87-4c8f-8ff4-9a12a101a4a6 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:09:59.940491 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-aa70ac2c-fe87-4c8f-8ff4-9a12a101a4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:00.020806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 122/243] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:00.021735 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70ac2c-fe87-4c8f-8ff4-9a12a101a4a6 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:00.037833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fed1a-f8c4-4e33-a2ca-8b7f8f5b51c5 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:00.075087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f59a9-03d6-43c5-8926-e9ccd3596da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:00.076133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f59a9-03d6-43c5-8926-e9ccd3596da5 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:00.076642 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f59a9-03d6-43c5-8926-e9ccd3596da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:00.077138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f59a9-03d6-43c5-8926-e9ccd3596da5 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:00.078097 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f59a9-03d6-43c5-8926-e9ccd3596da5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:00.079762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f59a9-03d6-43c5-8926-e9ccd3596da5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:00.131197 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70ac2c-fe87-4c8f-8ff4-9a12a101a4a6 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:00.154656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:00.160010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 122/244] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:09:59 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:10:00.162080 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f59a9-03d6-43c5-8926-e9ccd3596da5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:00.168017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59280629-591f-4e6c-86e6-4a5e9985a5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:00.169087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59280629-591f-4e6c-86e6-4a5e9985a5bd None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:00.169503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59280629-591f-4e6c-86e6-4a5e9985a5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:00.169843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59280629-591f-4e6c-86e6-4a5e9985a5bd None admin] PATH_INFO: `/v3/users/59c0507b3d8f424f926f53861e97825e` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:00.187323 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59280629-591f-4e6c-86e6-4a5e9985a5bd None admin] RBAC: Authorizing `identity:get_user(user_id=59c0507b3d8f424f926f53861e97825e)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:00.189312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59280629-591f-4e6c-86e6-4a5e9985a5bd None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:00.191633 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 123/245] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:10:00 2022] GET /identity/v3/users/59c0507b3d8f424f926f53861e97825e => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:00.198888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59280629-591f-4e6c-86e6-4a5e9985a5bd None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:00.204369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:00.293098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f59a9-03d6-43c5-8926-e9ccd3596da5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:00.346961 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a85a62-61d7-4a8c-9749-b7a6bd89ff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:00.347871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a85a62-61d7-4a8c-9749-b7a6bd89ff23 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:00.348159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a85a62-61d7-4a8c-9749-b7a6bd89ff23 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:00.348965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a85a62-61d7-4a8c-9749-b7a6bd89ff23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:00.361815 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a85a62-61d7-4a8c-9749-b7a6bd89ff23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:00.368653 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59280629-591f-4e6c-86e6-4a5e9985a5bd None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-91a85a62-61d7-4a8c-9749-b7a6bd89ff23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:00.370710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:00.371667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:00.372630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:00.372630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:00.372630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:00.372630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:00.372630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:00.372630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:00.372630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:00.372630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:00.372630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:00.372630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:00.372630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:00.372630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:00.372630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 123/246] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:00.377885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a85a62-61d7-4a8c-9749-b7a6bd89ff23 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:00.409925 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bd290-2ae7-4724-9929-63c9ec380028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:00.410588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bd290-2ae7-4724-9929-63c9ec380028 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:00.411563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bd290-2ae7-4724-9929-63c9ec380028 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:00.411902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bd290-2ae7-4724-9929-63c9ec380028 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:00.479235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:00.495057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a85a62-61d7-4a8c-9749-b7a6bd89ff23 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:00.505464 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:00.508830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bd290-2ae7-4724-9929-63c9ec380028 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:00.511157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bd290-2ae7-4724-9929-63c9ec380028 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:00.548978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5b86e-7394-41b1-a85c-eaefb2348446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:00.549867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5b86e-7394-41b1-a85c-eaefb2348446 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:00.550253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5b86e-7394-41b1-a85c-eaefb2348446 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:00.550531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5b86e-7394-41b1-a85c-eaefb2348446 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:00.551297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5b86e-7394-41b1-a85c-eaefb2348446 None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:00.552307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5b86e-7394-41b1-a85c-eaefb2348446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:00.555181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5b86e-7394-41b1-a85c-eaefb2348446 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:00.569478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 124/247] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:00.575003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5b86e-7394-41b1-a85c-eaefb2348446 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:00.657251 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 124/248] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:00.663451 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bd290-2ae7-4724-9929-63c9ec380028 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:00.719982 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5b86e-7394-41b1-a85c-eaefb2348446 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:00.760731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1658038-d374-4cd3-8ab7-df50c22f872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:00.761721 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1658038-d374-4cd3-8ab7-df50c22f872e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:00.762012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1658038-d374-4cd3-8ab7-df50c22f872e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:00.762288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1658038-d374-4cd3-8ab7-df50c22f872e None admin] PATH_INFO: `/v3/users/4818491a51e848bf976e97b296d37b52` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:00.763577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1658038-d374-4cd3-8ab7-df50c22f872e None admin] RBAC: Authorizing `identity:get_user(user_id=4818491a51e848bf976e97b296d37b52)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:00.765045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1658038-d374-4cd3-8ab7-df50c22f872e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:00.766054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:00.767812 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 125/249] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:10:00 2022] GET /identity/v3/users/4818491a51e848bf976e97b296d37b52 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:00.773457 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1658038-d374-4cd3-8ab7-df50c22f872e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:00.789185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bd290-2ae7-4724-9929-63c9ec380028 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:00.796027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:00.831179 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5e41d-2d4d-4286-95bb-33805d827100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:00.832408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5e41d-2d4d-4286-95bb-33805d827100 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:00.832938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5e41d-2d4d-4286-95bb-33805d827100 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:00.833479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5e41d-2d4d-4286-95bb-33805d827100 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:00.834905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5e41d-2d4d-4286-95bb-33805d827100 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:00.836573 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5e41d-2d4d-4286-95bb-33805d827100 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:00.838870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 125/250] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:00 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:00.850136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5e41d-2d4d-4286-95bb-33805d827100 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:00.899828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1658038-d374-4cd3-8ab7-df50c22f872e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:00.965711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee7dd4-b3a4-4cf0-982c-966be5737b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:00.967153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee7dd4-b3a4-4cf0-982c-966be5737b3a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:00.967698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee7dd4-b3a4-4cf0-982c-966be5737b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:00.973573 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee7dd4-b3a4-4cf0-982c-966be5737b3a None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:00.975072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee7dd4-b3a4-4cf0-982c-966be5737b3a None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:00.976642 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee7dd4-b3a4-4cf0-982c-966be5737b3a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:00.983026 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 126/251] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:00 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:00.987202 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee7dd4-b3a4-4cf0-982c-966be5737b3a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:01.047407 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5e41d-2d4d-4286-95bb-33805d827100 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:01.107876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768d0a7-4865-4855-b5f4-644e47219a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:01.108785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d0a7-4865-4855-b5f4-644e47219a3a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:01.109246 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d0a7-4865-4855-b5f4-644e47219a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:01.109847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d0a7-4865-4855-b5f4-644e47219a3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:01.110901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768d0a7-4865-4855-b5f4-644e47219a3a None admin] RBAC: Adding query filter params (role.id=3f956eee424f40eda9501bcc798b6b18, scope.project.id=9140784043094850b716a45f8a921768, user.id=59c0507b3d8f424f926f53861e97825e) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:01.111443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768d0a7-4865-4855-b5f4-644e47219a3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:01.113102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768d0a7-4865-4855-b5f4-644e47219a3a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:01.124692 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 126/252] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:00 2022] GET /identity/v3/role_assignments?user.id=59c0507b3d8f424f926f53861e97825e&scope.project.id=9140784043094850b716a45f8a921768&role.id=3f956eee424f40eda9501bcc798b6b18 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:01.193544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:01.210360 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee7dd4-b3a4-4cf0-982c-966be5737b3a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:01.258221 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a03e15-2b37-4739-b8c0-493850df62cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:01.259058 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a03e15-2b37-4739-b8c0-493850df62cf None admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:01.259348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a03e15-2b37-4739-b8c0-493850df62cf None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:01.259629 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a03e15-2b37-4739-b8c0-493850df62cf None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768/users/4818491a51e848bf976e97b296d37b52/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:01.261802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a03e15-2b37-4739-b8c0-493850df62cf None admin] RBAC: Authorizing `identity:create_grant(project_id=9140784043094850b716a45f8a921768, user_id=4818491a51e848bf976e97b296d37b52, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:01.263269 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a03e15-2b37-4739-b8c0-493850df62cf None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:01.390377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 127/253] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:10:00 2022] PUT /identity/v3/projects/9140784043094850b716a45f8a921768/users/4818491a51e848bf976e97b296d37b52/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:10:01.447928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a5ca6-5f0b-44e3-824b-b200a7dffcd4 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:01.448430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a5ca6-5f0b-44e3-824b-b200a7dffcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:01.448506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a5ca6-5f0b-44e3-824b-b200a7dffcd4 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:01.449948 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 127/254] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:01.458774 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b98b4-0307-4b4d-99bb-5561b5042787 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:01.459068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b98b4-0307-4b4d-99bb-5561b5042787 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:01.459351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b98b4-0307-4b4d-99bb-5561b5042787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:01.486303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ae8b98b4-0307-4b4d-99bb-5561b5042787 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:01.487538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ae8b98b4-0307-4b4d-99bb-5561b5042787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:01.578522 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 128/255] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:01.611996 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a5ca6-5f0b-44e3-824b-b200a7dffcd4 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:01.632995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:01.745788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a5ca6-5f0b-44e3-824b-b200a7dffcd4 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:01.792575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064bec5e-ed28-47f4-bded-72febe84d2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:01.793650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bec5e-ed28-47f4-bded-72febe84d2ba None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:01.794075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bec5e-ed28-47f4-bded-72febe84d2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:01.794492 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bec5e-ed28-47f4-bded-72febe84d2ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:01.810403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064bec5e-ed28-47f4-bded-72febe84d2ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-064bec5e-ed28-47f4-bded-72febe84d2ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:01.822493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:01.823585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:01.824578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:01.824578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:01.824578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:01.824578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:01.824578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:01.824578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:01.824578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:01.824578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:01.824578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:01.824578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:01.824578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:01.824578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:01.826924 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 128/256] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:10:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:01.835180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b98b4-0307-4b4d-99bb-5561b5042787 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:01.916685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33c4d5-d62a-46e3-af8b-36f14e77808a None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:01.917391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33c4d5-d62a-46e3-af8b-36f14e77808a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:01.917871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33c4d5-d62a-46e3-af8b-36f14e77808a None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:01.919604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 129/257] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:10:01.927059 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27b18-7be2-4fb6-99f4-d7ab08fc8c08 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:01.927579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27b18-7be2-4fb6-99f4-d7ab08fc8c08 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:01.928070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27b18-7be2-4fb6-99f4-d7ab08fc8c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:01.937512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:01.958219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b98b4-0307-4b4d-99bb-5561b5042787 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:01.978978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-31b27b18-7be2-4fb6-99f4-d7ab08fc8c08 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:01.980183 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-31b27b18-7be2-4fb6-99f4-d7ab08fc8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:02.000941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00db8c-9ee9-447c-b6df-636da007b2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:02.001648 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00db8c-9ee9-447c-b6df-636da007b2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:02.001924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00db8c-9ee9-447c-b6df-636da007b2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:02.002202 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00db8c-9ee9-447c-b6df-636da007b2c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:02.002958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00db8c-9ee9-447c-b6df-636da007b2c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:02.003269 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00db8c-9ee9-447c-b6df-636da007b2c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:02.004693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00db8c-9ee9-447c-b6df-636da007b2c2 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:02.019786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 129/258] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:02.024795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00db8c-9ee9-447c-b6df-636da007b2c2 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:02.115847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 130/259] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:02.143207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b27b18-7be2-4fb6-99f4-d7ab08fc8c08 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:02.145449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:02.193289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00db8c-9ee9-447c-b6df-636da007b2c2 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:02.278382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756be30-a045-4943-8d00-982fa8b8dd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:02.279346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756be30-a045-4943-8d00-982fa8b8dd2a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:02.279653 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756be30-a045-4943-8d00-982fa8b8dd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:02.279902 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756be30-a045-4943-8d00-982fa8b8dd2a None admin] PATH_INFO: `/v3/users/d2473c3b3ddd4428b22706836dd8ade1` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:02.281399 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756be30-a045-4943-8d00-982fa8b8dd2a None admin] RBAC: Authorizing `identity:get_user(user_id=d2473c3b3ddd4428b22706836dd8ade1)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:02.282876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756be30-a045-4943-8d00-982fa8b8dd2a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:02.284904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 130/260] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:10:02 2022] GET /identity/v3/users/d2473c3b3ddd4428b22706836dd8ade1 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:02.290376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756be30-a045-4943-8d00-982fa8b8dd2a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:02.307753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b27b18-7be2-4fb6-99f4-d7ab08fc8c08 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:02.308428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:02.375567 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113a41f-92a5-42b2-a00c-b8caec85b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:02.376311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113a41f-92a5-42b2-a00c-b8caec85b268 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:02.376968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113a41f-92a5-42b2-a00c-b8caec85b268 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:02.377294 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113a41f-92a5-42b2-a00c-b8caec85b268 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:02.398985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113a41f-92a5-42b2-a00c-b8caec85b268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-1113a41f-92a5-42b2-a00c-b8caec85b268 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:02.412027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:02.412926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:02.413744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:02.413744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:02.413744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:02.413744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:02.413744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:02.413744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:02.413744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:02.413744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:02.413744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:02.413744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:02.413744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:02.413744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:02.422340 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 131/261] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:10:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:02.428806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113a41f-92a5-42b2-a00c-b8caec85b268 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:02.515190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756be30-a045-4943-8d00-982fa8b8dd2a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:02.580071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb714491-633f-4fdb-b734-c44bddd3fc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:02.580726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb714491-633f-4fdb-b734-c44bddd3fc6c None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:02.581015 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb714491-633f-4fdb-b734-c44bddd3fc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:02.581316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb714491-633f-4fdb-b734-c44bddd3fc6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:02.581485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:02.669215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113a41f-92a5-42b2-a00c-b8caec85b268 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:02.731693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb714491-633f-4fdb-b734-c44bddd3fc6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:02.733242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb714491-633f-4fdb-b734-c44bddd3fc6c None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:02.741921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c0e60-211d-48d8-8454-35a8e06b5ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:02.743536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c0e60-211d-48d8-8454-35a8e06b5ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:02.743830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c0e60-211d-48d8-8454-35a8e06b5ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:02.744115 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c0e60-211d-48d8-8454-35a8e06b5ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:02.744893 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c0e60-211d-48d8-8454-35a8e06b5ae8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:02.745250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c0e60-211d-48d8-8454-35a8e06b5ae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:02.746639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c0e60-211d-48d8-8454-35a8e06b5ae8 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:02.759546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:02.767931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 132/262] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:02.773682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c0e60-211d-48d8-8454-35a8e06b5ae8 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:02.976128 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 131/263] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:02.990197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb714491-633f-4fdb-b734-c44bddd3fc6c None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:03.016862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c0e60-211d-48d8-8454-35a8e06b5ae8 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:03.046407 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:03.070458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e077a-a1cd-472a-8707-e220e85b65ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:03.071687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e077a-a1cd-472a-8707-e220e85b65ab None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:03.072170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e077a-a1cd-472a-8707-e220e85b65ab None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:03.072640 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e077a-a1cd-472a-8707-e220e85b65ab None admin] PATH_INFO: `/v3/users/d2473c3b3ddd4428b22706836dd8ade1` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:03.074251 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e077a-a1cd-472a-8707-e220e85b65ab None admin] RBAC: Authorizing `identity:get_user(user_id=d2473c3b3ddd4428b22706836dd8ade1)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:03.075909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e077a-a1cd-472a-8707-e220e85b65ab None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:03.078617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 133/264] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:10:02 2022] GET /identity/v3/users/d2473c3b3ddd4428b22706836dd8ade1 => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:03.083957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e077a-a1cd-472a-8707-e220e85b65ab None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:03.177213 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb714491-633f-4fdb-b734-c44bddd3fc6c None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:03.193656 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:03.243648 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a2c52-99e6-4ab1-895f-676044f3bca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:03.245013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a2c52-99e6-4ab1-895f-676044f3bca2 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:03.246544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a2c52-99e6-4ab1-895f-676044f3bca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:03.247188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a2c52-99e6-4ab1-895f-676044f3bca2 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:03.249679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a2c52-99e6-4ab1-895f-676044f3bca2 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:03.251503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a2c52-99e6-4ab1-895f-676044f3bca2 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:03.254209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 132/265] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:02 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:03.263883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a2c52-99e6-4ab1-895f-676044f3bca2 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:03.274967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e077a-a1cd-472a-8707-e220e85b65ab None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:03.338941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b5fa2-7071-4533-82ac-9888b204225b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:03.339957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b5fa2-7071-4533-82ac-9888b204225b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:03.340465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b5fa2-7071-4533-82ac-9888b204225b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:03.340958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b5fa2-7071-4533-82ac-9888b204225b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:03.435778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a2c52-99e6-4ab1-895f-676044f3bca2 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:03.439774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:03.457874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b5fa2-7071-4533-82ac-9888b204225b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:03.459350 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b5fa2-7071-4533-82ac-9888b204225b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:03.498663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfadc51-63cb-4560-ba7a-fbdd2f2501d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:03.499238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfadc51-63cb-4560-ba7a-fbdd2f2501d3 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:03.499521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfadc51-63cb-4560-ba7a-fbdd2f2501d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:03.499795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfadc51-63cb-4560-ba7a-fbdd2f2501d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:03.500794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfadc51-63cb-4560-ba7a-fbdd2f2501d3 None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=9140784043094850b716a45f8a921768, user.id=d2473c3b3ddd4428b22706836dd8ade1) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:03.501439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfadc51-63cb-4560-ba7a-fbdd2f2501d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:03.503176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfadc51-63cb-4560-ba7a-fbdd2f2501d3 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:03.510894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 133/266] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:03 2022] GET /identity/v3/role_assignments?user.id=d2473c3b3ddd4428b22706836dd8ade1&scope.project.id=9140784043094850b716a45f8a921768&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:03.512138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef847bb-b9bc-46a8-b591-d82f9ffa87b9 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:03.512428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef847bb-b9bc-46a8-b591-d82f9ffa87b9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:03.512702 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef847bb-b9bc-46a8-b591-d82f9ffa87b9 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:03.514757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 134/267] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:03.516004 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb9930-0ee9-4694-ad66-490903ea33f2 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:03.516531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb9930-0ee9-4694-ad66-490903ea33f2 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:03.516531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb9930-0ee9-4694-ad66-490903ea33f2 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:03.518318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 135/268] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:03.523428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725e2d-9ba2-424d-800d-379c4fbf7060 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:03.523428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725e2d-9ba2-424d-800d-379c4fbf7060 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:03.523428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725e2d-9ba2-424d-800d-379c4fbf7060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:03.570919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-bb725e2d-9ba2-424d-800d-379c4fbf7060 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:03.572519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bb725e2d-9ba2-424d-800d-379c4fbf7060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:03.592722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 134/269] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:03.594806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11d577-36ee-40a4-8941-8cb83b0cdb3d None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:03.595342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11d577-36ee-40a4-8941-8cb83b0cdb3d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:03.595821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11d577-36ee-40a4-8941-8cb83b0cdb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:03.637579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:03.638196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-5b11d577-36ee-40a4-8941-8cb83b0cdb3d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:03.639441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5b11d577-36ee-40a4-8941-8cb83b0cdb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:03.682390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 136/270] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:03.683285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725e2d-9ba2-424d-800d-379c4fbf7060 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:03.766476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 135/271] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:03.767732 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11d577-36ee-40a4-8941-8cb83b0cdb3d None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:03.791444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725e2d-9ba2-424d-800d-379c4fbf7060 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:03.817152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:03.833139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67535e-e4c7-47e3-8194-40d9c0dcefda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:03.833139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67535e-e4c7-47e3-8194-40d9c0dcefda None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:03.833139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67535e-e4c7-47e3-8194-40d9c0dcefda None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:03.833139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67535e-e4c7-47e3-8194-40d9c0dcefda None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:03.833739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67535e-e4c7-47e3-8194-40d9c0dcefda None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:03.835252 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67535e-e4c7-47e3-8194-40d9c0dcefda None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:03.837311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 137/272] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:03 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:03.843130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67535e-e4c7-47e3-8194-40d9c0dcefda None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:03.887829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:03.906694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11d577-36ee-40a4-8941-8cb83b0cdb3d None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:03.945746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998dae6-16c9-4fb9-8456-d7e6999f8566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:03.946903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998dae6-16c9-4fb9-8456-d7e6999f8566 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:03.947418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998dae6-16c9-4fb9-8456-d7e6999f8566 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:03.948035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998dae6-16c9-4fb9-8456-d7e6999f8566 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:03.954357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67535e-e4c7-47e3-8194-40d9c0dcefda None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:03.962706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998dae6-16c9-4fb9-8456-d7e6999f8566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-c998dae6-16c9-4fb9-8456-d7e6999f8566 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:03.974261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:03.975180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:03.975993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:03.975993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:03.975993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:03.975993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:03.975993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:03.975993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:03.975993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:03.975993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:03.975993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:03.975993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:03.975993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:03.975993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:03.978880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 136/273] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:03.980024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998dae6-16c9-4fb9-8456-d7e6999f8566 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:03.991704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6e265-38d0-4d9b-b647-13c4b01ad717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:03.992371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6e265-38d0-4d9b-b647-13c4b01ad717 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:03.992652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6e265-38d0-4d9b-b647-13c4b01ad717 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:03.993183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6e265-38d0-4d9b-b647-13c4b01ad717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:03.993987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6e265-38d0-4d9b-b647-13c4b01ad717 None admin] RBAC: Adding query filter params (role.id=8eb72f5f99cf44e09c674c32be4bbb9d, scope.project.id=9140784043094850b716a45f8a921768, user.id=d2473c3b3ddd4428b22706836dd8ade1) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:03.994300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6e265-38d0-4d9b-b647-13c4b01ad717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:03.995745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6e265-38d0-4d9b-b647-13c4b01ad717 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:04.002921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 138/274] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:03 2022] GET /identity/v3/role_assignments?user.id=d2473c3b3ddd4428b22706836dd8ade1&scope.project.id=9140784043094850b716a45f8a921768&role.id=8eb72f5f99cf44e09c674c32be4bbb9d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:04.003545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6e265-38d0-4d9b-b647-13c4b01ad717 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:04.089529 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:04.098529 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998dae6-16c9-4fb9-8456-d7e6999f8566 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:04.139236 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8ac1a-2745-4683-9f56-57e779195c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:04.141222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8ac1a-2745-4683-9f56-57e779195c43 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:04.141980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8ac1a-2745-4683-9f56-57e779195c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:04.142477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8ac1a-2745-4683-9f56-57e779195c43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:04.143543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6e265-38d0-4d9b-b647-13c4b01ad717 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:04.144261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8ac1a-2745-4683-9f56-57e779195c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:04.146008 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:04.148715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8ac1a-2745-4683-9f56-57e779195c43 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:04.150821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 137/275] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:04.152338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f838d1-ca69-4302-9b7f-ac7393ca7223 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:04.157462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f838d1-ca69-4302-9b7f-ac7393ca7223 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:04.157462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f838d1-ca69-4302-9b7f-ac7393ca7223 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:04.157462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 138/276] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:04.160785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f838d1-ca69-4302-9b7f-ac7393ca7223 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:04.188962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb6366-db69-4bab-aa2e-671df9770069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:04.189706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb6366-db69-4bab-aa2e-671df9770069 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:04.190254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb6366-db69-4bab-aa2e-671df9770069 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:04.190532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb6366-db69-4bab-aa2e-671df9770069 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:04.191618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb6366-db69-4bab-aa2e-671df9770069 None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:04.191618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb6366-db69-4bab-aa2e-671df9770069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:04.193966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb6366-db69-4bab-aa2e-671df9770069 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:04.204424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 139/277] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:04.205715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a747b6c-f88a-43d6-8c3c-1cc4e44f2113 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:04.205954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a747b6c-f88a-43d6-8c3c-1cc4e44f2113 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:04.206233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a747b6c-f88a-43d6-8c3c-1cc4e44f2113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:04.225145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-2a747b6c-f88a-43d6-8c3c-1cc4e44f2113 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:04.226328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-2a747b6c-f88a-43d6-8c3c-1cc4e44f2113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:04.287741 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f838d1-ca69-4302-9b7f-ac7393ca7223 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:04.304636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 140/278] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:04.305871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a747b6c-f88a-43d6-8c3c-1cc4e44f2113 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:04.335014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73d028-c72c-4573-8d0c-9b29df1dad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:04.336115 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d028-c72c-4573-8d0c-9b29df1dad8e None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:04.336615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d028-c72c-4573-8d0c-9b29df1dad8e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:04.337174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d028-c72c-4573-8d0c-9b29df1dad8e None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:04.338089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73d028-c72c-4573-8d0c-9b29df1dad8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:04.339781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73d028-c72c-4573-8d0c-9b29df1dad8e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:04.408186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:04.415246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a747b6c-f88a-43d6-8c3c-1cc4e44f2113 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:04.448712 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a8b11-e2f0-46de-a7da-2dd50d0fc214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:04.449801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a8b11-e2f0-46de-a7da-2dd50d0fc214 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:04.450082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a8b11-e2f0-46de-a7da-2dd50d0fc214 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:04.450359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a8b11-e2f0-46de-a7da-2dd50d0fc214 None admin] PATH_INFO: `/v3/users/200a97a2ce0b4ac0bed8915e1bd9b13e` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:04.455316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 139/279] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:10:04 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:10:04.456162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73d028-c72c-4573-8d0c-9b29df1dad8e None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:04.465222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a8b11-e2f0-46de-a7da-2dd50d0fc214 None admin] RBAC: Authorizing `identity:get_user(user_id=200a97a2ce0b4ac0bed8915e1bd9b13e)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:04.466813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a8b11-e2f0-46de-a7da-2dd50d0fc214 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:04.468674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 141/280] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:10:04 2022] GET /identity/v3/users/200a97a2ce0b4ac0bed8915e1bd9b13e => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:04.470073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708e41-6ec8-49f3-afa4-73d8d445e79c None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:04.470356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708e41-6ec8-49f3-afa4-73d8d445e79c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:04.470630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708e41-6ec8-49f3-afa4-73d8d445e79c None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:04.472177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 142/281] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:04.475585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa708e41-6ec8-49f3-afa4-73d8d445e79c None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:04.480969 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:04.585168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73d028-c72c-4573-8d0c-9b29df1dad8e None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:04.595772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa708e41-6ec8-49f3-afa4-73d8d445e79c None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:04.625325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b3714-0c9b-4a2d-b8fd-a8b40b5ea6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:04.626717 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b3714-0c9b-4a2d-b8fd-a8b40b5ea6aa None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:04.627162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b3714-0c9b-4a2d-b8fd-a8b40b5ea6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:04.627619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b3714-0c9b-4a2d-b8fd-a8b40b5ea6aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:04.637533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c05b0-6244-4eec-b0ff-b8e2e978f283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:04.638308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b3714-0c9b-4a2d-b8fd-a8b40b5ea6aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:04.638453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c05b0-6244-4eec-b0ff-b8e2e978f283 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:04.638734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c05b0-6244-4eec-b0ff-b8e2e978f283 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:04.639012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c05b0-6244-4eec-b0ff-b8e2e978f283 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:04.639846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c05b0-6244-4eec-b0ff-b8e2e978f283 None admin] RBAC: Adding query filter params (role.id=1b578241384b4a3698242fde91cc1769, user.id=200a97a2ce0b4ac0bed8915e1bd9b13e, scope.system=all) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:04.640159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c05b0-6244-4eec-b0ff-b8e2e978f283 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:04.641616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c05b0-6244-4eec-b0ff-b8e2e978f283 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-146b3714-0c9b-4a2d-b8fd-a8b40b5ea6aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:04.646765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:04.647639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:04.648439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:04.648439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:04.648439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:04.648439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:04.648439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:04.648439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:04.648439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:04.648439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:04.648439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:04.648439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:04.648439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:10:04.648439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:04.649073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 143/282] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Jul 12 16:10:04 2022] GET /identity/v3/role_assignments?user.id=200a97a2ce0b4ac0bed8915e1bd9b13e&scope.system=all&role.id=1b578241384b4a3698242fde91cc1769 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:04.649073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08948c-32f9-4b75-92dd-3576f86cac0f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:04.649073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08948c-32f9-4b75-92dd-3576f86cac0f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:04.649866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08948c-32f9-4b75-92dd-3576f86cac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:04.653800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 140/283] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:04.659873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b3714-0c9b-4a2d-b8fd-a8b40b5ea6aa None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:04.671577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-7b08948c-32f9-4b75-92dd-3576f86cac0f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:04.672827 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-7b08948c-32f9-4b75-92dd-3576f86cac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:04.693498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:04.765480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 144/284] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:04.771332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:04.791482 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08948c-32f9-4b75-92dd-3576f86cac0f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:04.813859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b3714-0c9b-4a2d-b8fd-a8b40b5ea6aa None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:04.859557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f92f46-6189-4d82-8123-928dd8f9d327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:04.860302 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f92f46-6189-4d82-8123-928dd8f9d327 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:04.860737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f92f46-6189-4d82-8123-928dd8f9d327 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:04.861022 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f92f46-6189-4d82-8123-928dd8f9d327 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:04.862003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f92f46-6189-4d82-8123-928dd8f9d327 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:04.862322 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f92f46-6189-4d82-8123-928dd8f9d327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:04.865901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f92f46-6189-4d82-8123-928dd8f9d327 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:04.877205 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 141/285] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:04.881975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f92f46-6189-4d82-8123-928dd8f9d327 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:04.918879 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08948c-32f9-4b75-92dd-3576f86cac0f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:04.960068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4df4a-76e4-481f-8190-0ccd207b3641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:04.961394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4df4a-76e4-481f-8190-0ccd207b3641 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:04.962658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4df4a-76e4-481f-8190-0ccd207b3641 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:04.963091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4df4a-76e4-481f-8190-0ccd207b3641 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:04.975828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4df4a-76e4-481f-8190-0ccd207b3641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-56f4df4a-76e4-481f-8190-0ccd207b3641 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:04.986798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:04.987730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:04.988523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:04.988523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:04.988523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:04.988523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:04.988523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:04.988523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:04.988523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:04.988523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:04.988523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:04.988523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:04.988523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:04.988523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:04.990804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 145/286] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:05.001162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4df4a-76e4-481f-8190-0ccd207b3641 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:05.018504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f92f46-6189-4d82-8123-928dd8f9d327 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:05.025009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:05.070993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:05.087382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659e226-1011-4805-aaf9-0f947878aa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:05.088277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659e226-1011-4805-aaf9-0f947878aa3b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:05.088737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659e226-1011-4805-aaf9-0f947878aa3b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:05.089017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659e226-1011-4805-aaf9-0f947878aa3b None admin] PATH_INFO: `/v3/users/59c0507b3d8f424f926f53861e97825e` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:05.092742 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659e226-1011-4805-aaf9-0f947878aa3b None admin] RBAC: Authorizing `identity:get_user(user_id=59c0507b3d8f424f926f53861e97825e)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:05.094229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659e226-1011-4805-aaf9-0f947878aa3b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:05.106021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 142/287] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:10:04 2022] GET /identity/v3/users/59c0507b3d8f424f926f53861e97825e => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:05.115281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659e226-1011-4805-aaf9-0f947878aa3b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:05.217354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4df4a-76e4-481f-8190-0ccd207b3641 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:05.252273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b7d71-e085-492c-8449-731644a2f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:05.252949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b7d71-e085-492c-8449-731644a2f077 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:05.253259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b7d71-e085-492c-8449-731644a2f077 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:05.253539 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b7d71-e085-492c-8449-731644a2f077 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:05.254297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b7d71-e085-492c-8449-731644a2f077 None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:05.255166 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b7d71-e085-492c-8449-731644a2f077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:05.256567 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b7d71-e085-492c-8449-731644a2f077 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:05.259564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659e226-1011-4805-aaf9-0f947878aa3b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:05.265319 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 146/288] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:05.271331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b7d71-e085-492c-8449-731644a2f077 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:05.330350 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268c3d2-b8b0-487d-be28-936fda87b876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:05.331269 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268c3d2-b8b0-487d-be28-936fda87b876 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:05.331557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268c3d2-b8b0-487d-be28-936fda87b876 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:05.331834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268c3d2-b8b0-487d-be28-936fda87b876 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:05.333206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268c3d2-b8b0-487d-be28-936fda87b876 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:05.334653 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268c3d2-b8b0-487d-be28-936fda87b876 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:05.346176 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 143/289] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:05 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:05.350132 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268c3d2-b8b0-487d-be28-936fda87b876 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:05.403138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:05.463713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:05.466628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b7d71-e085-492c-8449-731644a2f077 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:05.528081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268c3d2-b8b0-487d-be28-936fda87b876 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:05.530618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c67a2-b5ab-40ba-8d05-b41a11cadf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:05.531492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c67a2-b5ab-40ba-8d05-b41a11cadf5e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:05.531772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c67a2-b5ab-40ba-8d05-b41a11cadf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:05.532044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c67a2-b5ab-40ba-8d05-b41a11cadf5e None admin] PATH_INFO: `/v3/users/4818491a51e848bf976e97b296d37b52` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:05.533929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c67a2-b5ab-40ba-8d05-b41a11cadf5e None admin] RBAC: Authorizing `identity:get_user(user_id=4818491a51e848bf976e97b296d37b52)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:05.535387 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c67a2-b5ab-40ba-8d05-b41a11cadf5e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:05.537272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 147/290] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:10:05 2022] GET /identity/v3/users/4818491a51e848bf976e97b296d37b52 => generated 297 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:05.542499 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c67a2-b5ab-40ba-8d05-b41a11cadf5e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:05.600115 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67dd7d-e030-4a04-9842-8f6175da0f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:05.601064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67dd7d-e030-4a04-9842-8f6175da0f44 None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:05.601369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67dd7d-e030-4a04-9842-8f6175da0f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:05.601646 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67dd7d-e030-4a04-9842-8f6175da0f44 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768/users/59c0507b3d8f424f926f53861e97825e/roles/3f956eee424f40eda9501bcc798b6b18` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:05.604920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67dd7d-e030-4a04-9842-8f6175da0f44 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140784043094850b716a45f8a921768, user_id=59c0507b3d8f424f926f53861e97825e, role_id=3f956eee424f40eda9501bcc798b6b18)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:05.606402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67dd7d-e030-4a04-9842-8f6175da0f44 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:05.667729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c67a2-b5ab-40ba-8d05-b41a11cadf5e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:05.705038 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44b7b5-6216-4ad3-8a06-1ddf07536146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:05.705727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44b7b5-6216-4ad3-8a06-1ddf07536146 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:05.706063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44b7b5-6216-4ad3-8a06-1ddf07536146 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:05.706391 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44b7b5-6216-4ad3-8a06-1ddf07536146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:05.710307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:05.725284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 144/291] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:10:05 2022] PUT /identity/v3/projects/9140784043094850b716a45f8a921768/users/59c0507b3d8f424f926f53861e97825e/roles/3f956eee424f40eda9501bcc798b6b18 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:10:05.791685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44b7b5-6216-4ad3-8a06-1ddf07536146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:05.793185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44b7b5-6216-4ad3-8a06-1ddf07536146 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:05.923157 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 148/292] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:05.929359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67dd7d-e030-4a04-9842-8f6175da0f44 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:06.044007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67dd7d-e030-4a04-9842-8f6175da0f44 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:06.071761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:06.082649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0699d8-c29d-4ea0-96ce-b2589d8f0329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:06.083534 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0699d8-c29d-4ea0-96ce-b2589d8f0329 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:06.083831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0699d8-c29d-4ea0-96ce-b2589d8f0329 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:06.084105 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0699d8-c29d-4ea0-96ce-b2589d8f0329 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:06.085345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0699d8-c29d-4ea0-96ce-b2589d8f0329 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:06.086807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0699d8-c29d-4ea0-96ce-b2589d8f0329 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:06.088850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 145/293] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:05 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:06.094498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44b7b5-6216-4ad3-8a06-1ddf07536146 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:06.131344 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:06.214623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44b7b5-6216-4ad3-8a06-1ddf07536146 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:06.262094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fd354-98f9-4dc2-9e32-6d32bf1631a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:06.262764 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fd354-98f9-4dc2-9e32-6d32bf1631a7 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:06.263123 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fd354-98f9-4dc2-9e32-6d32bf1631a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:06.263408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fd354-98f9-4dc2-9e32-6d32bf1631a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:06.264248 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fd354-98f9-4dc2-9e32-6d32bf1631a7 None admin] RBAC: Adding query filter params (role.id=1b578241384b4a3698242fde91cc1769, scope.project.id=9140784043094850b716a45f8a921768, user.id=4818491a51e848bf976e97b296d37b52) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:06.264559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fd354-98f9-4dc2-9e32-6d32bf1631a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:06.266021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fd354-98f9-4dc2-9e32-6d32bf1631a7 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:06.272719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 149/294] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:06 2022] GET /identity/v3/role_assignments?user.id=4818491a51e848bf976e97b296d37b52&scope.project.id=9140784043094850b716a45f8a921768&role.id=1b578241384b4a3698242fde91cc1769 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:06.855364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8515765-5fd7-4dce-88c1-36f59b49f6b4 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:06.855869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8515765-5fd7-4dce-88c1-36f59b49f6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:06.855947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8515765-5fd7-4dce-88c1-36f59b49f6b4 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:06.857676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 146/295] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:06.863223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88345ddb-91e5-470d-ab85-ade2c55db9f4 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:06.864223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88345ddb-91e5-470d-ab85-ade2c55db9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:06.864310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88345ddb-91e5-470d-ab85-ade2c55db9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:06.884938 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-88345ddb-91e5-470d-ab85-ade2c55db9f4 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:06.886238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-88345ddb-91e5-470d-ab85-ade2c55db9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:06.895311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fe254-2655-4765-94e4-91f9cf3f3ebf None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:06.895897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fe254-2655-4765-94e4-91f9cf3f3ebf None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:06.902073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fe254-2655-4765-94e4-91f9cf3f3ebf None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:06.902073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 147/296] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:06.903521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06134e-8b8f-4516-831b-a7eff2293893 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:06.904020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06134e-8b8f-4516-831b-a7eff2293893 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:06.904503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06134e-8b8f-4516-831b-a7eff2293893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:06.921849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-8a06134e-8b8f-4516-831b-a7eff2293893 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:06.923194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8a06134e-8b8f-4516-831b-a7eff2293893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:06.964028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 150/297] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:06.986695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88345ddb-91e5-470d-ab85-ade2c55db9f4 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:06.993846 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 148/298] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:10:07.016821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06134e-8b8f-4516-831b-a7eff2293893 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:07.017503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:07.108675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88345ddb-91e5-470d-ab85-ade2c55db9f4 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:07.128675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06134e-8b8f-4516-831b-a7eff2293893 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:07.152392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:07.158265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c84d5b-2ee5-4618-9347-cc7346b6f830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:07.159257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c84d5b-2ee5-4618-9347-cc7346b6f830 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:07.159544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c84d5b-2ee5-4618-9347-cc7346b6f830 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:07.167231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c84d5b-2ee5-4618-9347-cc7346b6f830 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:07.167342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fc78b-6d7e-4143-b3db-d11f90a8f3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:07.167342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fc78b-6d7e-4143-b3db-d11f90a8f3cf None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:07.167792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fc78b-6d7e-4143-b3db-d11f90a8f3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:07.168242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fc78b-6d7e-4143-b3db-d11f90a8f3cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:07.173023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c84d5b-2ee5-4618-9347-cc7346b6f830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:07.179596 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fc78b-6d7e-4143-b3db-d11f90a8f3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-b5c84d5b-2ee5-4618-9347-cc7346b6f830 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:07.182670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:07.183533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:07.184317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:07.184317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:07.184317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:07.184317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:07.184317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:07.184317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:07.184317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:07.184317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:07.184317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:07.184317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:07.184317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:10:07.184317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:07.184317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 151/299] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-8a1fc78b-6d7e-4143-b3db-d11f90a8f3cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:07.190876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:07.191729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:07.193430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:07.193430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:07.193430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:07.193430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:07.193430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:07.193430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:07.193430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:07.193430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:07.193430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:07.193430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:07.193430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:07.193430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:07.194535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c84d5b-2ee5-4618-9347-cc7346b6f830 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:07.197187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 149/300] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:07.199552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fc78b-6d7e-4143-b3db-d11f90a8f3cf None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:07.311109 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:07.312427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fc78b-6d7e-4143-b3db-d11f90a8f3cf None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:07.321375 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c84d5b-2ee5-4618-9347-cc7346b6f830 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:07.349486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f839522-b204-402f-9403-de279c1d0a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:07.350163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f839522-b204-402f-9403-de279c1d0a9e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:07.350452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f839522-b204-402f-9403-de279c1d0a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:07.350732 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f839522-b204-402f-9403-de279c1d0a9e None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:07.351487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f839522-b204-402f-9403-de279c1d0a9e None admin] RBAC: Adding query filter params (name=member) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:07.351795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f839522-b204-402f-9403-de279c1d0a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:07.353207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f839522-b204-402f-9403-de279c1d0a9e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:07.359164 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5840-5e92-4a4f-a6cf-cf7ccee902e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:07.360040 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5840-5e92-4a4f-a6cf-cf7ccee902e9 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:07.360493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5840-5e92-4a4f-a6cf-cf7ccee902e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:07.360946 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5840-5e92-4a4f-a6cf-cf7ccee902e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:07.361306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 150/301] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:07.362070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5840-5e92-4a4f-a6cf-cf7ccee902e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:07.362638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5840-5e92-4a4f-a6cf-cf7ccee902e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:07.364216 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5840-5e92-4a4f-a6cf-cf7ccee902e9 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:07.366136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb91fc-4f21-4ce8-8c6f-eede337426cb None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:07.366439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb91fc-4f21-4ce8-8c6f-eede337426cb None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:07.366721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb91fc-4f21-4ce8-8c6f-eede337426cb None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:07.368143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 151/302] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:07.369147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb91fc-4f21-4ce8-8c6f-eede337426cb None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:07.375819 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 152/303] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:07.378890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbadfd-1d9a-41dc-ab15-505091102993 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:07.379939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbadfd-1d9a-41dc-ab15-505091102993 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:07.380945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbadfd-1d9a-41dc-ab15-505091102993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:07.398672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-4dbbadfd-1d9a-41dc-ab15-505091102993 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:07.399843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4dbbadfd-1d9a-41dc-ab15-505091102993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:07.419053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:07.475874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 153/304] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:07.485410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbadfd-1d9a-41dc-ab15-505091102993 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:07.486796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb91fc-4f21-4ce8-8c6f-eede337426cb None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:07.522949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca66faf-440c-4ece-913e-ef6e8e5520e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:07.523832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca66faf-440c-4ece-913e-ef6e8e5520e5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:07.524115 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca66faf-440c-4ece-913e-ef6e8e5520e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:07.524388 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca66faf-440c-4ece-913e-ef6e8e5520e5 None admin] PATH_INFO: `/v3/users/200a97a2ce0b4ac0bed8915e1bd9b13e` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:07.525802 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca66faf-440c-4ece-913e-ef6e8e5520e5 None admin] RBAC: Authorizing `identity:get_user(user_id=200a97a2ce0b4ac0bed8915e1bd9b13e)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:07.527355 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca66faf-440c-4ece-913e-ef6e8e5520e5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:07.529148 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 152/305] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:10:07 2022] GET /identity/v3/users/200a97a2ce0b4ac0bed8915e1bd9b13e => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:07.534109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca66faf-440c-4ece-913e-ef6e8e5520e5 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:07.570681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:07.588213 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbadfd-1d9a-41dc-ab15-505091102993 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:07.622904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810a34b-47d5-40e9-9f95-a5d238c8071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:07.623702 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a34b-47d5-40e9-9f95-a5d238c8071f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:07.623990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a34b-47d5-40e9-9f95-a5d238c8071f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:07.624264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a34b-47d5-40e9-9f95-a5d238c8071f None admin] PATH_INFO: `/v3/users/c8653ab3e5b248ff9060337f558c6fff` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:07.638259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810a34b-47d5-40e9-9f95-a5d238c8071f None admin] RBAC: Authorizing `identity:get_user(user_id=c8653ab3e5b248ff9060337f558c6fff)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:07.639727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810a34b-47d5-40e9-9f95-a5d238c8071f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:07.640786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca66faf-440c-4ece-913e-ef6e8e5520e5 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:07.641610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 154/306] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:10:07 2022] GET /identity/v3/users/c8653ab3e5b248ff9060337f558c6fff => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:07.642272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810a34b-47d5-40e9-9f95-a5d238c8071f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:07.658976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:07.680409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9657e-ae24-4fbb-b3f6-03cc5618cfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:07.681241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9657e-ae24-4fbb-b3f6-03cc5618cfe5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:07.681528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9657e-ae24-4fbb-b3f6-03cc5618cfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:07.681808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9657e-ae24-4fbb-b3f6-03cc5618cfe5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:07.682970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9657e-ae24-4fbb-b3f6-03cc5618cfe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:07.684413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9657e-ae24-4fbb-b3f6-03cc5618cfe5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:07.686081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 153/307] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:07.686866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9657e-ae24-4fbb-b3f6-03cc5618cfe5 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:07.753402 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810a34b-47d5-40e9-9f95-a5d238c8071f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:07.788947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e235c-52ea-4338-98ab-3e3ece62db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:07.790016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9657e-ae24-4fbb-b3f6-03cc5618cfe5 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:07.790225 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e235c-52ea-4338-98ab-3e3ece62db0e None admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:07.790647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e235c-52ea-4338-98ab-3e3ece62db0e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:07.791098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e235c-52ea-4338-98ab-3e3ece62db0e None admin] PATH_INFO: `/v3/system/users/200a97a2ce0b4ac0bed8915e1bd9b13e/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:07.792915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e235c-52ea-4338-98ab-3e3ece62db0e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=200a97a2ce0b4ac0bed8915e1bd9b13e, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:07.794484 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e235c-52ea-4338-98ab-3e3ece62db0e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:07.824014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b725d42-d4a5-47d4-b641-ad37d066688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:07.824676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b725d42-d4a5-47d4-b641-ad37d066688b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:07.824965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b725d42-d4a5-47d4-b641-ad37d066688b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:07.825281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b725d42-d4a5-47d4-b641-ad37d066688b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:07.826124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b725d42-d4a5-47d4-b641-ad37d066688b None admin] RBAC: Adding query filter params (role.id=3f956eee424f40eda9501bcc798b6b18, user.id=c8653ab3e5b248ff9060337f558c6fff, scope.system=all) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:07.826437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b725d42-d4a5-47d4-b641-ad37d066688b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:07.827881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b725d42-d4a5-47d4-b641-ad37d066688b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:07.832841 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 154/308] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Jul 12 16:10:07 2022] GET /identity/v3/role_assignments?user.id=c8653ab3e5b248ff9060337f558c6fff&scope.system=all&role.id=3f956eee424f40eda9501bcc798b6b18 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:07.833637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b725d42-d4a5-47d4-b641-ad37d066688b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:07.886382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 155/309] 10.222.0.26 () {58 vars in 1334 bytes} [Tue Jul 12 16:10:07 2022] PUT /identity/v3/system/users/200a97a2ce0b4ac0bed8915e1bd9b13e/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:10:07.895400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:07.972066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b725d42-d4a5-47d4-b641-ad37d066688b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:08.057601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84820c7b-2ba3-4862-932d-197065cc075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:08.058291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820c7b-2ba3-4862-932d-197065cc075f None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:08.058578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820c7b-2ba3-4862-932d-197065cc075f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:08.058858 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820c7b-2ba3-4862-932d-197065cc075f None admin] PATH_INFO: `/v3/groups` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:08.059568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84820c7b-2ba3-4862-932d-197065cc075f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:08.061026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84820c7b-2ba3-4862-932d-197065cc075f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:08.128260 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 155/310] 10.222.0.26 () {60 vars in 1134 bytes} [Tue Jul 12 16:10:07 2022] POST /identity/v3/groups => generated 229 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:10:08.211219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e093ee-01ad-4247-8e87-6b3f8f7aa594 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:08.211219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e093ee-01ad-4247-8e87-6b3f8f7aa594 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:08.211219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e093ee-01ad-4247-8e87-6b3f8f7aa594 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:08.211528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 156/311] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:08.217254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1f019-cb1b-4dd6-a618-57501e33db08 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:08.217574 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1f019-cb1b-4dd6-a618-57501e33db08 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:08.217828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1f019-cb1b-4dd6-a618-57501e33db08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:08.235793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-b9a1f019-cb1b-4dd6-a618-57501e33db08 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:08.237080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b9a1f019-cb1b-4dd6-a618-57501e33db08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:08.310684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 156/312] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:08.335079 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e093ee-01ad-4247-8e87-6b3f8f7aa594 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:08.339818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:08.451707 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e093ee-01ad-4247-8e87-6b3f8f7aa594 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:08.487220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a17a7-994b-4b64-90e8-649a856e8ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:08.487949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a17a7-994b-4b64-90e8-649a856e8ddd None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:08.488234 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a17a7-994b-4b64-90e8-649a856e8ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:08.488514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a17a7-994b-4b64-90e8-649a856e8ddd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:08.500075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a17a7-994b-4b64-90e8-649a856e8ddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-bc5a17a7-994b-4b64-90e8-649a856e8ddd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:08.508829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:08.510012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:08.510900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:08.510900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:08.510900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:08.510900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:08.510900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:08.510900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:08.510900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:08.510900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:08.510900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:08.510900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:08.510900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:10:08.510900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:08.510900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 157/313] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:08.516476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1f019-cb1b-4dd6-a618-57501e33db08 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:08.549946 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:08.620575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1f019-cb1b-4dd6-a618-57501e33db08 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:08.654612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd1a20-cb4a-487d-bb92-e0f811bdc4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:08.655288 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd1a20-cb4a-487d-bb92-e0f811bdc4dd None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:08.655570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd1a20-cb4a-487d-bb92-e0f811bdc4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:08.655846 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd1a20-cb4a-487d-bb92-e0f811bdc4dd None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:08.656599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd1a20-cb4a-487d-bb92-e0f811bdc4dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:08.656904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd1a20-cb4a-487d-bb92-e0f811bdc4dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:08.658379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd1a20-cb4a-487d-bb92-e0f811bdc4dd None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:08.668038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 157/314] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:08.673519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a17a7-994b-4b64-90e8-649a856e8ddd None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:08.742369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:08.776607 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a17a7-994b-4b64-90e8-649a856e8ddd None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:08.811860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356dadf-96fe-4972-a35e-18fcf53ba431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:08.812741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356dadf-96fe-4972-a35e-18fcf53ba431 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:08.813031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356dadf-96fe-4972-a35e-18fcf53ba431 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:08.813339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356dadf-96fe-4972-a35e-18fcf53ba431 None admin] PATH_INFO: `/v3/users/59c0507b3d8f424f926f53861e97825e` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:08.814542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356dadf-96fe-4972-a35e-18fcf53ba431 None admin] RBAC: Authorizing `identity:get_user(user_id=59c0507b3d8f424f926f53861e97825e)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:08.816351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356dadf-96fe-4972-a35e-18fcf53ba431 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:08.818370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 158/315] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:10:08 2022] GET /identity/v3/users/59c0507b3d8f424f926f53861e97825e => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:08.823799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd1a20-cb4a-487d-bb92-e0f811bdc4dd None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:08.921518 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:08.928190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd1a20-cb4a-487d-bb92-e0f811bdc4dd None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:08.962899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8802f0d-d180-4fc0-9668-80d8bc22978f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:08.963559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8802f0d-d180-4fc0-9668-80d8bc22978f None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:08.963848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8802f0d-d180-4fc0-9668-80d8bc22978f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:08.964126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8802f0d-d180-4fc0-9668-80d8bc22978f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:09.033467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8802f0d-d180-4fc0-9668-80d8bc22978f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:09.034897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8802f0d-d180-4fc0-9668-80d8bc22978f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:09.139543 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:09.139860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 158/316] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:09.146094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356dadf-96fe-4972-a35e-18fcf53ba431 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:09.249350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356dadf-96fe-4972-a35e-18fcf53ba431 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:09.279862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:09.286377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92828aee-bb63-4556-b0af-3e19a454d130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:09.287184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92828aee-bb63-4556-b0af-3e19a454d130 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:09.287731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92828aee-bb63-4556-b0af-3e19a454d130 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:09.288013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92828aee-bb63-4556-b0af-3e19a454d130 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:09.289261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92828aee-bb63-4556-b0af-3e19a454d130 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:09.290706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92828aee-bb63-4556-b0af-3e19a454d130 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:09.292707 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 159/317] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:09 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:09.298495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8802f0d-d180-4fc0-9668-80d8bc22978f None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:09.406810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8802f0d-d180-4fc0-9668-80d8bc22978f None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:09.440756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce143d-c083-4ef2-8469-484756990c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:09.441450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce143d-c083-4ef2-8469-484756990c88 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:09.442257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce143d-c083-4ef2-8469-484756990c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:09.442538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce143d-c083-4ef2-8469-484756990c88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:09.443369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce143d-c083-4ef2-8469-484756990c88 None admin] RBAC: Adding query filter params (role.id=3f956eee424f40eda9501bcc798b6b18, scope.project.id=9140784043094850b716a45f8a921768, user.id=59c0507b3d8f424f926f53861e97825e) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:09.443675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce143d-c083-4ef2-8469-484756990c88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:09.445102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce143d-c083-4ef2-8469-484756990c88 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:09.453066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 159/318] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:09 2022] GET /identity/v3/role_assignments?user.id=59c0507b3d8f424f926f53861e97825e&scope.project.id=9140784043094850b716a45f8a921768&role.id=3f956eee424f40eda9501bcc798b6b18 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:09.997648 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67d03b-d883-4d6b-a946-8d18f13f25bf None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:09.998032 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67d03b-d883-4d6b-a946-8d18f13f25bf None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:09.998233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67d03b-d883-4d6b-a946-8d18f13f25bf None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:09.999720 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 160/319] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:10.004902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e9003-091f-4459-b0e3-703794466253 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.005393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e9003-091f-4459-b0e3-703794466253 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.005477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e9003-091f-4459-b0e3-703794466253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.022554 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-332e9003-091f-4459-b0e3-703794466253 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:10.023732 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-332e9003-091f-4459-b0e3-703794466253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:10.053165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e016404-0232-4ee4-8898-b04895dc28e9 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.053699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e016404-0232-4ee4-8898-b04895dc28e9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.053981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e016404-0232-4ee4-8898-b04895dc28e9 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.055330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 161/320] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:10:10.060312 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e17cd1-9ea9-4755-aa33-1a1d38e7236b None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.060598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e17cd1-9ea9-4755-aa33-1a1d38e7236b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.060871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e17cd1-9ea9-4755-aa33-1a1d38e7236b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.077577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-d6e17cd1-9ea9-4755-aa33-1a1d38e7236b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:10.078749 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d6e17cd1-9ea9-4755-aa33-1a1d38e7236b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:10.087338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:10.099863 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 160/321] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:10.122448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e9003-091f-4459-b0e3-703794466253 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:10.153273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 162/322] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:10:10.173502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e17cd1-9ea9-4755-aa33-1a1d38e7236b None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:10.232176 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e9003-091f-4459-b0e3-703794466253 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:10.267434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4501051-e744-4b44-8e55-c799d10db0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:10.268149 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4501051-e744-4b44-8e55-c799d10db0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.268429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4501051-e744-4b44-8e55-c799d10db0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.268701 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4501051-e744-4b44-8e55-c799d10db0b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.269832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e17cd1-9ea9-4755-aa33-1a1d38e7236b None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:10.278681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4501051-e744-4b44-8e55-c799d10db0b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-b4501051-e744-4b44-8e55-c799d10db0b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:10.286903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:10.287822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:10.288619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:10.288619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:10.288619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:10.288619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:10.288619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:10.288619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:10.288619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:10.288619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:10.288619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:10.288619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:10.288619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:10:10.288619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:10.288619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 161/323] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:10.289319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f91d5-e6bb-473d-bf3e-ba3a6ed37bba None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.289844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f91d5-e6bb-473d-bf3e-ba3a6ed37bba None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.289844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f91d5-e6bb-473d-bf3e-ba3a6ed37bba None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.291114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 162/324] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:10.293840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f91d5-e6bb-473d-bf3e-ba3a6ed37bba None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:10.302358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:10.307713 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671b692-0f81-4f29-af6d-59ccddcbe7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:10.312212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671b692-0f81-4f29-af6d-59ccddcbe7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.312212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671b692-0f81-4f29-af6d-59ccddcbe7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.312212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671b692-0f81-4f29-af6d-59ccddcbe7f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.319112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671b692-0f81-4f29-af6d-59ccddcbe7f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-4671b692-0f81-4f29-af6d-59ccddcbe7f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:10.326767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:10.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:10.328480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:10.328480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:10.328480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:10.328480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:10.328480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:10.328480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:10.328480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:10.328480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:10.328480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:10.328480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:10.328480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:10.328480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:10.332846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 163/325] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:10.334055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864244-e4dd-452d-ad50-163b46dc2f3f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.334343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864244-e4dd-452d-ad50-163b46dc2f3f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.334620 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864244-e4dd-452d-ad50-163b46dc2f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.345897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:10.350772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ea864244-e4dd-452d-ad50-163b46dc2f3f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:10.351928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ea864244-e4dd-452d-ad50-163b46dc2f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:10.395983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f91d5-e6bb-473d-bf3e-ba3a6ed37bba None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:10.416729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 164/326] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:10.417746 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864244-e4dd-452d-ad50-163b46dc2f3f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:10.435680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc247f26-2973-4b90-944f-f4da49cca8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:10.436831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc247f26-2973-4b90-944f-f4da49cca8ed None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.437321 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc247f26-2973-4b90-944f-f4da49cca8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.437759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc247f26-2973-4b90-944f-f4da49cca8ed None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.438660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc247f26-2973-4b90-944f-f4da49cca8ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:10.439512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc247f26-2973-4b90-944f-f4da49cca8ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:10.441178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc247f26-2973-4b90-944f-f4da49cca8ed None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:10.449901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 163/327] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:10.450931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc247f26-2973-4b90-944f-f4da49cca8ed None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:10.518531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864244-e4dd-452d-ad50-163b46dc2f3f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:10.540618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:10.553486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc247f26-2973-4b90-944f-f4da49cca8ed None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:10.555117 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91302f86-aa66-42a9-8bae-7640c78d35cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:10.555117 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91302f86-aa66-42a9-8bae-7640c78d35cc None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.555117 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91302f86-aa66-42a9-8bae-7640c78d35cc None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.555117 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91302f86-aa66-42a9-8bae-7640c78d35cc None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.555706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91302f86-aa66-42a9-8bae-7640c78d35cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:10.556014 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91302f86-aa66-42a9-8bae-7640c78d35cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:10.557653 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91302f86-aa66-42a9-8bae-7640c78d35cc None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:10.565848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 165/328] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:10.566629 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91302f86-aa66-42a9-8bae-7640c78d35cc None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:10.567294 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:10.588139 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613873a-75da-4416-b86f-1c2b4c0360e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:10.588898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613873a-75da-4416-b86f-1c2b4c0360e3 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.589207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613873a-75da-4416-b86f-1c2b4c0360e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.589487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613873a-75da-4416-b86f-1c2b4c0360e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.590641 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613873a-75da-4416-b86f-1c2b4c0360e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:10.592066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613873a-75da-4416-b86f-1c2b4c0360e3 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:10.593710 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 164/329] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:10.593710 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613873a-75da-4416-b86f-1c2b4c0360e3 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:10.672319 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91302f86-aa66-42a9-8bae-7640c78d35cc None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:10.691191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613873a-75da-4416-b86f-1c2b4c0360e3 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:10.705053 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfe3c8-cc76-428c-b61b-ce59cecf484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:10.706154 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfe3c8-cc76-428c-b61b-ce59cecf484b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.706441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfe3c8-cc76-428c-b61b-ce59cecf484b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.706719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfe3c8-cc76-428c-b61b-ce59cecf484b None admin] PATH_INFO: `/v3/users/c8653ab3e5b248ff9060337f558c6fff` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.708430 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfe3c8-cc76-428c-b61b-ce59cecf484b None admin] RBAC: Authorizing `identity:get_user(user_id=c8653ab3e5b248ff9060337f558c6fff)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:10.709902 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfe3c8-cc76-428c-b61b-ce59cecf484b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:10.715980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 166/330] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:10:10 2022] GET /identity/v3/users/c8653ab3e5b248ff9060337f558c6fff => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:10.715980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfe3c8-cc76-428c-b61b-ce59cecf484b None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:10.724572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328438e-6e3f-46c7-bb5e-3a627acc3b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:10.725486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328438e-6e3f-46c7-bb5e-3a627acc3b75 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.725771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328438e-6e3f-46c7-bb5e-3a627acc3b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.726048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328438e-6e3f-46c7-bb5e-3a627acc3b75 None admin] PATH_INFO: `/v3/users/200a97a2ce0b4ac0bed8915e1bd9b13e` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.727231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328438e-6e3f-46c7-bb5e-3a627acc3b75 None admin] RBAC: Authorizing `identity:get_user(user_id=200a97a2ce0b4ac0bed8915e1bd9b13e)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:10.728665 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328438e-6e3f-46c7-bb5e-3a627acc3b75 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:10.730317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 165/331] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:10:10 2022] GET /identity/v3/users/200a97a2ce0b4ac0bed8915e1bd9b13e => generated 293 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:10.731049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328438e-6e3f-46c7-bb5e-3a627acc3b75 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:10.762760 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:10.780076 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:10.814628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfe3c8-cc76-428c-b61b-ce59cecf484b None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:10.832349 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328438e-6e3f-46c7-bb5e-3a627acc3b75 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:10.848226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382ed3a-6176-4688-8d03-47498ec94f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:10.848884 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ed3a-6176-4688-8d03-47498ec94f7d None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.849192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ed3a-6176-4688-8d03-47498ec94f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.849474 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ed3a-6176-4688-8d03-47498ec94f7d None admin] PATH_INFO: `/v3/groups` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.850162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382ed3a-6176-4688-8d03-47498ec94f7d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:10.851590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382ed3a-6176-4688-8d03-47498ec94f7d None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:10.865387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5a98a-880f-46f3-b543-370464e50dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:10.866276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5a98a-880f-46f3-b543-370464e50dee None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:10.866563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5a98a-880f-46f3-b543-370464e50dee None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:10.866888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5a98a-880f-46f3-b543-370464e50dee None admin] PATH_INFO: `/v3/system/users/c8653ab3e5b248ff9060337f558c6fff/roles/3f956eee424f40eda9501bcc798b6b18` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:10.868367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5a98a-880f-46f3-b543-370464e50dee None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c8653ab3e5b248ff9060337f558c6fff, role_id=3f956eee424f40eda9501bcc798b6b18)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:10.869752 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5a98a-880f-46f3-b543-370464e50dee None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:10.994910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 167/332] 10.222.0.26 () {60 vars in 1134 bytes} [Tue Jul 12 16:10:10 2022] POST /identity/v3/groups => generated 226 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:10:10.995733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382ed3a-6176-4688-8d03-47498ec94f7d None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:11.019024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 166/333] 10.222.0.26 () {58 vars in 1334 bytes} [Tue Jul 12 16:10:10 2022] PUT /identity/v3/system/users/c8653ab3e5b248ff9060337f558c6fff/roles/3f956eee424f40eda9501bcc798b6b18 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:10:11.116183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382ed3a-6176-4688-8d03-47498ec94f7d None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:11.128410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:11.155982 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4315f-6d55-4228-b7c0-c0cc760433a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:11.156766 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4315f-6d55-4228-b7c0-c0cc760433a0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:11.157039 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4315f-6d55-4228-b7c0-c0cc760433a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:11.157352 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4315f-6d55-4228-b7c0-c0cc760433a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:11.158221 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4315f-6d55-4228-b7c0-c0cc760433a0 None admin] RBAC: Adding query filter params (role.id=1b578241384b4a3698242fde91cc1769, user.id=200a97a2ce0b4ac0bed8915e1bd9b13e, scope.system=all) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:11.158537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4315f-6d55-4228-b7c0-c0cc760433a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:11.160025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4315f-6d55-4228-b7c0-c0cc760433a0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:11.176307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 168/334] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Jul 12 16:10:10 2022] GET /identity/v3/role_assignments?user.id=200a97a2ce0b4ac0bed8915e1bd9b13e&scope.system=all&role.id=1b578241384b4a3698242fde91cc1769 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:13.208389 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5209f0-cf4e-441d-b60f-c5761258cf71 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:13.208936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5209f0-cf4e-441d-b60f-c5761258cf71 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:13.208936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5209f0-cf4e-441d-b60f-c5761258cf71 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:13.210490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 167/335] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:13.216168 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5479f-d888-4ac8-b0a2-3052a2ed92ce None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:13.216588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5479f-d888-4ac8-b0a2-3052a2ed92ce None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:13.216764 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5479f-d888-4ac8-b0a2-3052a2ed92ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:13.238295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-0ab5479f-d888-4ac8-b0a2-3052a2ed92ce None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:13.240104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0ab5479f-d888-4ac8-b0a2-3052a2ed92ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:13.315906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 169/336] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:13.340244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5209f0-cf4e-441d-b60f-c5761258cf71 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:13.409053 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66684201-46df-4303-afc8-86da8527ca52 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:13.409391 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66684201-46df-4303-afc8-86da8527ca52 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:13.409672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66684201-46df-4303-afc8-86da8527ca52 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:13.411685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 170/337] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:13.416803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10c063-50f7-4ed5-9d2b-079a96b5fc1d None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:13.417088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10c063-50f7-4ed5-9d2b-079a96b5fc1d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:13.417412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10c063-50f7-4ed5-9d2b-079a96b5fc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:13.446765 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-1a10c063-50f7-4ed5-9d2b-079a96b5fc1d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:13.448019 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1a10c063-50f7-4ed5-9d2b-079a96b5fc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:13.497241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5209f0-cf4e-441d-b60f-c5761258cf71 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:13.529465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:13.577719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b217cbf-e795-4d58-8658-7e1b1786ab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:13.578524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217cbf-e795-4d58-8658-7e1b1786ab43 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:13.578809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217cbf-e795-4d58-8658-7e1b1786ab43 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:13.578916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 171/338] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:10:13.579110 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217cbf-e795-4d58-8658-7e1b1786ab43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:13.606062 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b217cbf-e795-4d58-8658-7e1b1786ab43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-7b217cbf-e795-4d58-8658-7e1b1786ab43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:13.618396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:13.619297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:13.620129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:13.620129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:13.620129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:13.620129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:13.620129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:13.620129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:13.620129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:13.620129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:13.620129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:13.620129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:13.620129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 16:10:13.620129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:13.620129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 168/339] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:13.623991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10c063-50f7-4ed5-9d2b-079a96b5fc1d None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:13.629536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b217cbf-e795-4d58-8658-7e1b1786ab43 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:13.677960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:13.810321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10c063-50f7-4ed5-9d2b-079a96b5fc1d None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:13.825624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b217cbf-e795-4d58-8658-7e1b1786ab43 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:13.877860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997925aa-fc90-4639-9584-1fd9c3e46fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:13.878929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997925aa-fc90-4639-9584-1fd9c3e46fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:13.879419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997925aa-fc90-4639-9584-1fd9c3e46fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:13.879865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997925aa-fc90-4639-9584-1fd9c3e46fa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:13.880038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1d100-67df-4679-9304-7c2596921a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:13.880886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1d100-67df-4679-9304-7c2596921a4e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:13.881349 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1d100-67df-4679-9304-7c2596921a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:13.881788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1d100-67df-4679-9304-7c2596921a4e None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:13.882775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1d100-67df-4679-9304-7c2596921a4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:13.883279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1d100-67df-4679-9304-7c2596921a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:13.884801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1d100-67df-4679-9304-7c2596921a4e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:13.898497 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997925aa-fc90-4639-9584-1fd9c3e46fa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:13.899302 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 169/340] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:13.911456 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1d100-67df-4679-9304-7c2596921a4e None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-997925aa-fc90-4639-9584-1fd9c3e46fa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:13.911587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:13.912647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:13.913566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:13.913566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:13.913566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:13.913566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:13.913566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:13.913566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:13.913566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:13.913566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:13.913566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:13.913566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:13.913566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:13.913566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:13.913566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 172/341] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:13.916063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997925aa-fc90-4639-9584-1fd9c3e46fa4 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:13.990899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:14.115384 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:14.128722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1d100-67df-4679-9304-7c2596921a4e None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:14.146584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997925aa-fc90-4639-9584-1fd9c3e46fa4 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:14.208836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18090bb4-dd08-4700-b2d0-20dcda856099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:14.209752 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18090bb4-dd08-4700-b2d0-20dcda856099 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:14.210037 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18090bb4-dd08-4700-b2d0-20dcda856099 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:14.210316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18090bb4-dd08-4700-b2d0-20dcda856099 None admin] PATH_INFO: `/v3/users/c8653ab3e5b248ff9060337f558c6fff` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:14.213791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18090bb4-dd08-4700-b2d0-20dcda856099 None admin] RBAC: Authorizing `identity:get_user(user_id=c8653ab3e5b248ff9060337f558c6fff)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:14.215761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18090bb4-dd08-4700-b2d0-20dcda856099 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:14.219051 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 170/342] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:10:13 2022] GET /identity/v3/users/c8653ab3e5b248ff9060337f558c6fff => generated 293 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:14.222541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7c7b6-b8a4-4c99-8337-2a9df1e881c4 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:14.222541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7c7b6-b8a4-4c99-8337-2a9df1e881c4 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:14.222541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7c7b6-b8a4-4c99-8337-2a9df1e881c4 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:14.222541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 171/343] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:14.223198 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc4580-2505-4d50-ac28-a0da319f59f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:14.223843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc4580-2505-4d50-ac28-a0da319f59f0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:14.224130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc4580-2505-4d50-ac28-a0da319f59f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:14.224409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc4580-2505-4d50-ac28-a0da319f59f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:14.225201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc4580-2505-4d50-ac28-a0da319f59f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:14.225517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc4580-2505-4d50-ac28-a0da319f59f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:14.226925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc4580-2505-4d50-ac28-a0da319f59f0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:14.233313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7c7b6-b8a4-4c99-8337-2a9df1e881c4 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:14.250998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 173/344] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:14.255102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89f352-396d-4890-86f6-da2934753387 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:14.255394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89f352-396d-4890-86f6-da2934753387 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:14.255672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89f352-396d-4890-86f6-da2934753387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:14.275658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-fa89f352-396d-4890-86f6-da2934753387 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:14.277222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-fa89f352-396d-4890-86f6-da2934753387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:14.388737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7c7b6-b8a4-4c99-8337-2a9df1e881c4 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:14.409211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 174/345] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:14.410485 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89f352-396d-4890-86f6-da2934753387 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:14.437454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:14.442026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba59bc-e954-447c-991a-d7fb3196513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:14.442702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba59bc-e954-447c-991a-d7fb3196513f None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:14.442987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba59bc-e954-447c-991a-d7fb3196513f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:14.444034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba59bc-e954-447c-991a-d7fb3196513f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:14.445612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba59bc-e954-447c-991a-d7fb3196513f None admin] RBAC: Adding query filter params (role.id=3f956eee424f40eda9501bcc798b6b18, user.id=c8653ab3e5b248ff9060337f558c6fff, scope.system=all) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:14.445941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba59bc-e954-447c-991a-d7fb3196513f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:14.447400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba59bc-e954-447c-991a-d7fb3196513f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:14.467723 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 172/346] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Jul 12 16:10:14 2022] GET /identity/v3/role_assignments?user.id=c8653ab3e5b248ff9060337f558c6fff&scope.system=all&role.id=3f956eee424f40eda9501bcc798b6b18 => generated 510 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:14.472315 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93273fe8-744c-4ddb-bf29-21ce80a711a7 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:14.472608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93273fe8-744c-4ddb-bf29-21ce80a711a7 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:14.473004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93273fe8-744c-4ddb-bf29-21ce80a711a7 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:14.475158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 173/347] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:14.475899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93273fe8-744c-4ddb-bf29-21ce80a711a7 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:14.528937 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:14.551777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89f352-396d-4890-86f6-da2934753387 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:14.595773 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65744c3e-84e4-4764-a436-2b0eb56588a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:14.596451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744c3e-84e4-4764-a436-2b0eb56588a3 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:14.596736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744c3e-84e4-4764-a436-2b0eb56588a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:14.597017 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744c3e-84e4-4764-a436-2b0eb56588a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:14.686165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65744c3e-84e4-4764-a436-2b0eb56588a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:14.688021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65744c3e-84e4-4764-a436-2b0eb56588a3 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:14.750017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93273fe8-744c-4ddb-bf29-21ce80a711a7 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:14.791136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7040604-21ac-4763-8910-4dac4d14e212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:14.791931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040604-21ac-4763-8910-4dac4d14e212 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:14.792218 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040604-21ac-4763-8910-4dac4d14e212 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:14.792489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040604-21ac-4763-8910-4dac4d14e212 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:14.793985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:14.806657 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7040604-21ac-4763-8910-4dac4d14e212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-d7040604-21ac-4763-8910-4dac4d14e212 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:14.816092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:14.817580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:14.818409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:14.818409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:14.818409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:14.818409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:14.818409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:14.818409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:14.818409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:14.818409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:14.818409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:14.818409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:14.818409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:14.818409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:14.818409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 174/348] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:10:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:14.819128 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b95bf-40e3-4652-85bd-a02749db6c35 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:14.819883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b95bf-40e3-4652-85bd-a02749db6c35 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:14.820267 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b95bf-40e3-4652-85bd-a02749db6c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:14.821044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 175/349] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:14.828945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65744c3e-84e4-4764-a436-2b0eb56588a3 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:14.851055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-bb8b95bf-40e3-4652-85bd-a02749db6c35 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:14.851055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-bb8b95bf-40e3-4652-85bd-a02749db6c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:14.870177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:14.937052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 175/350] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:14.938386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b95bf-40e3-4652-85bd-a02749db6c35 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:14.968900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65744c3e-84e4-4764-a436-2b0eb56588a3 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:15.018424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b196921-e14e-442c-a8cd-305df2fcd612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:15.019112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b196921-e14e-442c-a8cd-305df2fcd612 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:15.019393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b196921-e14e-442c-a8cd-305df2fcd612 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:15.019666 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b196921-e14e-442c-a8cd-305df2fcd612 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:15.020584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b196921-e14e-442c-a8cd-305df2fcd612 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:15.021050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b196921-e14e-442c-a8cd-305df2fcd612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:15.022748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b196921-e14e-442c-a8cd-305df2fcd612 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:15.038368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 176/351] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:15.039638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b196921-e14e-442c-a8cd-305df2fcd612 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:15.076668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b95bf-40e3-4652-85bd-a02749db6c35 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:15.091384 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:15.117338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea30a8-00fa-4e27-a333-04145c422167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:15.118507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea30a8-00fa-4e27-a333-04145c422167 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:15.118507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea30a8-00fa-4e27-a333-04145c422167 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:15.118762 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea30a8-00fa-4e27-a333-04145c422167 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:15.120066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea30a8-00fa-4e27-a333-04145c422167 None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:15.121560 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea30a8-00fa-4e27-a333-04145c422167 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:15.123483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 176/352] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:14 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:15.124181 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea30a8-00fa-4e27-a333-04145c422167 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:15.145288 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:15.157399 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b196921-e14e-442c-a8cd-305df2fcd612 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:15.195004 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172e535-8f98-41fa-b04e-2abfe7afc9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:15.196148 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172e535-8f98-41fa-b04e-2abfe7afc9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:15.196681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172e535-8f98-41fa-b04e-2abfe7afc9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:15.197190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172e535-8f98-41fa-b04e-2abfe7afc9d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:15.209050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172e535-8f98-41fa-b04e-2abfe7afc9d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-8172e535-8f98-41fa-b04e-2abfe7afc9d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:15.218636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:15.219544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:15.220348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:15.220348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:15.220348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:15.220348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:15.220348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:15.220348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:15.220348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:15.220348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:15.220348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:15.220348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:15.220348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:15.220348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:15.222460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 177/353] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:15.226454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172e535-8f98-41fa-b04e-2abfe7afc9d0 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:15.233516 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea30a8-00fa-4e27-a333-04145c422167 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:15.283499 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195949a-5227-45d8-b9f4-46167b0930d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:15.284157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195949a-5227-45d8-b9f4-46167b0930d5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:15.285014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195949a-5227-45d8-b9f4-46167b0930d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:15.285014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195949a-5227-45d8-b9f4-46167b0930d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:15.353026 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172e535-8f98-41fa-b04e-2abfe7afc9d0 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:15.354617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:15.369198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195949a-5227-45d8-b9f4-46167b0930d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:15.375682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195949a-5227-45d8-b9f4-46167b0930d5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:15.393870 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d0734-bc62-4b2c-abd1-e858c8f20032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:15.394352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:15.396022 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d0734-bc62-4b2c-abd1-e858c8f20032 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:15.396530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d0734-bc62-4b2c-abd1-e858c8f20032 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:15.396814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d0734-bc62-4b2c-abd1-e858c8f20032 None admin] PATH_INFO: `/v3/groups/4335cfc382d449ca8dd8ce35932c651e` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:15.403844 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d0734-bc62-4b2c-abd1-e858c8f20032 None admin] RBAC: Authorizing `identity:get_group(group_id=4335cfc382d449ca8dd8ce35932c651e)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:15.405339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d0734-bc62-4b2c-abd1-e858c8f20032 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:15.409092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 178/354] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:15 2022] GET /identity/v3/groups/4335cfc382d449ca8dd8ce35932c651e => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:15.409092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae901758-a0ca-4e39-ba4b-60560b998df5 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:15.409092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae901758-a0ca-4e39-ba4b-60560b998df5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:15.409386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae901758-a0ca-4e39-ba4b-60560b998df5 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:15.410773 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 179/355] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:15.415539 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae901758-a0ca-4e39-ba4b-60560b998df5 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:15.500851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 177/356] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:15.502276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2b0e0-3dea-4769-a8a2-434bf4ceac68 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:15.503000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2b0e0-3dea-4769-a8a2-434bf4ceac68 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:15.503000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2b0e0-3dea-4769-a8a2-434bf4ceac68 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:15.504148 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 178/357] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:15.504847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2b0e0-3dea-4769-a8a2-434bf4ceac68 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:15.547299 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae901758-a0ca-4e39-ba4b-60560b998df5 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:15.591740 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b0a7e-f9ca-4c30-9392-35dc71f851e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:15.592420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b0a7e-f9ca-4c30-9392-35dc71f851e0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:15.592713 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b0a7e-f9ca-4c30-9392-35dc71f851e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:15.592993 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b0a7e-f9ca-4c30-9392-35dc71f851e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:15.593804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b0a7e-f9ca-4c30-9392-35dc71f851e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:15.594119 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b0a7e-f9ca-4c30-9392-35dc71f851e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:15.595748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b0a7e-f9ca-4c30-9392-35dc71f851e0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:15.605571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 180/358] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:15.607218 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501f77-dd19-488c-815a-616dfde5dd4f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:15.607512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501f77-dd19-488c-815a-616dfde5dd4f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:15.607791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501f77-dd19-488c-815a-616dfde5dd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:15.626152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-0c501f77-dd19-488c-815a-616dfde5dd4f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:15.627351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0c501f77-dd19-488c-815a-616dfde5dd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:15.631344 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2b0e0-3dea-4769-a8a2-434bf4ceac68 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:15.651326 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:15.656368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:15.671584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c43788-9b9a-493a-be05-0c6e5ef28809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:15.672493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c43788-9b9a-493a-be05-0c6e5ef28809 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:15.673882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c43788-9b9a-493a-be05-0c6e5ef28809 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:15.673882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c43788-9b9a-493a-be05-0c6e5ef28809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:15.674138 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c43788-9b9a-493a-be05-0c6e5ef28809 None admin] RBAC: Adding query filter params (group.id=4335cfc382d449ca8dd8ce35932c651e, role.id=1b578241384b4a3698242fde91cc1769, scope.project.id=504ceb17b43e4a218dd7fddd35a66432) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:15.674419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c43788-9b9a-493a-be05-0c6e5ef28809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:15.675872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c43788-9b9a-493a-be05-0c6e5ef28809 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:15.682873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 179/359] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 16:10:15 2022] GET /identity/v3/role_assignments?group.id=4335cfc382d449ca8dd8ce35932c651e&scope.project.id=504ceb17b43e4a218dd7fddd35a66432&role.id=1b578241384b4a3698242fde91cc1769 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:15.684352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a5f65-045e-4547-9f9f-4b195bfde651 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:15.684794 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a5f65-045e-4547-9f9f-4b195bfde651 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:15.685272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a5f65-045e-4547-9f9f-4b195bfde651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:15.703888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-cd4a5f65-045e-4547-9f9f-4b195bfde651 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:15.705167 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-cd4a5f65-045e-4547-9f9f-4b195bfde651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:15.722714 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 181/360] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:15.724028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c501f77-dd19-488c-815a-616dfde5dd4f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:15.805699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 180/361] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:15.806856 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a5f65-045e-4547-9f9f-4b195bfde651 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:15.888646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c501f77-dd19-488c-815a-616dfde5dd4f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:15.939997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d2be2-ff2c-4475-a908-82c8d813e590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:15.941487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d2be2-ff2c-4475-a908-82c8d813e590 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:15.942516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d2be2-ff2c-4475-a908-82c8d813e590 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:15.942799 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d2be2-ff2c-4475-a908-82c8d813e590 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:15.944113 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d2be2-ff2c-4475-a908-82c8d813e590 None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:15.945502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a5f65-045e-4547-9f9f-4b195bfde651 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:15.945617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d2be2-ff2c-4475-a908-82c8d813e590 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:15.947453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 182/362] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:15 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:15.949918 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d2be2-ff2c-4475-a908-82c8d813e590 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:15.962355 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:15.984604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:15.992840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c23beb-d152-40e8-b167-ceb1e394e4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:15.993599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c23beb-d152-40e8-b167-ceb1e394e4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:15.993891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c23beb-d152-40e8-b167-ceb1e394e4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:15.994164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c23beb-d152-40e8-b167-ceb1e394e4b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:16.079719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d2be2-ff2c-4475-a908-82c8d813e590 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:16.089298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c23beb-d152-40e8-b167-ceb1e394e4b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:16.091045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c23beb-d152-40e8-b167-ceb1e394e4b5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:16.126170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f201bd-16c1-4e77-8a0b-a5b8fb29a0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:16.126170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f201bd-16c1-4e77-8a0b-a5b8fb29a0ad None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:16.126490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f201bd-16c1-4e77-8a0b-a5b8fb29a0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:16.126725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f201bd-16c1-4e77-8a0b-a5b8fb29a0ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:16.142438 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f201bd-16c1-4e77-8a0b-a5b8fb29a0ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-a2f201bd-16c1-4e77-8a0b-a5b8fb29a0ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:16.151735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:16.152778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 183/363] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:10:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:16.154099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f201bd-16c1-4e77-8a0b-a5b8fb29a0ad None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:16.234109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 181/364] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:16.235009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c23beb-d152-40e8-b167-ceb1e394e4b5 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:16.254499 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:16.271908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:16.296204 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f201bd-16c1-4e77-8a0b-a5b8fb29a0ad None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:16.352042 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d94695-4d28-483e-ab61-17b5f9c16501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:16.352643 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d94695-4d28-483e-ab61-17b5f9c16501 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:16.352981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d94695-4d28-483e-ab61-17b5f9c16501 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:16.353306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d94695-4d28-483e-ab61-17b5f9c16501 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:16.369067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d94695-4d28-483e-ab61-17b5f9c16501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:16.373103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c23beb-d152-40e8-b167-ceb1e394e4b5 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-21d94695-4d28-483e-ab61-17b5f9c16501 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:16.378366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:16.379828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:16.380645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:16.380645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:16.380645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:16.380645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:16.380645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:16.380645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:16.380645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:16.380645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:16.380645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:16.380645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:16.380645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:16.380645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:16.380645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 184/365] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:10:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:16.381380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d94695-4d28-483e-ab61-17b5f9c16501 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:16.424138 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a2d7a-f3f1-4010-8e97-9932bff9f4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:16.425023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a2d7a-f3f1-4010-8e97-9932bff9f4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:16.425372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a2d7a-f3f1-4010-8e97-9932bff9f4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:16.425655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a2d7a-f3f1-4010-8e97-9932bff9f4e9 None admin] PATH_INFO: `/v3/groups/4335cfc382d449ca8dd8ce35932c651e` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:16.426887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a2d7a-f3f1-4010-8e97-9932bff9f4e9 None admin] RBAC: Authorizing `identity:get_group(group_id=4335cfc382d449ca8dd8ce35932c651e)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:16.428349 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a2d7a-f3f1-4010-8e97-9932bff9f4e9 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:16.436021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 182/366] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:16 2022] GET /identity/v3/groups/4335cfc382d449ca8dd8ce35932c651e => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:16.436021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a2d7a-f3f1-4010-8e97-9932bff9f4e9 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:16.512387 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d94695-4d28-483e-ab61-17b5f9c16501 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:16.539276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:16.554990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96596b10-71f6-4379-8e19-6e206ad16c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:16.555666 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96596b10-71f6-4379-8e19-6e206ad16c83 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:16.555956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96596b10-71f6-4379-8e19-6e206ad16c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:16.556246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96596b10-71f6-4379-8e19-6e206ad16c83 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:16.557039 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96596b10-71f6-4379-8e19-6e206ad16c83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:16.557379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96596b10-71f6-4379-8e19-6e206ad16c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:16.558350 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a2d7a-f3f1-4010-8e97-9932bff9f4e9 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:16.558760 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96596b10-71f6-4379-8e19-6e206ad16c83 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:16.568017 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 185/367] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:16.569468 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96596b10-71f6-4379-8e19-6e206ad16c83 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:16.583791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:16.602043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d22e4-f9c6-4034-9f66-0490771b94ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:16.602878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d22e4-f9c6-4034-9f66-0490771b94ad None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:16.603160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d22e4-f9c6-4034-9f66-0490771b94ad None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:16.603470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d22e4-f9c6-4034-9f66-0490771b94ad None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:16.605263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d22e4-f9c6-4034-9f66-0490771b94ad None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:16.606791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d22e4-f9c6-4034-9f66-0490771b94ad None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:16.608496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 183/368] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:16 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:16.609262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d22e4-f9c6-4034-9f66-0490771b94ad None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:16.709779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96596b10-71f6-4379-8e19-6e206ad16c83 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:16.741039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d22e4-f9c6-4034-9f66-0490771b94ad None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:16.749558 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9507189-7a85-4cbb-ba94-ec29ab70c963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:16.749558 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507189-7a85-4cbb-ba94-ec29ab70c963 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:16.749558 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507189-7a85-4cbb-ba94-ec29ab70c963 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:16.749882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507189-7a85-4cbb-ba94-ec29ab70c963 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:16.750564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9507189-7a85-4cbb-ba94-ec29ab70c963 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:16.750871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9507189-7a85-4cbb-ba94-ec29ab70c963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:16.752248 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9507189-7a85-4cbb-ba94-ec29ab70c963 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:16.761879 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 186/369] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:16.763089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9507189-7a85-4cbb-ba94-ec29ab70c963 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:16.796528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdbe8e-0a08-49a9-93f8-76fd7d50fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:16.797484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdbe8e-0a08-49a9-93f8-76fd7d50fc72 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:16.797993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdbe8e-0a08-49a9-93f8-76fd7d50fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:16.798418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdbe8e-0a08-49a9-93f8-76fd7d50fc72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:16.799405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdbe8e-0a08-49a9-93f8-76fd7d50fc72 None admin] RBAC: Adding query filter params (group.id=4335cfc382d449ca8dd8ce35932c651e, role.id=8eb72f5f99cf44e09c674c32be4bbb9d, scope.project.id=504ceb17b43e4a218dd7fddd35a66432) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:16.799868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdbe8e-0a08-49a9-93f8-76fd7d50fc72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:16.801547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdbe8e-0a08-49a9-93f8-76fd7d50fc72 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:16.808065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 184/370] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 16:10:16 2022] GET /identity/v3/role_assignments?group.id=4335cfc382d449ca8dd8ce35932c651e&scope.project.id=504ceb17b43e4a218dd7fddd35a66432&role.id=8eb72f5f99cf44e09c674c32be4bbb9d => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:16.809174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdbe8e-0a08-49a9-93f8-76fd7d50fc72 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:16.826468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:16.849533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:16.885680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9507189-7a85-4cbb-ba94-ec29ab70c963 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:16.924979 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7c7e8-c5a5-4613-83cc-bdac76d683c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:16.925498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c7e8-c5a5-4613-83cc-bdac76d683c7 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:16.925791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c7e8-c5a5-4613-83cc-bdac76d683c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:16.926130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c7e8-c5a5-4613-83cc-bdac76d683c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:16.930930 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdbe8e-0a08-49a9-93f8-76fd7d50fc72 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:16.970805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f27233-8119-4d37-b526-a4ef6d4dcea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:16.972626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f27233-8119-4d37-b526-a4ef6d4dcea0 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:16.973797 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f27233-8119-4d37-b526-a4ef6d4dcea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:16.974291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f27233-8119-4d37-b526-a4ef6d4dcea0 None admin] PATH_INFO: `/v3/groups/4335cfc382d449ca8dd8ce35932c651e` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:16.975811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f27233-8119-4d37-b526-a4ef6d4dcea0 None admin] RBAC: Authorizing `identity:get_group(group_id=4335cfc382d449ca8dd8ce35932c651e)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:16.977697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f27233-8119-4d37-b526-a4ef6d4dcea0 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:16.979935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 185/371] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:16 2022] GET /identity/v3/groups/4335cfc382d449ca8dd8ce35932c651e => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:16.981042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f27233-8119-4d37-b526-a4ef6d4dcea0 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:17.007749 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7c7e8-c5a5-4613-83cc-bdac76d683c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:17.009919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7c7e8-c5a5-4613-83cc-bdac76d683c7 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:17.074031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:17.097474 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f27233-8119-4d37-b526-a4ef6d4dcea0 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:17.119200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:17.138620 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b402e-5521-4a8d-955e-460c1668ce20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:17.139426 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b402e-5521-4a8d-955e-460c1668ce20 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:17.139803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b402e-5521-4a8d-955e-460c1668ce20 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:17.140173 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b402e-5521-4a8d-955e-460c1668ce20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:17.142249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 187/372] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:17.143382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7c7e8-c5a5-4613-83cc-bdac76d683c7 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:17.227596 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b402e-5521-4a8d-955e-460c1668ce20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:17.229191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b402e-5521-4a8d-955e-460c1668ce20 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:17.274264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7c7e8-c5a5-4613-83cc-bdac76d683c7 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:17.321237 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18aacd-17f7-479a-a9ad-ac1f32921148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:17.322027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:17.322741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18aacd-17f7-479a-a9ad-ac1f32921148 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:17.323107 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18aacd-17f7-479a-a9ad-ac1f32921148 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:17.323388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18aacd-17f7-479a-a9ad-ac1f32921148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:17.324710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18aacd-17f7-479a-a9ad-ac1f32921148 None admin] RBAC: Adding query filter params (group.id=4335cfc382d449ca8dd8ce35932c651e, role.id=1b578241384b4a3698242fde91cc1769, scope.project.id=9140784043094850b716a45f8a921768) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:17.325141 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18aacd-17f7-479a-a9ad-ac1f32921148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:17.327687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18aacd-17f7-479a-a9ad-ac1f32921148 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:17.335582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 188/373] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 16:10:17 2022] GET /identity/v3/role_assignments?group.id=4335cfc382d449ca8dd8ce35932c651e&scope.project.id=9140784043094850b716a45f8a921768&role.id=1b578241384b4a3698242fde91cc1769 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:17.342071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18aacd-17f7-479a-a9ad-ac1f32921148 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:17.346933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 186/374] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:17.353363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b402e-5521-4a8d-955e-460c1668ce20 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:17.404273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:17.483347 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b402e-5521-4a8d-955e-460c1668ce20 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:17.522502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371db88-a087-4acc-836e-4631efda21be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:17.523389 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371db88-a087-4acc-836e-4631efda21be None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:17.523673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371db88-a087-4acc-836e-4631efda21be None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:17.523947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371db88-a087-4acc-836e-4631efda21be None admin] PATH_INFO: `/v3/projects/d20bec087d7d4867acdc2fcb7538cbf2` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:17.525218 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371db88-a087-4acc-836e-4631efda21be None admin] RBAC: Authorizing `identity:get_project(project_id=d20bec087d7d4867acdc2fcb7538cbf2)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:17.526684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371db88-a087-4acc-836e-4631efda21be None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:17.528836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 187/375] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:17 2022] GET /identity/v3/projects/d20bec087d7d4867acdc2fcb7538cbf2 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:17.540758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371db88-a087-4acc-836e-4631efda21be None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:17.558699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18aacd-17f7-479a-a9ad-ac1f32921148 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:17.603931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:17.618010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d19032-9784-459f-9db9-f5fa53a29958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:17.618897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d19032-9784-459f-9db9-f5fa53a29958 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:17.619187 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d19032-9784-459f-9db9-f5fa53a29958 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:17.619620 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d19032-9784-459f-9db9-f5fa53a29958 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:17.622461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d19032-9784-459f-9db9-f5fa53a29958 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:17.623965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d19032-9784-459f-9db9-f5fa53a29958 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:17.625945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 189/376] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:17 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:17.631482 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d19032-9784-459f-9db9-f5fa53a29958 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:17.730677 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371db88-a087-4acc-836e-4631efda21be None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:17.746985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d19032-9784-459f-9db9-f5fa53a29958 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:17.749407 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:17.784777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d8922-1bcb-4b34-87ee-ebb9a5b2d001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:17.786269 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d8922-1bcb-4b34-87ee-ebb9a5b2d001 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:17.786700 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d8922-1bcb-4b34-87ee-ebb9a5b2d001 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:17.786980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d8922-1bcb-4b34-87ee-ebb9a5b2d001 None admin] PATH_INFO: `/v3/groups/4335cfc382d449ca8dd8ce35932c651e` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:17.788322 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d8922-1bcb-4b34-87ee-ebb9a5b2d001 None admin] RBAC: Authorizing `identity:get_group(group_id=4335cfc382d449ca8dd8ce35932c651e)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:17.790072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d8922-1bcb-4b34-87ee-ebb9a5b2d001 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:17.792010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 190/377] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:17 2022] GET /identity/v3/groups/4335cfc382d449ca8dd8ce35932c651e => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:17.797666 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d8922-1bcb-4b34-87ee-ebb9a5b2d001 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:17.853270 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4522ea-4d98-4109-a377-85db30975d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:17.854281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4522ea-4d98-4109-a377-85db30975d3c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:17.854510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4522ea-4d98-4109-a377-85db30975d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:17.854785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4522ea-4d98-4109-a377-85db30975d3c None admin] PATH_INFO: `/v3/groups/6188b8c3aa14451c9f52e3e9b0253128` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:17.872320 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4522ea-4d98-4109-a377-85db30975d3c None admin] RBAC: Authorizing `identity:get_group(group_id=6188b8c3aa14451c9f52e3e9b0253128)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:17.873832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4522ea-4d98-4109-a377-85db30975d3c None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:17.875852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 188/378] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:17 2022] GET /identity/v3/groups/6188b8c3aa14451c9f52e3e9b0253128 => generated 229 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:17.882018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4522ea-4d98-4109-a377-85db30975d3c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:17.914419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d8922-1bcb-4b34-87ee-ebb9a5b2d001 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:17.955934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d804a-ca6f-48f3-af15-9758301be57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:17.956604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d804a-ca6f-48f3-af15-9758301be57e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:17.956886 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d804a-ca6f-48f3-af15-9758301be57e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:17.957233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d804a-ca6f-48f3-af15-9758301be57e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:17.959088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d804a-ca6f-48f3-af15-9758301be57e None admin] RBAC: Adding query filter params (group.id=4335cfc382d449ca8dd8ce35932c651e, role.id=8eb72f5f99cf44e09c674c32be4bbb9d, scope.project.id=9140784043094850b716a45f8a921768) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:17.959421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d804a-ca6f-48f3-af15-9758301be57e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:17.961197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d804a-ca6f-48f3-af15-9758301be57e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:17.977183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 191/379] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 16:10:17 2022] GET /identity/v3/role_assignments?group.id=4335cfc382d449ca8dd8ce35932c651e&scope.project.id=9140784043094850b716a45f8a921768&role.id=8eb72f5f99cf44e09c674c32be4bbb9d => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:18.064796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4522ea-4d98-4109-a377-85db30975d3c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:18.084490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:18.093168 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5817-46ce-4189-839b-e982069a3478 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:18.093168 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5817-46ce-4189-839b-e982069a3478 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:18.093168 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5817-46ce-4189-839b-e982069a3478 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:18.094747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 192/380] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:18.102471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d93f6-79ff-48cc-abb3-29e8d6eabcae None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:18.103345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d93f6-79ff-48cc-abb3-29e8d6eabcae None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:18.103824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d93f6-79ff-48cc-abb3-29e8d6eabcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:18.114441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32372f-8be8-4f44-acc4-f6a1b4705de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:18.115459 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32372f-8be8-4f44-acc4-f6a1b4705de9 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:18.117536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32372f-8be8-4f44-acc4-f6a1b4705de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:18.118041 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32372f-8be8-4f44-acc4-f6a1b4705de9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:18.119123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32372f-8be8-4f44-acc4-f6a1b4705de9 None admin] RBAC: Adding query filter params (group.id=6188b8c3aa14451c9f52e3e9b0253128, role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=d20bec087d7d4867acdc2fcb7538cbf2) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:18.124632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32372f-8be8-4f44-acc4-f6a1b4705de9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:18.126480 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32372f-8be8-4f44-acc4-f6a1b4705de9 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:18.138823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 189/381] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 16:10:17 2022] GET /identity/v3/role_assignments?group.id=6188b8c3aa14451c9f52e3e9b0253128&scope.project.id=d20bec087d7d4867acdc2fcb7538cbf2&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:18.140385 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-015d93f6-79ff-48cc-abb3-29e8d6eabcae None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:18.142021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-015d93f6-79ff-48cc-abb3-29e8d6eabcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:18.184309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:18.237910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 193/382] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:10:18.273054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32372f-8be8-4f44-acc4-f6a1b4705de9 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:18.404260 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32372f-8be8-4f44-acc4-f6a1b4705de9 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:18.439851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efee6f-5f32-46b2-b56b-5fbd75dbb278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:18.440658 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efee6f-5f32-46b2-b56b-5fbd75dbb278 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:18.440939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efee6f-5f32-46b2-b56b-5fbd75dbb278 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:18.441243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efee6f-5f32-46b2-b56b-5fbd75dbb278 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:18.452264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efee6f-5f32-46b2-b56b-5fbd75dbb278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-f3efee6f-5f32-46b2-b56b-5fbd75dbb278 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:18.465160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:18.466045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:18.466834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:18.466834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:18.466834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:18.466834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:18.466834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:18.466834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:18.466834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:18.466834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:18.466834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:18.466834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:18.466834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:18.466834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:18.466834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 190/383] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:18.469250 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d93f6-79ff-48cc-abb3-29e8d6eabcae None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:18.591190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d93f6-79ff-48cc-abb3-29e8d6eabcae None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:18.630672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36885e-890a-4ce4-9ba4-0faa1667e3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:18.631681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36885e-890a-4ce4-9ba4-0faa1667e3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:18.632146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36885e-890a-4ce4-9ba4-0faa1667e3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:18.632607 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36885e-890a-4ce4-9ba4-0faa1667e3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:18.633572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36885e-890a-4ce4-9ba4-0faa1667e3c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:18.634058 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36885e-890a-4ce4-9ba4-0faa1667e3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:18.635640 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36885e-890a-4ce4-9ba4-0faa1667e3c9 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:18.646102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 194/384] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:18.653246 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efee6f-5f32-46b2-b56b-5fbd75dbb278 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:18.703222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:18.801048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efee6f-5f32-46b2-b56b-5fbd75dbb278 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:18.852620 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29ab98-888a-479b-a1a4-25bbc049926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:18.853531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29ab98-888a-479b-a1a4-25bbc049926f None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:18.853817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29ab98-888a-479b-a1a4-25bbc049926f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:18.854093 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29ab98-888a-479b-a1a4-25bbc049926f None admin] PATH_INFO: `/v3/groups/4335cfc382d449ca8dd8ce35932c651e` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:18.855293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29ab98-888a-479b-a1a4-25bbc049926f None admin] RBAC: Authorizing `identity:get_group(group_id=4335cfc382d449ca8dd8ce35932c651e)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:18.856748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29ab98-888a-479b-a1a4-25bbc049926f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:18.858760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 191/385] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:18 2022] GET /identity/v3/groups/4335cfc382d449ca8dd8ce35932c651e => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:18.864487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36885e-890a-4ce4-9ba4-0faa1667e3c9 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:18.909859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:19.006715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36885e-890a-4ce4-9ba4-0faa1667e3c9 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:19.040925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd7217-0ccd-4998-afed-d14b3aa9a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:19.041817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd7217-0ccd-4998-afed-d14b3aa9a46a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:19.042101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd7217-0ccd-4998-afed-d14b3aa9a46a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:19.042372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd7217-0ccd-4998-afed-d14b3aa9a46a None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:19.043564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd7217-0ccd-4998-afed-d14b3aa9a46a None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:19.044996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd7217-0ccd-4998-afed-d14b3aa9a46a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:19.047100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 195/386] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:18 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:19.053106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29ab98-888a-479b-a1a4-25bbc049926f None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:19.179743 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29ab98-888a-479b-a1a4-25bbc049926f None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:19.182086 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:19.214985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892088e-c4be-49f3-a0ce-444e5cc00e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:19.215879 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892088e-c4be-49f3-a0ce-444e5cc00e53 None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:19.216166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892088e-c4be-49f3-a0ce-444e5cc00e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:19.216519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892088e-c4be-49f3-a0ce-444e5cc00e53 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432/groups/4335cfc382d449ca8dd8ce35932c651e/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:19.218549 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892088e-c4be-49f3-a0ce-444e5cc00e53 None admin] RBAC: Authorizing `identity:create_grant(project_id=504ceb17b43e4a218dd7fddd35a66432, group_id=4335cfc382d449ca8dd8ce35932c651e, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:19.219987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892088e-c4be-49f3-a0ce-444e5cc00e53 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:19.256909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d22b-2caf-4e10-91a2-1f6976e72907 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:19.257528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d22b-2caf-4e10-91a2-1f6976e72907 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:19.258019 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d22b-2caf-4e10-91a2-1f6976e72907 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:19.259574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 196/387] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:19.264619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5821a4-4646-49fc-8ead-224250ce77b1 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:19.265161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5821a4-4646-49fc-8ead-224250ce77b1 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:19.265637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5821a4-4646-49fc-8ead-224250ce77b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:19.283481 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-2e5821a4-4646-49fc-8ead-224250ce77b1 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:19.284958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-2e5821a4-4646-49fc-8ead-224250ce77b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:19.310853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 192/388] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Jul 12 16:10:19 2022] PUT /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432/groups/4335cfc382d449ca8dd8ce35932c651e/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:10:19.364684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 197/389] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:10:19.399468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892088e-c4be-49f3-a0ce-444e5cc00e53 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:19.549290 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892088e-c4be-49f3-a0ce-444e5cc00e53 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:19.589776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1f767-7c80-4b2e-b8be-a14d240b496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:19.590599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1f767-7c80-4b2e-b8be-a14d240b496c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:19.590890 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1f767-7c80-4b2e-b8be-a14d240b496c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:19.591178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1f767-7c80-4b2e-b8be-a14d240b496c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:19.602312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1f767-7c80-4b2e-b8be-a14d240b496c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-77e1f767-7c80-4b2e-b8be-a14d240b496c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:19.612047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:19.613168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:19.614199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:19.614199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:19.614199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:19.614199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:19.614199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:19.614199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:19.614199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:19.614199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:19.614199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:19.614199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:19.614199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:19.614199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:19.616503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 193/390] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:10:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:19.622315 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5821a4-4646-49fc-8ead-224250ce77b1 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:19.652041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:19.734425 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5821a4-4646-49fc-8ead-224250ce77b1 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:19.776150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3cde1-0afd-48dd-96cf-76d31b635919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:19.777196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3cde1-0afd-48dd-96cf-76d31b635919 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:19.777678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3cde1-0afd-48dd-96cf-76d31b635919 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:19.778138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3cde1-0afd-48dd-96cf-76d31b635919 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:19.779074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3cde1-0afd-48dd-96cf-76d31b635919 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:19.779574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3cde1-0afd-48dd-96cf-76d31b635919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:19.781155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3cde1-0afd-48dd-96cf-76d31b635919 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:19.790264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 198/391] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:19.795491 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1f767-7c80-4b2e-b8be-a14d240b496c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:19.826302 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:19.859245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef36722-64b7-4666-80d4-1f209f4888bb None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:19.859586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef36722-64b7-4666-80d4-1f209f4888bb None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:19.859804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef36722-64b7-4666-80d4-1f209f4888bb None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:19.861330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 199/392] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:10:19.867257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4d83d-1d29-44fd-a77f-a50e08449946 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:19.870682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4d83d-1d29-44fd-a77f-a50e08449946 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:19.870682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4d83d-1d29-44fd-a77f-a50e08449946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:19.889146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-31f4d83d-1d29-44fd-a77f-a50e08449946 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:19.890438 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-31f4d83d-1d29-44fd-a77f-a50e08449946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:19.957604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1f767-7c80-4b2e-b8be-a14d240b496c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:20.003434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e7637-8f8a-41d5-adc8-d96f2b3e04ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:20.004906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e7637-8f8a-41d5-adc8-d96f2b3e04ec None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:20.005306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e7637-8f8a-41d5-adc8-d96f2b3e04ec None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:20.005750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e7637-8f8a-41d5-adc8-d96f2b3e04ec None admin] PATH_INFO: `/v3/groups/4335cfc382d449ca8dd8ce35932c651e` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:20.007079 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e7637-8f8a-41d5-adc8-d96f2b3e04ec None admin] RBAC: Authorizing `identity:get_group(group_id=4335cfc382d449ca8dd8ce35932c651e)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:20.008807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e7637-8f8a-41d5-adc8-d96f2b3e04ec None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:20.010989 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 194/393] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:19 2022] GET /identity/v3/groups/4335cfc382d449ca8dd8ce35932c651e => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:20.018046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e7637-8f8a-41d5-adc8-d96f2b3e04ec None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:20.030846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 200/394] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:10:20.065374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4d83d-1d29-44fd-a77f-a50e08449946 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:20.093249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:20.123021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:20.134287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e7637-8f8a-41d5-adc8-d96f2b3e04ec None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:20.170992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff11b78-a157-4ff1-8952-ee96870636c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:20.172270 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff11b78-a157-4ff1-8952-ee96870636c6 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:20.172751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff11b78-a157-4ff1-8952-ee96870636c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:20.173255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff11b78-a157-4ff1-8952-ee96870636c6 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:20.174680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff11b78-a157-4ff1-8952-ee96870636c6 None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:20.176331 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff11b78-a157-4ff1-8952-ee96870636c6 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:20.178559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 195/395] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:20 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:20.184139 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff11b78-a157-4ff1-8952-ee96870636c6 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:20.275037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4d83d-1d29-44fd-a77f-a50e08449946 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:20.290467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff11b78-a157-4ff1-8952-ee96870636c6 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:20.327645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2da87-9460-4f26-b2ca-1eb9a2b03f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:20.328973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2da87-9460-4f26-b2ca-1eb9a2b03f48 None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:20.329512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2da87-9460-4f26-b2ca-1eb9a2b03f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:20.329987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2da87-9460-4f26-b2ca-1eb9a2b03f48 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432/groups/4335cfc382d449ca8dd8ce35932c651e/roles/8eb72f5f99cf44e09c674c32be4bbb9d` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:20.333193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2da87-9460-4f26-b2ca-1eb9a2b03f48 None admin] RBAC: Authorizing `identity:create_grant(project_id=504ceb17b43e4a218dd7fddd35a66432, group_id=4335cfc382d449ca8dd8ce35932c651e, role_id=8eb72f5f99cf44e09c674c32be4bbb9d)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:20.334860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2da87-9460-4f26-b2ca-1eb9a2b03f48 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:20.346155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05951ed2-a1f2-46ea-a186-703ad8ec0bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:20.347328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951ed2-a1f2-46ea-a186-703ad8ec0bef None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:20.348446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951ed2-a1f2-46ea-a186-703ad8ec0bef None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:20.348993 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951ed2-a1f2-46ea-a186-703ad8ec0bef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:20.360139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05951ed2-a1f2-46ea-a186-703ad8ec0bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-05951ed2-a1f2-46ea-a186-703ad8ec0bef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:20.368598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:20.369514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:20.370388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:20.370388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:20.370388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:20.370388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:20.370388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:20.370388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:20.370388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:20.370388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:20.370388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:20.370388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:20.370388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:20.370388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:20.373142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 201/396] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:20.378637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05951ed2-a1f2-46ea-a186-703ad8ec0bef None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:20.412965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 196/397] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Jul 12 16:10:20 2022] PUT /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432/groups/4335cfc382d449ca8dd8ce35932c651e/roles/8eb72f5f99cf44e09c674c32be4bbb9d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:10:20.495517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:20.526761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05951ed2-a1f2-46ea-a186-703ad8ec0bef None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:20.571112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe9fcb-8db8-4e57-9641-41d04a6964af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:20.571802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe9fcb-8db8-4e57-9641-41d04a6964af None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:20.572085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe9fcb-8db8-4e57-9641-41d04a6964af None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:20.572360 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe9fcb-8db8-4e57-9641-41d04a6964af None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:20.573152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe9fcb-8db8-4e57-9641-41d04a6964af None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:20.573459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe9fcb-8db8-4e57-9641-41d04a6964af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:20.575070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe9fcb-8db8-4e57-9641-41d04a6964af None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:20.591915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 202/398] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:20.597314 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2da87-9460-4f26-b2ca-1eb9a2b03f48 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:20.625089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:20.635038 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55427a5e-3dca-4bd2-b1af-c95564f35496 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:20.635555 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55427a5e-3dca-4bd2-b1af-c95564f35496 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:20.635631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55427a5e-3dca-4bd2-b1af-c95564f35496 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:20.637019 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 203/399] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:10:20.647900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0943d9e-9b65-4699-abb2-b8c82474491d None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:20.648188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0943d9e-9b65-4699-abb2-b8c82474491d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:20.648467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0943d9e-9b65-4699-abb2-b8c82474491d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:20.668658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-f0943d9e-9b65-4699-abb2-b8c82474491d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:20.669882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f0943d9e-9b65-4699-abb2-b8c82474491d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:20.720837 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2da87-9460-4f26-b2ca-1eb9a2b03f48 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:20.757268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 204/400] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:10:20.757865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea798ce2-2d4f-4c06-9717-abccc2e1b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:20.758834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea798ce2-2d4f-4c06-9717-abccc2e1b5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:20.759122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea798ce2-2d4f-4c06-9717-abccc2e1b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:20.759400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea798ce2-2d4f-4c06-9717-abccc2e1b5d2 None admin] PATH_INFO: `/v3/groups/4335cfc382d449ca8dd8ce35932c651e` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:20.760582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea798ce2-2d4f-4c06-9717-abccc2e1b5d2 None admin] RBAC: Authorizing `identity:get_group(group_id=4335cfc382d449ca8dd8ce35932c651e)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:20.762055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea798ce2-2d4f-4c06-9717-abccc2e1b5d2 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:20.763769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 197/401] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:20 2022] GET /identity/v3/groups/4335cfc382d449ca8dd8ce35932c651e => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:20.774230 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0943d9e-9b65-4699-abb2-b8c82474491d None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:20.781413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea798ce2-2d4f-4c06-9717-abccc2e1b5d2 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:20.844828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:20.884543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0943d9e-9b65-4699-abb2-b8c82474491d None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:20.934881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:20.943845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d18db-2dd3-4367-9226-cb3bad69b4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:20.944728 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d18db-2dd3-4367-9226-cb3bad69b4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:20.945013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d18db-2dd3-4367-9226-cb3bad69b4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:20.945315 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d18db-2dd3-4367-9226-cb3bad69b4f5 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:20.947711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d18db-2dd3-4367-9226-cb3bad69b4f5 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:20.949217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d18db-2dd3-4367-9226-cb3bad69b4f5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:20.952513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 205/402] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:20 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:20.956867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d18db-2dd3-4367-9226-cb3bad69b4f5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:20.963065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea798ce2-2d4f-4c06-9717-abccc2e1b5d2 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:21.028425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab931eef-78f1-467c-9fcc-94ce0718425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:21.029261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931eef-78f1-467c-9fcc-94ce0718425e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:21.029549 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931eef-78f1-467c-9fcc-94ce0718425e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:21.029825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931eef-78f1-467c-9fcc-94ce0718425e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:21.043575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab931eef-78f1-467c-9fcc-94ce0718425e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-ab931eef-78f1-467c-9fcc-94ce0718425e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:21.055065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:21.056016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:21.056887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:21.056887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:21.056887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:21.056887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:21.056887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:21.056887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:21.056887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:21.056887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:21.056887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:21.056887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:21.056887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:21.056887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:21.061197 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 198/403] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:10:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:21.063862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f01d98-1520-4ba7-9abd-60bcb886007a None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:21.064152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f01d98-1520-4ba7-9abd-60bcb886007a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:21.064428 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f01d98-1520-4ba7-9abd-60bcb886007a None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:21.070864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 199/404] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:21.071748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f01d98-1520-4ba7-9abd-60bcb886007a None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:21.102266 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d18db-2dd3-4367-9226-cb3bad69b4f5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:21.148679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef75a15-a987-4b80-9c8f-330c56681316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:21.149704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef75a15-a987-4b80-9c8f-330c56681316 None admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:21.150139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef75a15-a987-4b80-9c8f-330c56681316 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:21.150508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef75a15-a987-4b80-9c8f-330c56681316 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768/groups/4335cfc382d449ca8dd8ce35932c651e/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:21.153036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef75a15-a987-4b80-9c8f-330c56681316 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140784043094850b716a45f8a921768, group_id=4335cfc382d449ca8dd8ce35932c651e, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:21.155058 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef75a15-a987-4b80-9c8f-330c56681316 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:21.159313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:21.178850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f01d98-1520-4ba7-9abd-60bcb886007a None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:21.212911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7849af6-3575-493d-9ede-6431a4aadf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:21.213606 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7849af6-3575-493d-9ede-6431a4aadf89 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:21.213891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7849af6-3575-493d-9ede-6431a4aadf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:21.214167 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7849af6-3575-493d-9ede-6431a4aadf89 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:21.214917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7849af6-3575-493d-9ede-6431a4aadf89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:21.215225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7849af6-3575-493d-9ede-6431a4aadf89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:21.216597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7849af6-3575-493d-9ede-6431a4aadf89 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:21.224751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 200/405] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:21.225972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0f023-1f22-4b24-b68e-ac81ffdfb85b None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:21.226260 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0f023-1f22-4b24-b68e-ac81ffdfb85b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:21.226538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0f023-1f22-4b24-b68e-ac81ffdfb85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:21.244752 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a0d0f023-1f22-4b24-b68e-ac81ffdfb85b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:21.245960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a0d0f023-1f22-4b24-b68e-ac81ffdfb85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:21.248756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:21.298936 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 206/406] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Jul 12 16:10:20 2022] PUT /identity/v3/projects/9140784043094850b716a45f8a921768/groups/4335cfc382d449ca8dd8ce35932c651e/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:10:21.300202 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef75a15-a987-4b80-9c8f-330c56681316 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:21.348557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 201/407] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:21.382887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0f023-1f22-4b24-b68e-ac81ffdfb85b None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:21.434003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef75a15-a987-4b80-9c8f-330c56681316 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:21.474773 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e839e0-b7ee-4aca-ac3c-d4908eca00ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:21.475962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e839e0-b7ee-4aca-ac3c-d4908eca00ca None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:21.476254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e839e0-b7ee-4aca-ac3c-d4908eca00ca None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:21.476534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e839e0-b7ee-4aca-ac3c-d4908eca00ca None admin] PATH_INFO: `/v3/groups/4335cfc382d449ca8dd8ce35932c651e` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:21.477801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e839e0-b7ee-4aca-ac3c-d4908eca00ca None admin] RBAC: Authorizing `identity:get_group(group_id=4335cfc382d449ca8dd8ce35932c651e)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:21.480164 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e839e0-b7ee-4aca-ac3c-d4908eca00ca None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:21.481883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 207/408] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:21 2022] GET /identity/v3/groups/4335cfc382d449ca8dd8ce35932c651e => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:21.502792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e839e0-b7ee-4aca-ac3c-d4908eca00ca None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:21.597188 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0f023-1f22-4b24-b68e-ac81ffdfb85b None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:21.626693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14124544-181a-4cc5-a77d-38db178b39b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:21.627500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14124544-181a-4cc5-a77d-38db178b39b1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:21.627791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14124544-181a-4cc5-a77d-38db178b39b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:21.628071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14124544-181a-4cc5-a77d-38db178b39b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:21.636307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:21.637689 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:21.640217 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14124544-181a-4cc5-a77d-38db178b39b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-14124544-181a-4cc5-a77d-38db178b39b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:21.648512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:21.649461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:21.650308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:21.650308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:21.650308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:21.650308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:21.650308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:21.650308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:21.650308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:21.650308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:21.650308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:21.650308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:21.650308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:21.650308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:21.650308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 202/409] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:10:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:21.655833 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14124544-181a-4cc5-a77d-38db178b39b1 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:21.725707 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e839e0-b7ee-4aca-ac3c-d4908eca00ca None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:21.794756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5553b6-74c5-4e76-83e2-c74dfedc4b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:21.795627 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5553b6-74c5-4e76-83e2-c74dfedc4b52 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:21.795911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5553b6-74c5-4e76-83e2-c74dfedc4b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:21.796188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5553b6-74c5-4e76-83e2-c74dfedc4b52 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:21.802111 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5553b6-74c5-4e76-83e2-c74dfedc4b52 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:21.803598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5553b6-74c5-4e76-83e2-c74dfedc4b52 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:21.805692 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 208/410] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:21 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:21.826125 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5553b6-74c5-4e76-83e2-c74dfedc4b52 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:21.836610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14124544-181a-4cc5-a77d-38db178b39b1 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:21.877892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3084bbe-595b-4add-970d-387299c4b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:21.878576 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084bbe-595b-4add-970d-387299c4b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:21.878862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084bbe-595b-4add-970d-387299c4b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:21.880825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084bbe-595b-4add-970d-387299c4b0b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:21.881624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3084bbe-595b-4add-970d-387299c4b0b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:21.881943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3084bbe-595b-4add-970d-387299c4b0b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:21.883343 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3084bbe-595b-4add-970d-387299c4b0b8 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:21.900479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 203/411] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:21.906530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3084bbe-595b-4add-970d-387299c4b0b8 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:22.022610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:22.048939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5553b6-74c5-4e76-83e2-c74dfedc4b52 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:22.082125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3084bbe-595b-4add-970d-387299c4b0b8 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:22.088963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:22.096350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f1cb9-7ebe-46a4-92ac-2a5dce719c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:22.098334 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f1cb9-7ebe-46a4-92ac-2a5dce719c85 None admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:22.098882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f1cb9-7ebe-46a4-92ac-2a5dce719c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:22.099632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f1cb9-7ebe-46a4-92ac-2a5dce719c85 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768/groups/4335cfc382d449ca8dd8ce35932c651e/roles/8eb72f5f99cf44e09c674c32be4bbb9d` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:22.102285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f1cb9-7ebe-46a4-92ac-2a5dce719c85 None admin] RBAC: Authorizing `identity:create_grant(project_id=9140784043094850b716a45f8a921768, group_id=4335cfc382d449ca8dd8ce35932c651e, role_id=8eb72f5f99cf44e09c674c32be4bbb9d)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:22.104376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f1cb9-7ebe-46a4-92ac-2a5dce719c85 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:22.150255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a26a7b-37f0-4ae9-a53c-36b0c3a926c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:22.151519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a26a7b-37f0-4ae9-a53c-36b0c3a926c9 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:22.152002 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a26a7b-37f0-4ae9-a53c-36b0c3a926c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:22.152517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a26a7b-37f0-4ae9-a53c-36b0c3a926c9 None admin] PATH_INFO: `/v3/groups/6188b8c3aa14451c9f52e3e9b0253128` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:22.154467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a26a7b-37f0-4ae9-a53c-36b0c3a926c9 None admin] RBAC: Authorizing `identity:get_group(group_id=6188b8c3aa14451c9f52e3e9b0253128)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:22.156256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a26a7b-37f0-4ae9-a53c-36b0c3a926c9 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:22.158714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 204/412] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:21 2022] GET /identity/v3/groups/6188b8c3aa14451c9f52e3e9b0253128 => generated 229 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:22.160668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05863da4-3350-4a10-a51a-7ac3cac4e8f2 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:22.166943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05863da4-3350-4a10-a51a-7ac3cac4e8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:22.166943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05863da4-3350-4a10-a51a-7ac3cac4e8f2 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:22.166943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 205/413] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:22.168148 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05863da4-3350-4a10-a51a-7ac3cac4e8f2 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:22.196296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 209/414] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Jul 12 16:10:21 2022] PUT /identity/v3/projects/9140784043094850b716a45f8a921768/groups/4335cfc382d449ca8dd8ce35932c651e/roles/8eb72f5f99cf44e09c674c32be4bbb9d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:10:22.198068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f70b-9d44-43bf-8ce1-2fa34e47d2a1 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:22.198607 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f70b-9d44-43bf-8ce1-2fa34e47d2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:22.199134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f70b-9d44-43bf-8ce1-2fa34e47d2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:22.241462 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e878f70b-9d44-43bf-8ce1-2fa34e47d2a1 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:22.243451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e878f70b-9d44-43bf-8ce1-2fa34e47d2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:22.354726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 210/415] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:22.381304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878f70b-9d44-43bf-8ce1-2fa34e47d2a1 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:22.500296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878f70b-9d44-43bf-8ce1-2fa34e47d2a1 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:22.514409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05863da4-3350-4a10-a51a-7ac3cac4e8f2 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:22.528794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:22.543777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919280f-353b-4609-8307-d298bfb5c5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:22.545222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919280f-353b-4609-8307-d298bfb5c5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:22.545706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919280f-353b-4609-8307-d298bfb5c5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:22.546175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919280f-353b-4609-8307-d298bfb5c5f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:22.559664 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919280f-353b-4609-8307-d298bfb5c5f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-0919280f-353b-4609-8307-d298bfb5c5f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:22.572277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:22.573271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:22.574077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:22.574077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:22.574077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:22.574077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:22.574077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:22.574077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:22.574077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:22.574077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:22.574077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:22.574077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:22.574077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:22.574077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:22.577262 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 211/416] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:22.581189 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:22.584770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919280f-353b-4609-8307-d298bfb5c5f8 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:22.586697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad4488-35eb-47d8-b5f8-b5f47bb425ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:22.587579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4488-35eb-47d8-b5f8-b5f47bb425ce None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:22.587864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4488-35eb-47d8-b5f8-b5f47bb425ce None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:22.588141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4488-35eb-47d8-b5f8-b5f47bb425ce None admin] PATH_INFO: `/v3/projects/d20bec087d7d4867acdc2fcb7538cbf2` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:22.589404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad4488-35eb-47d8-b5f8-b5f47bb425ce None admin] RBAC: Authorizing `identity:get_project(project_id=d20bec087d7d4867acdc2fcb7538cbf2)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:22.590974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad4488-35eb-47d8-b5f8-b5f47bb425ce None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:22.592590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 206/417] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:22 2022] GET /identity/v3/projects/d20bec087d7d4867acdc2fcb7538cbf2 => generated 344 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:22.598217 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad4488-35eb-47d8-b5f8-b5f47bb425ce None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:22.702376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919280f-353b-4609-8307-d298bfb5c5f8 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:22.708842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad4488-35eb-47d8-b5f8-b5f47bb425ce None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:22.745463 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3787cc-ca64-43d8-9e8e-f8a115c6533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:22.746353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3787cc-ca64-43d8-9e8e-f8a115c6533d None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:22.746637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3787cc-ca64-43d8-9e8e-f8a115c6533d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:22.746919 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3787cc-ca64-43d8-9e8e-f8a115c6533d None admin] PATH_INFO: `/v3/projects/d20bec087d7d4867acdc2fcb7538cbf2/groups/6188b8c3aa14451c9f52e3e9b0253128/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:22.747161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30653f-8623-4df5-9708-9032c79a68e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:22.748062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30653f-8623-4df5-9708-9032c79a68e5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:22.748536 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30653f-8623-4df5-9708-9032c79a68e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:22.748876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3787cc-ca64-43d8-9e8e-f8a115c6533d None admin] RBAC: Authorizing `identity:create_grant(project_id=d20bec087d7d4867acdc2fcb7538cbf2, group_id=6188b8c3aa14451c9f52e3e9b0253128, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:22.749226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30653f-8623-4df5-9708-9032c79a68e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:22.750173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30653f-8623-4df5-9708-9032c79a68e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:22.750367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3787cc-ca64-43d8-9e8e-f8a115c6533d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:22.750870 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30653f-8623-4df5-9708-9032c79a68e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:22.752446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30653f-8623-4df5-9708-9032c79a68e5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:22.762785 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 212/418] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:22.770683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30653f-8623-4df5-9708-9032c79a68e5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:22.820171 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:22.835584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 207/419] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Jul 12 16:10:22 2022] PUT /identity/v3/projects/d20bec087d7d4867acdc2fcb7538cbf2/groups/6188b8c3aa14451c9f52e3e9b0253128/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:10:22.836658 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762653dd-8994-45c8-be48-63f545792576 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:22.836952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762653dd-8994-45c8-be48-63f545792576 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:22.837261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762653dd-8994-45c8-be48-63f545792576 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:22.838629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 208/420] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:22.846676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd86d3-de8c-45b1-9a1d-79487fe16606 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:22.846960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd86d3-de8c-45b1-9a1d-79487fe16606 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:22.847234 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd86d3-de8c-45b1-9a1d-79487fe16606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:22.902234 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-eebd86d3-de8c-45b1-9a1d-79487fe16606 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:22.903451 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-eebd86d3-de8c-45b1-9a1d-79487fe16606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:22.907264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30653f-8623-4df5-9708-9032c79a68e5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:22.951968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa17a65-5721-47ad-b6f4-7f0e6f97c74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:22.953181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa17a65-5721-47ad-b6f4-7f0e6f97c74f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:22.953674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa17a65-5721-47ad-b6f4-7f0e6f97c74f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:22.954146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa17a65-5721-47ad-b6f4-7f0e6f97c74f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:23.044863 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa17a65-5721-47ad-b6f4-7f0e6f97c74f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:23.046377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa17a65-5721-47ad-b6f4-7f0e6f97c74f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:23.057564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:23.080085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 209/421] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:23.106370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:23.112307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd86d3-de8c-45b1-9a1d-79487fe16606 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:23.174957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 213/422] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:23.182168 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa17a65-5721-47ad-b6f4-7f0e6f97c74f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:23.288877 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd86d3-de8c-45b1-9a1d-79487fe16606 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:23.333486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e037ef3-87d9-4597-9cb8-2f424a989183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:23.334539 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e037ef3-87d9-4597-9cb8-2f424a989183 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:23.334982 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e037ef3-87d9-4597-9cb8-2f424a989183 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:23.335390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e037ef3-87d9-4597-9cb8-2f424a989183 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:23.346355 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e037ef3-87d9-4597-9cb8-2f424a989183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-2e037ef3-87d9-4597-9cb8-2f424a989183 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:23.358550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:23.359687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:23.360698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:23.360698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:23.360698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:23.360698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:23.360698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:23.360698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:23.360698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:23.360698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:23.360698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:23.360698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:23.360698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:23.360698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:23.369615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 210/423] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:10:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:23.373227 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e037ef3-87d9-4597-9cb8-2f424a989183 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:23.412803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa17a65-5721-47ad-b6f4-7f0e6f97c74f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:23.461848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:23.473562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc326db2-8ed4-4e90-a400-4af4df54b238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:23.481962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc326db2-8ed4-4e90-a400-4af4df54b238 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:23.481962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc326db2-8ed4-4e90-a400-4af4df54b238 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:23.481962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc326db2-8ed4-4e90-a400-4af4df54b238 None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:23.481962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc326db2-8ed4-4e90-a400-4af4df54b238 None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:23.485143 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc326db2-8ed4-4e90-a400-4af4df54b238 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:23.490974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 214/424] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:23 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:23.492658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc326db2-8ed4-4e90-a400-4af4df54b238 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:23.523115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:23.548421 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e037ef3-87d9-4597-9cb8-2f424a989183 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:23.609277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112207b-3635-4978-a340-09eddf4a5888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:23.609953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112207b-3635-4978-a340-09eddf4a5888 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:23.610240 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112207b-3635-4978-a340-09eddf4a5888 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:23.610519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112207b-3635-4978-a340-09eddf4a5888 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:23.611269 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112207b-3635-4978-a340-09eddf4a5888 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:23.611584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112207b-3635-4978-a340-09eddf4a5888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:23.612969 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112207b-3635-4978-a340-09eddf4a5888 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:23.632817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 211/425] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:23.638640 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112207b-3635-4978-a340-09eddf4a5888 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:23.682375 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc326db2-8ed4-4e90-a400-4af4df54b238 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:23.728966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53774a54-1f87-4936-a6ed-bc2a3f2e9550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:23.730642 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53774a54-1f87-4936-a6ed-bc2a3f2e9550 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:23.731117 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53774a54-1f87-4936-a6ed-bc2a3f2e9550 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:23.731571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53774a54-1f87-4936-a6ed-bc2a3f2e9550 None admin] PATH_INFO: `/v3/groups/4335cfc382d449ca8dd8ce35932c651e` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:23.733147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53774a54-1f87-4936-a6ed-bc2a3f2e9550 None admin] RBAC: Authorizing `identity:get_group(group_id=4335cfc382d449ca8dd8ce35932c651e)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:23.734592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53774a54-1f87-4936-a6ed-bc2a3f2e9550 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:23.741662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 215/426] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:23 2022] GET /identity/v3/groups/4335cfc382d449ca8dd8ce35932c651e => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:23.741662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7ac4f-7dcf-4c51-9561-c75dd8738ffe None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:23.741662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7ac4f-7dcf-4c51-9561-c75dd8738ffe None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:23.741662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7ac4f-7dcf-4c51-9561-c75dd8738ffe None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:23.743928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 216/427] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:23.743928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7ac4f-7dcf-4c51-9561-c75dd8738ffe None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:23.771526 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112207b-3635-4978-a340-09eddf4a5888 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:23.785849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:23.814960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d830047-85ce-4f65-9dc1-d6091913b420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:23.815620 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830047-85ce-4f65-9dc1-d6091913b420 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:23.817100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830047-85ce-4f65-9dc1-d6091913b420 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:23.817785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830047-85ce-4f65-9dc1-d6091913b420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:23.861884 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:23.891172 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7ac4f-7dcf-4c51-9561-c75dd8738ffe None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:23.906947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d830047-85ce-4f65-9dc1-d6091913b420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:23.908666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d830047-85ce-4f65-9dc1-d6091913b420 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:23.927206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972e5b-cfad-4b43-af7b-325213d93379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:23.927862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972e5b-cfad-4b43-af7b-325213d93379 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:23.928148 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972e5b-cfad-4b43-af7b-325213d93379 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:23.928426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972e5b-cfad-4b43-af7b-325213d93379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:23.929520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972e5b-cfad-4b43-af7b-325213d93379 None admin] RBAC: Adding query filter params (group.id=4335cfc382d449ca8dd8ce35932c651e, role.id=1b578241384b4a3698242fde91cc1769, scope.project.id=504ceb17b43e4a218dd7fddd35a66432) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:23.929630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972e5b-cfad-4b43-af7b-325213d93379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:23.931193 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972e5b-cfad-4b43-af7b-325213d93379 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:23.941211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 217/428] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 16:10:23 2022] GET /identity/v3/role_assignments?group.id=4335cfc382d449ca8dd8ce35932c651e&scope.project.id=504ceb17b43e4a218dd7fddd35a66432&role.id=1b578241384b4a3698242fde91cc1769 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:23.941211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333b375-92f5-452b-853e-5ef2493b9efb None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:23.941211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333b375-92f5-452b-853e-5ef2493b9efb None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:23.941211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333b375-92f5-452b-853e-5ef2493b9efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:23.965696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-d333b375-92f5-452b-853e-5ef2493b9efb None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:23.966926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d333b375-92f5-452b-853e-5ef2493b9efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:24.053896 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 218/429] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:24.078712 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333b375-92f5-452b-853e-5ef2493b9efb None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:24.123643 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 212/430] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:24.129899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d830047-85ce-4f65-9dc1-d6091913b420 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:24.151173 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:24.179342 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:24.225843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333b375-92f5-452b-853e-5ef2493b9efb None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:24.271163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bad5f-5821-4dd3-a3dc-e20ad3bace0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:24.272133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bad5f-5821-4dd3-a3dc-e20ad3bace0b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:24.272519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bad5f-5821-4dd3-a3dc-e20ad3bace0b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:24.272855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bad5f-5821-4dd3-a3dc-e20ad3bace0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:24.286694 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bad5f-5821-4dd3-a3dc-e20ad3bace0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:24.287973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d830047-85ce-4f65-9dc1-d6091913b420 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-449bad5f-5821-4dd3-a3dc-e20ad3bace0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:24.296456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:24.297395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:24.298219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:24.298219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:24.298219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:24.298219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:24.298219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:24.298219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:24.298219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:24.298219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:24.298219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:24.298219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:24.298219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 16:10:24.298219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:24.298849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 219/431] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:24.305506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bad5f-5821-4dd3-a3dc-e20ad3bace0b None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:24.330811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffd7f9-21de-4489-b7a0-c44267eaa3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:24.332709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffd7f9-21de-4489-b7a0-c44267eaa3ba None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:24.335423 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffd7f9-21de-4489-b7a0-c44267eaa3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:24.335740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffd7f9-21de-4489-b7a0-c44267eaa3ba None admin] PATH_INFO: `/v3/projects/504ceb17b43e4a218dd7fddd35a66432` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:24.337030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffd7f9-21de-4489-b7a0-c44267eaa3ba None admin] RBAC: Authorizing `identity:get_project(project_id=504ceb17b43e4a218dd7fddd35a66432)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:24.339661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffd7f9-21de-4489-b7a0-c44267eaa3ba None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:24.342080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 213/432] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:24 2022] GET /identity/v3/projects/504ceb17b43e4a218dd7fddd35a66432 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:24.347941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffd7f9-21de-4489-b7a0-c44267eaa3ba None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:24.449271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bad5f-5821-4dd3-a3dc-e20ad3bace0b None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:24.468076 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:24.492479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffd7f9-21de-4489-b7a0-c44267eaa3ba None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:24.494037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5ee43-2573-4879-9035-6aa5e53ba482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:24.494717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5ee43-2573-4879-9035-6aa5e53ba482 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:24.495001 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5ee43-2573-4879-9035-6aa5e53ba482 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:24.495276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5ee43-2573-4879-9035-6aa5e53ba482 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:24.496025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5ee43-2573-4879-9035-6aa5e53ba482 None admin] RBAC: Adding query filter params (name=member) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:24.496343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5ee43-2573-4879-9035-6aa5e53ba482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:24.497791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5ee43-2573-4879-9035-6aa5e53ba482 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:24.499258 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:24.508490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 220/433] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:10:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:24.518108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5ee43-2573-4879-9035-6aa5e53ba482 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:24.532708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073b4fc-8e9f-4f4d-a2a7-956d8b035b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:24.533664 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073b4fc-8e9f-4f4d-a2a7-956d8b035b57 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:24.533954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073b4fc-8e9f-4f4d-a2a7-956d8b035b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:24.534246 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073b4fc-8e9f-4f4d-a2a7-956d8b035b57 None admin] PATH_INFO: `/v3/groups/4335cfc382d449ca8dd8ce35932c651e` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:24.536740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073b4fc-8e9f-4f4d-a2a7-956d8b035b57 None admin] RBAC: Authorizing `identity:get_group(group_id=4335cfc382d449ca8dd8ce35932c651e)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:24.538402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073b4fc-8e9f-4f4d-a2a7-956d8b035b57 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:24.540551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 214/434] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:24 2022] GET /identity/v3/groups/4335cfc382d449ca8dd8ce35932c651e => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:24.547694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073b4fc-8e9f-4f4d-a2a7-956d8b035b57 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:24.643077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5ee43-2573-4879-9035-6aa5e53ba482 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:24.658832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073b4fc-8e9f-4f4d-a2a7-956d8b035b57 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:24.681734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03265de-23ce-4d9e-af1b-8b38d32f5d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:24.682395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03265de-23ce-4d9e-af1b-8b38d32f5d19 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:24.682679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03265de-23ce-4d9e-af1b-8b38d32f5d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:24.682954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03265de-23ce-4d9e-af1b-8b38d32f5d19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:24.696705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4b1ac-6bdd-41c7-b9c8-74fe07ec98cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:24.697497 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4b1ac-6bdd-41c7-b9c8-74fe07ec98cb None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:24.697787 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4b1ac-6bdd-41c7-b9c8-74fe07ec98cb None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:24.698062 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4b1ac-6bdd-41c7-b9c8-74fe07ec98cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:24.698906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4b1ac-6bdd-41c7-b9c8-74fe07ec98cb None admin] RBAC: Adding query filter params (group.id=4335cfc382d449ca8dd8ce35932c651e, role.id=8eb72f5f99cf44e09c674c32be4bbb9d, scope.project.id=504ceb17b43e4a218dd7fddd35a66432) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:24.699218 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4b1ac-6bdd-41c7-b9c8-74fe07ec98cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:24.700886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4b1ac-6bdd-41c7-b9c8-74fe07ec98cb None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:24.709790 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 215/435] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 16:10:24 2022] GET /identity/v3/role_assignments?group.id=4335cfc382d449ca8dd8ce35932c651e&scope.project.id=504ceb17b43e4a218dd7fddd35a66432&role.id=8eb72f5f99cf44e09c674c32be4bbb9d => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:24.772609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:24.780986 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03265de-23ce-4d9e-af1b-8b38d32f5d19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:24.788070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03265de-23ce-4d9e-af1b-8b38d32f5d19 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:24.827821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d19460-3ea0-4e11-880a-4cc8f46d57d7 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:24.828452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d19460-3ea0-4e11-880a-4cc8f46d57d7 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:24.828452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d19460-3ea0-4e11-880a-4cc8f46d57d7 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:24.829807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 216/436] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:10:24.836187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089861d4-0247-44fa-98bc-fa5ca308e87f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:24.836476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089861d4-0247-44fa-98bc-fa5ca308e87f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:24.836737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089861d4-0247-44fa-98bc-fa5ca308e87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:24.862143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-089861d4-0247-44fa-98bc-fa5ca308e87f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:24.864003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-089861d4-0247-44fa-98bc-fa5ca308e87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:24.881524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:24.913040 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 221/437] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:24.920262 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03265de-23ce-4d9e-af1b-8b38d32f5d19 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:24.962160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 217/438] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:24.984851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089861d4-0247-44fa-98bc-fa5ca308e87f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:25.035501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:25.041408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03265de-23ce-4d9e-af1b-8b38d32f5d19 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:25.088406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7945a21-62c9-4113-ab78-72dd56eba6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:25.089305 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7945a21-62c9-4113-ab78-72dd56eba6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:25.089615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7945a21-62c9-4113-ab78-72dd56eba6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:25.089933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7945a21-62c9-4113-ab78-72dd56eba6d0 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:25.091227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7945a21-62c9-4113-ab78-72dd56eba6d0 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:25.093201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7945a21-62c9-4113-ab78-72dd56eba6d0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:25.094351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 222/439] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:24 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:25.100551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7945a21-62c9-4113-ab78-72dd56eba6d0 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:25.112011 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089861d4-0247-44fa-98bc-fa5ca308e87f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:25.159122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b4fb-4344-479d-843a-133bfd701bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:25.160271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b4fb-4344-479d-843a-133bfd701bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:25.160753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b4fb-4344-479d-843a-133bfd701bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:25.161060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b4fb-4344-479d-843a-133bfd701bc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:25.171989 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:25.173362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41b4fb-4344-479d-843a-133bfd701bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-9f41b4fb-4344-479d-843a-133bfd701bc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:25.181728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:25.194571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 218/440] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:10:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:25.195439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b4fb-4344-479d-843a-133bfd701bc0 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:25.234828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7945a21-62c9-4113-ab78-72dd56eba6d0 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:25.268425 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9f43f-ad95-46cc-8c23-3d666443655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:25.269315 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9f43f-ad95-46cc-8c23-3d666443655b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:25.269627 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9f43f-ad95-46cc-8c23-3d666443655b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:25.269904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9f43f-ad95-46cc-8c23-3d666443655b None admin] PATH_INFO: `/v3/groups/4335cfc382d449ca8dd8ce35932c651e` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:25.271091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9f43f-ad95-46cc-8c23-3d666443655b None admin] RBAC: Authorizing `identity:get_group(group_id=4335cfc382d449ca8dd8ce35932c651e)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:25.272538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9f43f-ad95-46cc-8c23-3d666443655b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:25.274348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 223/441] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:25 2022] GET /identity/v3/groups/4335cfc382d449ca8dd8ce35932c651e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:25.275332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5287886-e3bb-4f9c-9dd6-e1e5fd19f4ab None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:25.275617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5287886-e3bb-4f9c-9dd6-e1e5fd19f4ab None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:25.275893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5287886-e3bb-4f9c-9dd6-e1e5fd19f4ab None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:25.277105 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 224/442] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:25.280139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5287886-e3bb-4f9c-9dd6-e1e5fd19f4ab None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:25.302120 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b4fb-4344-479d-843a-133bfd701bc0 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:25.311471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:25.335955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98cf05-a00e-481b-bce1-d17139dd515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:25.336619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98cf05-a00e-481b-bce1-d17139dd515a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:25.336901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98cf05-a00e-481b-bce1-d17139dd515a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:25.337216 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98cf05-a00e-481b-bce1-d17139dd515a None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:25.337956 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98cf05-a00e-481b-bce1-d17139dd515a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:25.338264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98cf05-a00e-481b-bce1-d17139dd515a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:25.339637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98cf05-a00e-481b-bce1-d17139dd515a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:25.348226 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 219/443] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:25.349480 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81d314-c178-4e48-baad-a1c334ae746f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:25.349773 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81d314-c178-4e48-baad-a1c334ae746f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:25.350051 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81d314-c178-4e48-baad-a1c334ae746f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:25.366114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-3f81d314-c178-4e48-baad-a1c334ae746f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:25.367288 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3f81d314-c178-4e48-baad-a1c334ae746f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:25.382569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5287886-e3bb-4f9c-9dd6-e1e5fd19f4ab None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:25.417877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500627c-d87b-4bff-a386-727fd9f94a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:25.418526 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500627c-d87b-4bff-a386-727fd9f94a10 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:25.418814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500627c-d87b-4bff-a386-727fd9f94a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:25.419092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500627c-d87b-4bff-a386-727fd9f94a10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:25.419914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500627c-d87b-4bff-a386-727fd9f94a10 None admin] RBAC: Adding query filter params (group.id=4335cfc382d449ca8dd8ce35932c651e, role.id=1b578241384b4a3698242fde91cc1769, scope.project.id=9140784043094850b716a45f8a921768) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:25.420226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500627c-d87b-4bff-a386-727fd9f94a10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:25.421692 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500627c-d87b-4bff-a386-727fd9f94a10 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:25.421836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:25.428376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 225/444] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 16:10:25 2022] GET /identity/v3/role_assignments?group.id=4335cfc382d449ca8dd8ce35932c651e&scope.project.id=9140784043094850b716a45f8a921768&role.id=1b578241384b4a3698242fde91cc1769 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:25.428927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500627c-d87b-4bff-a386-727fd9f94a10 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:25.442623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 220/445] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:25.468977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81d314-c178-4e48-baad-a1c334ae746f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:25.544001 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:25.549976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500627c-d87b-4bff-a386-727fd9f94a10 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:25.586129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81d314-c178-4e48-baad-a1c334ae746f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:25.591248 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd082bd-de79-45e7-9bdf-955757926184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:25.591248 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd082bd-de79-45e7-9bdf-955757926184 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:25.591248 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd082bd-de79-45e7-9bdf-955757926184 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:25.591526 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd082bd-de79-45e7-9bdf-955757926184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:25.630013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7d7cb-9893-4f77-8224-3619ad5ea133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:25.631601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7d7cb-9893-4f77-8224-3619ad5ea133 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:25.631888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7d7cb-9893-4f77-8224-3619ad5ea133 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:25.632169 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7d7cb-9893-4f77-8224-3619ad5ea133 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:25.643798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7d7cb-9893-4f77-8224-3619ad5ea133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-bab7d7cb-9893-4f77-8224-3619ad5ea133 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:25.652104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:25.653213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:25.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:25.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:25.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:25.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:25.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:25.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:25.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:25.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:25.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:25.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:25.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:25.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:25.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 221/446] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:10:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:25.661548 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7d7cb-9893-4f77-8224-3619ad5ea133 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:25.668255 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd082bd-de79-45e7-9bdf-955757926184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:25.669768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd082bd-de79-45e7-9bdf-955757926184 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:25.723567 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:25.776967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:25.779262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7d7cb-9893-4f77-8224-3619ad5ea133 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:25.784296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 226/447] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:25.791227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd082bd-de79-45e7-9bdf-955757926184 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:25.821811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df489ad-2b46-4557-858c-792433e60381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:25.822576 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df489ad-2b46-4557-858c-792433e60381 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:25.822865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df489ad-2b46-4557-858c-792433e60381 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:25.823141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df489ad-2b46-4557-858c-792433e60381 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:25.823918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df489ad-2b46-4557-858c-792433e60381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:25.824225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df489ad-2b46-4557-858c-792433e60381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:25.825710 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df489ad-2b46-4557-858c-792433e60381 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:25.833723 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 222/448] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:25.839131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df489ad-2b46-4557-858c-792433e60381 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:25.890181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd082bd-de79-45e7-9bdf-955757926184 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:25.923722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cce911-02e9-4190-92a8-77f98bbe66f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:25.924602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cce911-02e9-4190-92a8-77f98bbe66f1 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:25.924881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cce911-02e9-4190-92a8-77f98bbe66f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:25.925176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cce911-02e9-4190-92a8-77f98bbe66f1 None admin] PATH_INFO: `/v3/projects/9140784043094850b716a45f8a921768` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:25.926941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cce911-02e9-4190-92a8-77f98bbe66f1 None admin] RBAC: Authorizing `identity:get_project(project_id=9140784043094850b716a45f8a921768)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:25.928375 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cce911-02e9-4190-92a8-77f98bbe66f1 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:25.930228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 227/449] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:25 2022] GET /identity/v3/projects/9140784043094850b716a45f8a921768 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:25.935432 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cce911-02e9-4190-92a8-77f98bbe66f1 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:25.940886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df489ad-2b46-4557-858c-792433e60381 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:25.954092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:25.973484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c949dcf-64c6-4391-9989-b3eb2ab3d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:25.974181 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c949dcf-64c6-4391-9989-b3eb2ab3d8ef None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:25.974409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c949dcf-64c6-4391-9989-b3eb2ab3d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:25.974679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c949dcf-64c6-4391-9989-b3eb2ab3d8ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:25.995345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:26.033850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cce911-02e9-4190-92a8-77f98bbe66f1 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:26.040782 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c949dcf-64c6-4391-9989-b3eb2ab3d8ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:26.042272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c949dcf-64c6-4391-9989-b3eb2ab3d8ef None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:26.067194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea59ea-4bc7-4419-b7eb-783489fdd827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:26.068046 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea59ea-4bc7-4419-b7eb-783489fdd827 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:26.068334 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea59ea-4bc7-4419-b7eb-783489fdd827 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:26.068605 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea59ea-4bc7-4419-b7eb-783489fdd827 None admin] PATH_INFO: `/v3/groups/4335cfc382d449ca8dd8ce35932c651e` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:26.069806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea59ea-4bc7-4419-b7eb-783489fdd827 None admin] RBAC: Authorizing `identity:get_group(group_id=4335cfc382d449ca8dd8ce35932c651e)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:26.071236 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea59ea-4bc7-4419-b7eb-783489fdd827 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:26.072855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 228/450] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:25 2022] GET /identity/v3/groups/4335cfc382d449ca8dd8ce35932c651e => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:26.078484 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea59ea-4bc7-4419-b7eb-783489fdd827 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:26.139990 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 223/451] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 16:10:26.145953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c949dcf-64c6-4391-9989-b3eb2ab3d8ef None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:26.160769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:26.179009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea59ea-4bc7-4419-b7eb-783489fdd827 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:26.208729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:26.213589 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dff36-8e7e-4a4a-a9a7-f64edc8390d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:26.214237 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dff36-8e7e-4a4a-a9a7-f64edc8390d7 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:26.214525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dff36-8e7e-4a4a-a9a7-f64edc8390d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:26.214811 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dff36-8e7e-4a4a-a9a7-f64edc8390d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:26.215647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dff36-8e7e-4a4a-a9a7-f64edc8390d7 None admin] RBAC: Adding query filter params (group.id=4335cfc382d449ca8dd8ce35932c651e, role.id=8eb72f5f99cf44e09c674c32be4bbb9d, scope.project.id=9140784043094850b716a45f8a921768) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:26.215965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dff36-8e7e-4a4a-a9a7-f64edc8390d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:26.217432 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dff36-8e7e-4a4a-a9a7-f64edc8390d7 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:26.223197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 229/452] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 16:10:26 2022] GET /identity/v3/role_assignments?group.id=4335cfc382d449ca8dd8ce35932c651e&scope.project.id=9140784043094850b716a45f8a921768&role.id=8eb72f5f99cf44e09c674c32be4bbb9d => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:26.244425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c949dcf-64c6-4391-9989-b3eb2ab3d8ef None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:26.281144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae4555-50e1-4b57-8780-3ce47681c058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:26.282036 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae4555-50e1-4b57-8780-3ce47681c058 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:26.282324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae4555-50e1-4b57-8780-3ce47681c058 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:26.282604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae4555-50e1-4b57-8780-3ce47681c058 None admin] PATH_INFO: `/v3/projects/d20bec087d7d4867acdc2fcb7538cbf2` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:26.283818 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae4555-50e1-4b57-8780-3ce47681c058 None admin] RBAC: Authorizing `identity:get_project(project_id=d20bec087d7d4867acdc2fcb7538cbf2)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:26.285363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae4555-50e1-4b57-8780-3ce47681c058 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:26.287190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 224/453] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:10:26 2022] GET /identity/v3/projects/d20bec087d7d4867acdc2fcb7538cbf2 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:26.292798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dff36-8e7e-4a4a-a9a7-f64edc8390d7 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:26.395341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dff36-8e7e-4a4a-a9a7-f64edc8390d7 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:26.428381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144500cd-91d0-4fe0-9c4f-7584c5e6d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:26.429270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144500cd-91d0-4fe0-9c4f-7584c5e6d77b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:26.429549 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144500cd-91d0-4fe0-9c4f-7584c5e6d77b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:26.429817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144500cd-91d0-4fe0-9c4f-7584c5e6d77b None admin] PATH_INFO: `/v3/groups/6188b8c3aa14451c9f52e3e9b0253128` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:26.430968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144500cd-91d0-4fe0-9c4f-7584c5e6d77b None admin] RBAC: Authorizing `identity:get_group(group_id=6188b8c3aa14451c9f52e3e9b0253128)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:26.432405 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144500cd-91d0-4fe0-9c4f-7584c5e6d77b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:26.434339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 230/454] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 16:10:26 2022] GET /identity/v3/groups/6188b8c3aa14451c9f52e3e9b0253128 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:26.440360 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae4555-50e1-4b57-8780-3ce47681c058 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:26.524500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:26.542516 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae4555-50e1-4b57-8780-3ce47681c058 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:26.578294 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07e9ad-b570-458c-bfcb-954288e5fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:26.578979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07e9ad-b570-458c-bfcb-954288e5fbdd None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:26.579265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07e9ad-b570-458c-bfcb-954288e5fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:26.579546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07e9ad-b570-458c-bfcb-954288e5fbdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:26.580378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07e9ad-b570-458c-bfcb-954288e5fbdd None admin] RBAC: Adding query filter params (group.id=6188b8c3aa14451c9f52e3e9b0253128, role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=d20bec087d7d4867acdc2fcb7538cbf2) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:26.580691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07e9ad-b570-458c-bfcb-954288e5fbdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:26.582682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07e9ad-b570-458c-bfcb-954288e5fbdd None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:26.588391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 225/455] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 16:10:26 2022] GET /identity/v3/role_assignments?group.id=6188b8c3aa14451c9f52e3e9b0253128&scope.project.id=d20bec087d7d4867acdc2fcb7538cbf2&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:29.141826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011f9f0-2b6a-4fa1-87e0-2c82b31613a3 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:29.142843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011f9f0-2b6a-4fa1-87e0-2c82b31613a3 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:29.143361 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011f9f0-2b6a-4fa1-87e0-2c82b31613a3 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:29.145786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 231/456] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:29.151707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f52c93-8b76-41c7-b558-d40dd9048af8 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:29.152530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f52c93-8b76-41c7-b558-d40dd9048af8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:29.153014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f52c93-8b76-41c7-b558-d40dd9048af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:29.173613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-73f52c93-8b76-41c7-b558-d40dd9048af8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:29.175131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-73f52c93-8b76-41c7-b558-d40dd9048af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:29.194081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16af5-abfa-4624-9ed0-f4e368fa2894 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:29.194673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16af5-abfa-4624-9ed0-f4e368fa2894 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:29.195180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16af5-abfa-4624-9ed0-f4e368fa2894 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:29.196990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 232/457] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:29.201900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ace1a-202e-4571-8b6c-bd740569489a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:29.202445 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ace1a-202e-4571-8b6c-bd740569489a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:29.203084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ace1a-202e-4571-8b6c-bd740569489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:29.226793 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-d61ace1a-202e-4571-8b6c-bd740569489a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:29.229086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d61ace1a-202e-4571-8b6c-bd740569489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:29.317228 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 226/458] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:10:29.324449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:29.332453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 233/459] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:29.349694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f52c93-8b76-41c7-b558-d40dd9048af8 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:29.360533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ace1a-202e-4571-8b6c-bd740569489a None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:29.445983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:29.479487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f52c93-8b76-41c7-b558-d40dd9048af8 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:29.516560 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352db881-df0d-4f1b-bc39-b342f3045301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:29.517696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352db881-df0d-4f1b-bc39-b342f3045301 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:29.518168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352db881-df0d-4f1b-bc39-b342f3045301 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:29.518651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352db881-df0d-4f1b-bc39-b342f3045301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:29.519684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ace1a-202e-4571-8b6c-bd740569489a None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:29.529699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352db881-df0d-4f1b-bc39-b342f3045301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:29.531394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352db881-df0d-4f1b-bc39-b342f3045301 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-352db881-df0d-4f1b-bc39-b342f3045301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:29.551695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:29.552607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:29.553509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:29.553509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:29.553509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:29.553509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:29.555732 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 227/460] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:29.557214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d5d11-7824-4319-aba1-c736616ca904 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:29.557715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d5d11-7824-4319-aba1-c736616ca904 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:29.558211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d5d11-7824-4319-aba1-c736616ca904 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:29.559543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be424bb1-63e0-4817-b4bf-2c7cf97adcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:29.563871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be424bb1-63e0-4817-b4bf-2c7cf97adcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:29.563871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be424bb1-63e0-4817-b4bf-2c7cf97adcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:29.563871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be424bb1-63e0-4817-b4bf-2c7cf97adcb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:29.564262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 228/461] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:29.565478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d5d11-7824-4319-aba1-c736616ca904 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:29.574276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be424bb1-63e0-4817-b4bf-2c7cf97adcb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:29.576388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be424bb1-63e0-4817-b4bf-2c7cf97adcb4 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-be424bb1-63e0-4817-b4bf-2c7cf97adcb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:29.602235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:29.603200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:29.604059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:29.604059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:29.604059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:29.604059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:29.604059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 234/462] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:29.611106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a829469-bf10-4c63-aacd-dc28acb8bf44 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:29.611475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a829469-bf10-4c63-aacd-dc28acb8bf44 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:29.611821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a829469-bf10-4c63-aacd-dc28acb8bf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:29.634839 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-0a829469-bf10-4c63-aacd-dc28acb8bf44 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:29.636374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0a829469-bf10-4c63-aacd-dc28acb8bf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:29.683209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:29.699568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d5d11-7824-4319-aba1-c736616ca904 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:29.716489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 235/463] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:29.717940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a829469-bf10-4c63-aacd-dc28acb8bf44 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:29.750448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:29.759178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a43d33-f51e-4009-85f0-844c5ef1a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:29.760041 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a43d33-f51e-4009-85f0-844c5ef1a95e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:29.760502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a43d33-f51e-4009-85f0-844c5ef1a95e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:29.766835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a43d33-f51e-4009-85f0-844c5ef1a95e None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:29.766835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a43d33-f51e-4009-85f0-844c5ef1a95e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:29.766835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a43d33-f51e-4009-85f0-844c5ef1a95e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:29.766835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a43d33-f51e-4009-85f0-844c5ef1a95e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:29.775476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 229/464] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:29.776568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a43d33-f51e-4009-85f0-844c5ef1a95e None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:29.845856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a829469-bf10-4c63-aacd-dc28acb8bf44 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:29.885711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8a323-084a-4dea-9c6b-7aa5715a3933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:29.886385 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8a323-084a-4dea-9c6b-7aa5715a3933 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:29.886671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8a323-084a-4dea-9c6b-7aa5715a3933 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:29.886946 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8a323-084a-4dea-9c6b-7aa5715a3933 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:29.887670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8a323-084a-4dea-9c6b-7aa5715a3933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:29.888247 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8a323-084a-4dea-9c6b-7aa5715a3933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:29.889395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8a323-084a-4dea-9c6b-7aa5715a3933 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:29.891280 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a43d33-f51e-4009-85f0-844c5ef1a95e None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:29.905515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 236/465] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:29.905515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8a323-084a-4dea-9c6b-7aa5715a3933 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:29.935614 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cfdb7-9aeb-416f-b053-7b0f5f03749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:29.936517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cfdb7-9aeb-416f-b053-7b0f5f03749a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:29.936981 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cfdb7-9aeb-416f-b053-7b0f5f03749a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:29.937296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cfdb7-9aeb-416f-b053-7b0f5f03749a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:29.940160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:29.949964 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cfdb7-9aeb-416f-b053-7b0f5f03749a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:29.951681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cfdb7-9aeb-416f-b053-7b0f5f03749a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-920cfdb7-9aeb-416f-b053-7b0f5f03749a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:29.970565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:29.971667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:29.973352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:29.973352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:29.973352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:29.973352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:29.973352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 230/466] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:29.973700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d4a7e-ee27-49a2-ae0c-0f950d8ad71c None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:29.978449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d4a7e-ee27-49a2-ae0c-0f950d8ad71c None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:29.978449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d4a7e-ee27-49a2-ae0c-0f950d8ad71c None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:29.978449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 231/467] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:29.978449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d4a7e-ee27-49a2-ae0c-0f950d8ad71c None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:30.016866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8a323-084a-4dea-9c6b-7aa5715a3933 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:30.024541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:30.056072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24db55-603a-4b55-962f-473e8fd1bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:30.056753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24db55-603a-4b55-962f-473e8fd1bcf5 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:30.057038 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24db55-603a-4b55-962f-473e8fd1bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:30.057348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24db55-603a-4b55-962f-473e8fd1bcf5 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:30.058060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24db55-603a-4b55-962f-473e8fd1bcf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:30.059500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24db55-603a-4b55-962f-473e8fd1bcf5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:30.088544 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d4a7e-ee27-49a2-ae0c-0f950d8ad71c None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:30.122227 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c33d3-40cc-4725-a940-b20870e433b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:30.122925 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c33d3-40cc-4725-a940-b20870e433b4 None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:30.123215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c33d3-40cc-4725-a940-b20870e433b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:30.123495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c33d3-40cc-4725-a940-b20870e433b4 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:30.124204 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c33d3-40cc-4725-a940-b20870e433b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:30.125733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c33d3-40cc-4725-a940-b20870e433b4 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:30.154370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 237/468] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:10:29 2022] POST /identity/v3/users => generated 246 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:10:30.155201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24db55-603a-4b55-962f-473e8fd1bcf5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:30.229357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 232/469] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:10:29 2022] POST /identity/v3/users => generated 248 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:10:30.231443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29eaae5-2aee-4792-a3a7-4293a48b920e None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:30.232097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29eaae5-2aee-4792-a3a7-4293a48b920e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:30.232878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29eaae5-2aee-4792-a3a7-4293a48b920e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:30.258504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e29eaae5-2aee-4792-a3a7-4293a48b920e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:30.260308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e29eaae5-2aee-4792-a3a7-4293a48b920e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:30.308234 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:30.325518 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24db55-603a-4b55-962f-473e8fd1bcf5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:30.359192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 233/470] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:30.371368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8b477-4f58-428a-ac4c-aefce4751b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:30.372410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8b477-4f58-428a-ac4c-aefce4751b50 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:30.373063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8b477-4f58-428a-ac4c-aefce4751b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:30.373792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8b477-4f58-428a-ac4c-aefce4751b50 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:30.374817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8b477-4f58-428a-ac4c-aefce4751b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:30.375321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8b477-4f58-428a-ac4c-aefce4751b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:30.378345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8b477-4f58-428a-ac4c-aefce4751b50 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:30.383153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34954fc-f89a-4a31-be29-35af52a1ea3e None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:30.384386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34954fc-f89a-4a31-be29-35af52a1ea3e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:30.384870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34954fc-f89a-4a31-be29-35af52a1ea3e None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:30.386810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 234/471] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:30.387904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34954fc-f89a-4a31-be29-35af52a1ea3e None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:30.400659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 238/472] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:30.400659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825574c2-fcfe-41d9-ab16-f05f66ec20c8 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:30.400659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825574c2-fcfe-41d9-ab16-f05f66ec20c8 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:30.400659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825574c2-fcfe-41d9-ab16-f05f66ec20c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:30.421437 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-825574c2-fcfe-41d9-ab16-f05f66ec20c8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:30.422523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-825574c2-fcfe-41d9-ab16-f05f66ec20c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:30.425721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:30.511300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 239/473] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:30.512426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825574c2-fcfe-41d9-ab16-f05f66ec20c8 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:30.531289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34954fc-f89a-4a31-be29-35af52a1ea3e None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:30.576250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2e688-a0c4-4027-be1c-f61234203552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:30.577047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2e688-a0c4-4027-be1c-f61234203552 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:30.577363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2e688-a0c4-4027-be1c-f61234203552 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:30.577640 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2e688-a0c4-4027-be1c-f61234203552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:30.588183 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2e688-a0c4-4027-be1c-f61234203552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:30.589707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2e688-a0c4-4027-be1c-f61234203552 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-c3b2e688-a0c4-4027-be1c-f61234203552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:30.609945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:30.610876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:30.611796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:30.611796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:30.611796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:30.611796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:30.616498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 235/474] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:30.617369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2e688-a0c4-4027-be1c-f61234203552 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:30.619107 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:30.639973 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825574c2-fcfe-41d9-ab16-f05f66ec20c8 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:30.678517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234afd-d75e-4353-b48d-847f9f994a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:30.679557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234afd-d75e-4353-b48d-847f9f994a70 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:30.680052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234afd-d75e-4353-b48d-847f9f994a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:30.680508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234afd-d75e-4353-b48d-847f9f994a70 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:30.681581 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb234afd-d75e-4353-b48d-847f9f994a70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:30.683210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb234afd-d75e-4353-b48d-847f9f994a70 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:30.699415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:30.722278 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2e688-a0c4-4027-be1c-f61234203552 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:30.759173 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee24a5-8b3a-44f2-a183-1cb12a4eeb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:30.759819 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee24a5-8b3a-44f2-a183-1cb12a4eeb67 None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:30.760109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee24a5-8b3a-44f2-a183-1cb12a4eeb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:30.760390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee24a5-8b3a-44f2-a183-1cb12a4eeb67 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:30.761164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee24a5-8b3a-44f2-a183-1cb12a4eeb67 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:30.762590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee24a5-8b3a-44f2-a183-1cb12a4eeb67 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:30.801259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 240/475] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:10:30 2022] POST /identity/v3/users => generated 248 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:10:30.801259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234afd-d75e-4353-b48d-847f9f994a70 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:30.818358 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.sql.core [None req-03ee24a5-8b3a-44f2-a183-1cb12a4eeb67 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 16:10:30.818358 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 16:10:30.818358 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [parameters: {'id': 'b22de178b6fc4642a7d6ef590896275e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 16:10:30.818358 dv-cinder-797608-56-smb devstack@keystone.service[80379]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80379) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-03ee24a5-8b3a-44f2-a183-1cb12a4eeb67 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application conn.query(q) Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application result.read() Jul 12 16:10:30.843405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return ref.to_dict() Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 16:10:30.844361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application next(self.gen) Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application yield resource Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application next(self.gen) Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise self.value Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application session.commit() Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 16:10:30.845351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self.session.flush() Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application compat.raise_( Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 16:10:30.846870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 16:10:30.847826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application conn.query(q) Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application result.read() Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 16:10:30.848694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [parameters: {'id': 'b22de178b6fc4642a7d6ef590896275e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:30.850201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 16:10:30.851229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:30.852280 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 236/476] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Jul 12 16:10:30 2022] POST /identity/v3/roles => generated 144 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:30.856298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee24a5-8b3a-44f2-a183-1cb12a4eeb67 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:30.965751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234afd-d75e-4353-b48d-847f9f994a70 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:31.037178 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce8045-c149-4036-b9f5-50c7f84dccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:31.038441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce8045-c149-4036-b9f5-50c7f84dccf2 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:31.038931 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce8045-c149-4036-b9f5-50c7f84dccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:31.039443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce8045-c149-4036-b9f5-50c7f84dccf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:31.041006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce8045-c149-4036-b9f5-50c7f84dccf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:31.041815 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce8045-c149-4036-b9f5-50c7f84dccf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:31.044085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce8045-c149-4036-b9f5-50c7f84dccf2 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:31.050196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee24a5-8b3a-44f2-a183-1cb12a4eeb67 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:31.054209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:31.069363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 241/477] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:31.072584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce8045-c149-4036-b9f5-50c7f84dccf2 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:31.095601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8419f-fd92-48c4-a450-6bf63abb1c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:31.097642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8419f-fd92-48c4-a450-6bf63abb1c6c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:31.098137 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8419f-fd92-48c4-a450-6bf63abb1c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:31.098728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8419f-fd92-48c4-a450-6bf63abb1c6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:31.109935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8419f-fd92-48c4-a450-6bf63abb1c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-04b8419f-fd92-48c4-a450-6bf63abb1c6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:31.118705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:31.119628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:31.120435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:31.120435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:31.120435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:31.120435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:31.120435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:31.120435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:31.120435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:31.120435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:31.120435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:31.120435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:31.120435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 16:10:31.120435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:31.123203 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 237/478] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:10:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:31.130564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8419f-fd92-48c4-a450-6bf63abb1c6c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:31.135294 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:31.187657 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce8045-c149-4036-b9f5-50c7f84dccf2 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:31.225047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a865bc6-6d6a-42fc-ad19-73e687ae9c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:31.225768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a865bc6-6d6a-42fc-ad19-73e687ae9c97 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:31.226055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a865bc6-6d6a-42fc-ad19-73e687ae9c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:31.226333 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a865bc6-6d6a-42fc-ad19-73e687ae9c97 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:31.227130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a865bc6-6d6a-42fc-ad19-73e687ae9c97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:31.228478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a865bc6-6d6a-42fc-ad19-73e687ae9c97 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:31.249135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8419f-fd92-48c4-a450-6bf63abb1c6c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:31.284143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebe677-cee9-4adb-b022-760ff5fa3a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:31.285644 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebe677-cee9-4adb-b022-760ff5fa3a2e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:31.286083 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebe677-cee9-4adb-b022-760ff5fa3a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:31.286507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebe677-cee9-4adb-b022-760ff5fa3a2e None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:31.287538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebe677-cee9-4adb-b022-760ff5fa3a2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:31.288006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebe677-cee9-4adb-b022-760ff5fa3a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:31.289557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebe677-cee9-4adb-b022-760ff5fa3a2e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:31.298309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 238/479] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:31.321402 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 242/480] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:10:31 2022] POST /identity/v3/users => generated 249 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:10:32.426658 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a96302-b06e-4350-a02c-e9430a1cb4a2 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:32.427178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a96302-b06e-4350-a02c-e9430a1cb4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:32.427254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a96302-b06e-4350-a02c-e9430a1cb4a2 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:32.428873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 239/481] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:32.434264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e572c-d867-4d7c-b09d-678cc0e3768f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:32.434719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e572c-d867-4d7c-b09d-678cc0e3768f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:32.434886 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e572c-d867-4d7c-b09d-678cc0e3768f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:32.476623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-d81e572c-d867-4d7c-b09d-678cc0e3768f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:32.477857 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d81e572c-d867-4d7c-b09d-678cc0e3768f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:32.547159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:32.571810 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 243/482] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:10:32.604241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a96302-b06e-4350-a02c-e9430a1cb4a2 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:32.715370 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:32.791742 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a96302-b06e-4350-a02c-e9430a1cb4a2 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:32.835520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fc2e9-144f-44a1-9f5a-2d04551203e9 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:32.835837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fc2e9-144f-44a1-9f5a-2d04551203e9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:32.836447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fc2e9-144f-44a1-9f5a-2d04551203e9 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:32.839630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 244/483] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:32.839736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82c738-70b6-4655-809b-14b37794736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:32.839736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c738-70b6-4655-809b-14b37794736c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:32.839736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c738-70b6-4655-809b-14b37794736c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:32.839736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c738-70b6-4655-809b-14b37794736c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:32.846301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c9354-2039-46c8-bed6-8fb138f75f57 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:32.846590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c9354-2039-46c8-bed6-8fb138f75f57 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:32.846871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c9354-2039-46c8-bed6-8fb138f75f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:32.851134 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82c738-70b6-4655-809b-14b37794736c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-3b82c738-70b6-4655-809b-14b37794736c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:32.859341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:32.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:32.861054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:32.861054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:32.861054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:32.861054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:32.861054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:32.861054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:32.861054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:32.861054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:32.861054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:32.861054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:32.861054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:32.861054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:32.863830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 240/484] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:32.869284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82c738-70b6-4655-809b-14b37794736c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:32.876162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e09c9354-2039-46c8-bed6-8fb138f75f57 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:32.877941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e09c9354-2039-46c8-bed6-8fb138f75f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:33.015791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 245/485] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:33.029503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82c738-70b6-4655-809b-14b37794736c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:33.040149 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c9354-2039-46c8-bed6-8fb138f75f57 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:33.057839 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:33.081815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62415858-435a-4ef8-a378-e1ab0f379574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:33.082484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415858-435a-4ef8-a378-e1ab0f379574 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:33.082767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415858-435a-4ef8-a378-e1ab0f379574 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:33.083038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415858-435a-4ef8-a378-e1ab0f379574 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:33.083785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62415858-435a-4ef8-a378-e1ab0f379574 None admin] RBAC: Adding query filter params (name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:33.084141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62415858-435a-4ef8-a378-e1ab0f379574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:33.086350 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62415858-435a-4ef8-a378-e1ab0f379574 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:33.106755 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 241/486] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:33.112668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62415858-435a-4ef8-a378-e1ab0f379574 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:33.215052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c9354-2039-46c8-bed6-8fb138f75f57 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:33.245499 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:33.282495 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36eb2d-54ec-480e-8147-c350871ea8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:33.282495 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36eb2d-54ec-480e-8147-c350871ea8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:33.282495 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36eb2d-54ec-480e-8147-c350871ea8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:33.282495 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36eb2d-54ec-480e-8147-c350871ea8e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:33.299467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62415858-435a-4ef8-a378-e1ab0f379574 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:33.311183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36eb2d-54ec-480e-8147-c350871ea8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-ff36eb2d-54ec-480e-8147-c350871ea8e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:33.319865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:33.320770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:33.321609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:33.321609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:33.321609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:33.321609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:33.321609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:33.321609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:33.321609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:33.321609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:33.321609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:33.321609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:33.321609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:33.321609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:33.321609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 246/487] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:33.326758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36eb2d-54ec-480e-8147-c350871ea8e9 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:33.371995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532525f2-fab4-4ba5-bf59-10f684b6763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:33.372797 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532525f2-fab4-4ba5-bf59-10f684b6763e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:33.373083 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532525f2-fab4-4ba5-bf59-10f684b6763e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:33.373395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532525f2-fab4-4ba5-bf59-10f684b6763e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:33.391793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532525f2-fab4-4ba5-bf59-10f684b6763e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:33.395381 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532525f2-fab4-4ba5-bf59-10f684b6763e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-532525f2-fab4-4ba5-bf59-10f684b6763e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:33.429387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:33.432042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:33.434206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:33.434206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:33.434206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:33.434206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:33.434206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 242/488] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:33.437141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532525f2-fab4-4ba5-bf59-10f684b6763e None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:33.525461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:33.529350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36eb2d-54ec-480e-8147-c350871ea8e9 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:33.571290 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57f0a1-1299-4c43-8f96-8982d78bfb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:33.571974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57f0a1-1299-4c43-8f96-8982d78bfb16 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:33.572261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57f0a1-1299-4c43-8f96-8982d78bfb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:33.572541 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57f0a1-1299-4c43-8f96-8982d78bfb16 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:33.573335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57f0a1-1299-4c43-8f96-8982d78bfb16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:33.573706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57f0a1-1299-4c43-8f96-8982d78bfb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:33.575171 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57f0a1-1299-4c43-8f96-8982d78bfb16 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:33.585818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 247/489] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:33.590745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57f0a1-1299-4c43-8f96-8982d78bfb16 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:33.628974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532525f2-fab4-4ba5-bf59-10f684b6763e None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:33.633416 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:33.708013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb86f8-da39-4778-a7d3-4de61031226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:33.708681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb86f8-da39-4778-a7d3-4de61031226d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:33.708967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb86f8-da39-4778-a7d3-4de61031226d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:33.709277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb86f8-da39-4778-a7d3-4de61031226d None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:33.710014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb86f8-da39-4778-a7d3-4de61031226d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:33.710314 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb86f8-da39-4778-a7d3-4de61031226d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:33.711683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb86f8-da39-4778-a7d3-4de61031226d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:33.714542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57f0a1-1299-4c43-8f96-8982d78bfb16 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:33.730418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 243/490] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:33.731890 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61152-d7de-4357-a464-d797cc28ebe5 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:33.732178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61152-d7de-4357-a464-d797cc28ebe5 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:33.732458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61152-d7de-4357-a464-d797cc28ebe5 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:33.735058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 244/491] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:33.735835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61152-d7de-4357-a464-d797cc28ebe5 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:33.768314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b6a2-5460-4ed9-bd76-59d6091f0e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:33.769403 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b6a2-5460-4ed9-bd76-59d6091f0e27 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:33.770089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b6a2-5460-4ed9-bd76-59d6091f0e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:33.770364 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b6a2-5460-4ed9-bd76-59d6091f0e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:33.783199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3b6a2-5460-4ed9-bd76-59d6091f0e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:33.785214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3b6a2-5460-4ed9-bd76-59d6091f0e27 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-78a3b6a2-5460-4ed9-bd76-59d6091f0e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:33.809734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:33.810628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:33.811569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:33.811569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:33.811569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:33.811569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:33.813199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 248/492] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:33.814786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370a9c2-345b-4aaa-a867-6306bc6f3d79 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:33.815069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370a9c2-345b-4aaa-a867-6306bc6f3d79 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:33.815340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370a9c2-345b-4aaa-a867-6306bc6f3d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:33.839387 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-2370a9c2-345b-4aaa-a867-6306bc6f3d79 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:33.841069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-2370a9c2-345b-4aaa-a867-6306bc6f3d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:33.849145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:33.853881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61152-d7de-4357-a464-d797cc28ebe5 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:33.890114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e414648-4c86-475f-b2e4-0c737aa8491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:33.890896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e414648-4c86-475f-b2e4-0c737aa8491f None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:33.891180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e414648-4c86-475f-b2e4-0c737aa8491f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:33.891457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e414648-4c86-475f-b2e4-0c737aa8491f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:33.899159 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e414648-4c86-475f-b2e4-0c737aa8491f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:33.900617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e414648-4c86-475f-b2e4-0c737aa8491f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-0e414648-4c86-475f-b2e4-0c737aa8491f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:33.916098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:33.917046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:33.917994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:33.917994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:33.917994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:33.917994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:33.917994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:33.917994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:33.917994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:33.917994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:33.917994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:10:33.917994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:33.917994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 245/493] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 16:10:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:33.918573 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e414648-4c86-475f-b2e4-0c737aa8491f None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:33.924010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 249/494] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:33.929289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908672a-dee8-4ec0-bf1b-700c0a94a5e6 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:33.929289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908672a-dee8-4ec0-bf1b-700c0a94a5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:33.929289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908672a-dee8-4ec0-bf1b-700c0a94a5e6 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:33.929289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 250/495] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:33.929289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908672a-dee8-4ec0-bf1b-700c0a94a5e6 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:33.951868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:34.032048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e414648-4c86-475f-b2e4-0c737aa8491f None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:34.035197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908672a-dee8-4ec0-bf1b-700c0a94a5e6 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:34.065174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70a9ad-689c-4885-aa50-fc93371db977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:34.065833 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70a9ad-689c-4885-aa50-fc93371db977 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:34.066726 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70a9ad-689c-4885-aa50-fc93371db977 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:34.067013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70a9ad-689c-4885-aa50-fc93371db977 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:34.067739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70a9ad-689c-4885-aa50-fc93371db977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:34.068046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70a9ad-689c-4885-aa50-fc93371db977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:34.068787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd8bf7-1fe4-45ae-8575-a46206b379bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:34.069422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70a9ad-689c-4885-aa50-fc93371db977 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:34.069535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd8bf7-1fe4-45ae-8575-a46206b379bc None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:34.069744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd8bf7-1fe4-45ae-8575-a46206b379bc None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:34.070016 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd8bf7-1fe4-45ae-8575-a46206b379bc None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:34.070846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd8bf7-1fe4-45ae-8575-a46206b379bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:34.071152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd8bf7-1fe4-45ae-8575-a46206b379bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:34.072562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd8bf7-1fe4-45ae-8575-a46206b379bc None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:34.080751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 246/496] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:34.081973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06e49-660f-4551-b2a8-699202eac498 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:34.082263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06e49-660f-4551-b2a8-699202eac498 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:34.082545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06e49-660f-4551-b2a8-699202eac498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:34.100013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-c8f06e49-660f-4551-b2a8-699202eac498 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:34.101260 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c8f06e49-660f-4551-b2a8-699202eac498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:34.110008 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 251/497] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 16:10:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:34.110830 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd8bf7-1fe4-45ae-8575-a46206b379bc None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:34.115778 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:34.167655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 247/498] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:34.169026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45070a-3af2-4cf9-8dc8-0da2e53b9cfa None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:34.169332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45070a-3af2-4cf9-8dc8-0da2e53b9cfa None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:34.169613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45070a-3af2-4cf9-8dc8-0da2e53b9cfa None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:34.171016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 248/499] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:34.171541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45070a-3af2-4cf9-8dc8-0da2e53b9cfa None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:34.197964 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:34.220025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd8bf7-1fe4-45ae-8575-a46206b379bc None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:34.254362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38136d4b-510e-4f91-9992-1aea6e91dd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:34.255425 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38136d4b-510e-4f91-9992-1aea6e91dd21 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:34.255425 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38136d4b-510e-4f91-9992-1aea6e91dd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:34.255684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38136d4b-510e-4f91-9992-1aea6e91dd21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:34.265781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38136d4b-510e-4f91-9992-1aea6e91dd21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:34.273006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45070a-3af2-4cf9-8dc8-0da2e53b9cfa None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-38136d4b-510e-4f91-9992-1aea6e91dd21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:34.273446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:34.274533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 252/500] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:34.275557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38136d4b-510e-4f91-9992-1aea6e91dd21 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:34.309595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5746e3-d973-4f6c-a16a-b9c5abb6a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:34.310383 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5746e3-d973-4f6c-a16a-b9c5abb6a57d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:34.310669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5746e3-d973-4f6c-a16a-b9c5abb6a57d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:34.310941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5746e3-d973-4f6c-a16a-b9c5abb6a57d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:34.318080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5746e3-d973-4f6c-a16a-b9c5abb6a57d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:34.319514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5746e3-d973-4f6c-a16a-b9c5abb6a57d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-cf5746e3-d973-4f6c-a16a-b9c5abb6a57d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:34.333855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:34.334815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:34.335737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:34.335737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:34.335737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:34.335737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:34.335737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:34.335737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:34.335737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:34.335737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:34.335737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 16:10:34.335737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:34.335737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 249/501] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:34.336295 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec780ce-157a-4477-bead-eb2d690b4647 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:34.336505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec780ce-157a-4477-bead-eb2d690b4647 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:34.336699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec780ce-157a-4477-bead-eb2d690b4647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:34.352650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-dec780ce-157a-4477-bead-eb2d690b4647 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:34.353788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-dec780ce-157a-4477-bead-eb2d690b4647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:34.355713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:34.380341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38136d4b-510e-4f91-9992-1aea6e91dd21 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:34.413386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0fc3d-4337-438f-bb22-368fcb654c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:34.414035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0fc3d-4337-438f-bb22-368fcb654c01 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:34.414324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0fc3d-4337-438f-bb22-368fcb654c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:34.414606 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0fc3d-4337-438f-bb22-368fcb654c01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:34.417980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:34.418700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 250/502] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:34.419501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec780ce-157a-4477-bead-eb2d690b4647 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:34.493138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0fc3d-4337-438f-bb22-368fcb654c01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:34.494723 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0fc3d-4337-438f-bb22-368fcb654c01 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:34.520216 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec780ce-157a-4477-bead-eb2d690b4647 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:34.553405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8fe10-f221-4d48-ba9f-24244d912e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:34.554496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8fe10-f221-4d48-ba9f-24244d912e11 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:34.554779 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8fe10-f221-4d48-ba9f-24244d912e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:34.555055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8fe10-f221-4d48-ba9f-24244d912e11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:34.561762 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:34.565820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8fe10-f221-4d48-ba9f-24244d912e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-19e8fe10-f221-4d48-ba9f-24244d912e11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:34.574575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:34.575593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:34.576489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:34.576489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:34.576489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:34.576489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:34.576489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:34.576489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:34.576489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:34.576489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:34.576489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:34.576489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:34.576489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:34.576489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:34.576489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 251/503] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:34.577332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8fe10-f221-4d48-ba9f-24244d912e11 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:34.593535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 253/504] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:34.594376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0fc3d-4337-438f-bb22-368fcb654c01 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:34.630307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:34.677560 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8fe10-f221-4d48-ba9f-24244d912e11 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:34.692890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0fc3d-4337-438f-bb22-368fcb654c01 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:34.710779 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d99ff2-d6be-48e4-889c-847fa51b45c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:34.711445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d99ff2-d6be-48e4-889c-847fa51b45c8 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:34.711736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d99ff2-d6be-48e4-889c-847fa51b45c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:34.712018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d99ff2-d6be-48e4-889c-847fa51b45c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:34.712768 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d99ff2-d6be-48e4-889c-847fa51b45c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:34.713079 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d99ff2-d6be-48e4-889c-847fa51b45c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:34.714477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d99ff2-d6be-48e4-889c-847fa51b45c8 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:34.722208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 252/505] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:34.723536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d99ff2-d6be-48e4-889c-847fa51b45c8 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:34.726653 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01284ed-5ce4-45ae-badb-5079f10bfccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:34.727636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01284ed-5ce4-45ae-badb-5079f10bfccf None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:34.727921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01284ed-5ce4-45ae-badb-5079f10bfccf None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:34.728195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01284ed-5ce4-45ae-badb-5079f10bfccf None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:34.729039 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01284ed-5ce4-45ae-badb-5079f10bfccf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:34.729380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01284ed-5ce4-45ae-badb-5079f10bfccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:34.730831 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01284ed-5ce4-45ae-badb-5079f10bfccf None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:34.747480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 254/506] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Jul 12 16:10:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:34.748271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01284ed-5ce4-45ae-badb-5079f10bfccf None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:34.781487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:34.822052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d99ff2-d6be-48e4-889c-847fa51b45c8 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:34.840070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:34.846519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01284ed-5ce4-45ae-badb-5079f10bfccf None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:34.855514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852daab-244f-4519-add5-977cfc6300cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:34.856304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852daab-244f-4519-add5-977cfc6300cb None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:34.856590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852daab-244f-4519-add5-977cfc6300cb None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:34.856866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852daab-244f-4519-add5-977cfc6300cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:34.867151 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852daab-244f-4519-add5-977cfc6300cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:34.868593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852daab-244f-4519-add5-977cfc6300cb None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:34.880952 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7942fcf-a848-4dc4-82a9-8b4478873f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:34.881579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7942fcf-a848-4dc4-82a9-8b4478873f91 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:34.881866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7942fcf-a848-4dc4-82a9-8b4478873f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:34.882141 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7942fcf-a848-4dc4-82a9-8b4478873f91 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:34.882884 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7942fcf-a848-4dc4-82a9-8b4478873f91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:34.883190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7942fcf-a848-4dc4-82a9-8b4478873f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:34.884703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7942fcf-a848-4dc4-82a9-8b4478873f91 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-c852daab-244f-4519-add5-977cfc6300cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:34.885944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:34.886912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:34.887803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:34.887803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:34.887803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:34.887803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:34.887803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 253/507] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:34.888222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852daab-244f-4519-add5-977cfc6300cb None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:34.896027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 255/508] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:34.896885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7942fcf-a848-4dc4-82a9-8b4478873f91 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:34.988098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852daab-244f-4519-add5-977cfc6300cb None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:34.996760 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7942fcf-a848-4dc4-82a9-8b4478873f91 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:35.000604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:35.022739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee64fc8-98de-4e89-b794-3a95161c9bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:35.023529 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee64fc8-98de-4e89-b794-3a95161c9bfe None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:35.024005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee64fc8-98de-4e89-b794-3a95161c9bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:35.024116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee64fc8-98de-4e89-b794-3a95161c9bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:35.031213 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880962f1-489b-4f0c-b441-02a17456058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:35.032002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880962f1-489b-4f0c-b441-02a17456058f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:35.032284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880962f1-489b-4f0c-b441-02a17456058f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:35.032570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880962f1-489b-4f0c-b441-02a17456058f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:35.034753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee64fc8-98de-4e89-b794-3a95161c9bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:35.036905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee64fc8-98de-4e89-b794-3a95161c9bfe None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:35.043540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880962f1-489b-4f0c-b441-02a17456058f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:35.045414 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880962f1-489b-4f0c-b441-02a17456058f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-1ee64fc8-98de-4e89-b794-3a95161c9bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:35.054848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:35.055816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:35.056869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:35.056869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:35.056869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:35.056869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:35.056869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 254/509] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:35.057258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee64fc8-98de-4e89-b794-3a95161c9bfe None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-880962f1-489b-4f0c-b441-02a17456058f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:35.067893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:35.068784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:35.069756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:35.069756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:35.069756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:35.069756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:35.069756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 256/510] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:35.070058 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880962f1-489b-4f0c-b441-02a17456058f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:35.080730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:35.160753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee64fc8-98de-4e89-b794-3a95161c9bfe None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:35.169341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880962f1-489b-4f0c-b441-02a17456058f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:35.193852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0180-14fe-42a4-8ace-27c11f4e3c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:35.194498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0180-14fe-42a4-8ace-27c11f4e3c78 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:35.194783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0180-14fe-42a4-8ace-27c11f4e3c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:35.195061 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0180-14fe-42a4-8ace-27c11f4e3c78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:35.202421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b379-21b5-43d1-afac-4da9ec308f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:35.203461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b379-21b5-43d1-afac-4da9ec308f4c None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:35.203764 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b379-21b5-43d1-afac-4da9ec308f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:35.204049 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b379-21b5-43d1-afac-4da9ec308f4c None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:35.204773 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158b379-21b5-43d1-afac-4da9ec308f4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:35.205484 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158b379-21b5-43d1-afac-4da9ec308f4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:35.207771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158b379-21b5-43d1-afac-4da9ec308f4c None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:35.219758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 257/511] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:35.220564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b379-21b5-43d1-afac-4da9ec308f4c None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:35.226529 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:35.265559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c0180-14fe-42a4-8ace-27c11f4e3c78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:35.267017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c0180-14fe-42a4-8ace-27c11f4e3c78 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:35.286069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:35.321672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b379-21b5-43d1-afac-4da9ec308f4c None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:35.355459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad9d99-535e-4c61-9694-069c5dc2adc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:35.356243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad9d99-535e-4c61-9694-069c5dc2adc4 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:35.356531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad9d99-535e-4c61-9694-069c5dc2adc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:35.356805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad9d99-535e-4c61-9694-069c5dc2adc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:35.364521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 255/512] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:35.365219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0180-14fe-42a4-8ace-27c11f4e3c78 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:35.367679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad9d99-535e-4c61-9694-069c5dc2adc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:35.369257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad9d99-535e-4c61-9694-069c5dc2adc4 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-58ad9d99-535e-4c61-9694-069c5dc2adc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:35.386459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:35.387475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:35.388503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:35.388503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:35.388503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:35.388503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:35.392224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 258/513] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:35.392969 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad9d99-535e-4c61-9694-069c5dc2adc4 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:35.428314 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:35.465283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0180-14fe-42a4-8ace-27c11f4e3c78 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:35.496194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad9d99-535e-4c61-9694-069c5dc2adc4 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:35.500878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579670d-8d62-4402-9fd5-eb6bf4a1c604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:35.501566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579670d-8d62-4402-9fd5-eb6bf4a1c604 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:35.501851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579670d-8d62-4402-9fd5-eb6bf4a1c604 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:35.502128 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579670d-8d62-4402-9fd5-eb6bf4a1c604 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:35.502844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579670d-8d62-4402-9fd5-eb6bf4a1c604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:35.503151 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579670d-8d62-4402-9fd5-eb6bf4a1c604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:35.504938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579670d-8d62-4402-9fd5-eb6bf4a1c604 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:35.515928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 256/514] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:35.516861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579670d-8d62-4402-9fd5-eb6bf4a1c604 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:35.517000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:35.531526 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a730d-e9ea-41f8-9a3f-e80cc94e8735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:35.532176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a730d-e9ea-41f8-9a3f-e80cc94e8735 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:35.532458 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a730d-e9ea-41f8-9a3f-e80cc94e8735 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:35.532732 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a730d-e9ea-41f8-9a3f-e80cc94e8735 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:35.533487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a730d-e9ea-41f8-9a3f-e80cc94e8735 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:35.533818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a730d-e9ea-41f8-9a3f-e80cc94e8735 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:35.535856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a730d-e9ea-41f8-9a3f-e80cc94e8735 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:35.546965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 259/515] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:35.546965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a730d-e9ea-41f8-9a3f-e80cc94e8735 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:35.617925 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579670d-8d62-4402-9fd5-eb6bf4a1c604 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:35.640372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:35.651120 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0bbbb-b4f8-4ceb-b9d6-7f0f45ae7efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:35.651780 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0bbbb-b4f8-4ceb-b9d6-7f0f45ae7efb None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:35.652062 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0bbbb-b4f8-4ceb-b9d6-7f0f45ae7efb None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:35.652336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0bbbb-b4f8-4ceb-b9d6-7f0f45ae7efb None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:35.653030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0bbbb-b4f8-4ceb-b9d6-7f0f45ae7efb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:35.653241 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a730d-e9ea-41f8-9a3f-e80cc94e8735 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:35.654475 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0bbbb-b4f8-4ceb-b9d6-7f0f45ae7efb None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:35.685592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d80bc3-c559-47a8-9e2d-4ac56a44ea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:35.686313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d80bc3-c559-47a8-9e2d-4ac56a44ea9d None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:35.686596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d80bc3-c559-47a8-9e2d-4ac56a44ea9d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:35.686993 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d80bc3-c559-47a8-9e2d-4ac56a44ea9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:35.697871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d80bc3-c559-47a8-9e2d-4ac56a44ea9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:35.699313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d80bc3-c559-47a8-9e2d-4ac56a44ea9d None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-02d80bc3-c559-47a8-9e2d-4ac56a44ea9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:35.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:35.717427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:35.718332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:35.718332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:35.718332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:35.718332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:35.718332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 260/516] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:35.718602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d80bc3-c559-47a8-9e2d-4ac56a44ea9d None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:35.747728 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:35.760971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 257/517] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:10:35 2022] POST /identity/v3/users => generated 247 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:10:35.761725 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0bbbb-b4f8-4ceb-b9d6-7f0f45ae7efb None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:35.832467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d80bc3-c559-47a8-9e2d-4ac56a44ea9d None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:35.870477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325df64-3435-4702-ab71-2e0d32fa725e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:35.871166 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325df64-3435-4702-ab71-2e0d32fa725e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:35.871460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325df64-3435-4702-ab71-2e0d32fa725e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:35.871738 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325df64-3435-4702-ab71-2e0d32fa725e None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:35.872476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325df64-3435-4702-ab71-2e0d32fa725e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:35.872786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325df64-3435-4702-ab71-2e0d32fa725e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:35.874253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325df64-3435-4702-ab71-2e0d32fa725e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:35.878488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0bbbb-b4f8-4ceb-b9d6-7f0f45ae7efb None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:35.892324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 261/518] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:35.892324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325df64-3435-4702-ab71-2e0d32fa725e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:35.923160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3c39f-ada0-4f00-b2c0-5c210b0e3bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:35.924633 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3c39f-ada0-4f00-b2c0-5c210b0e3bbd None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:35.924767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3c39f-ada0-4f00-b2c0-5c210b0e3bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:35.925410 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3c39f-ada0-4f00-b2c0-5c210b0e3bbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:35.933399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3c39f-ada0-4f00-b2c0-5c210b0e3bbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:35.934854 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3c39f-ada0-4f00-b2c0-5c210b0e3bbd None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-4dc3c39f-ada0-4f00-b2c0-5c210b0e3bbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:35.952113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:35.952986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:35.953995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:35.953995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:35.953995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:35.953995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:35.953995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:35.953995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:35.953995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:35.953995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:35.955187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 258/519] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:35.955949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3c39f-ada0-4f00-b2c0-5c210b0e3bbd None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:35.996689 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:36.005608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325df64-3435-4702-ab71-2e0d32fa725e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:36.006291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:36.041668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f948d8-df11-4d77-a168-a7bc9a47ec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:36.042464 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f948d8-df11-4d77-a168-a7bc9a47ec84 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:36.042751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f948d8-df11-4d77-a168-a7bc9a47ec84 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:36.043026 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f948d8-df11-4d77-a168-a7bc9a47ec84 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:36.050986 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f948d8-df11-4d77-a168-a7bc9a47ec84 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:36.052438 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f948d8-df11-4d77-a168-a7bc9a47ec84 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:36.060520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3c39f-ada0-4f00-b2c0-5c210b0e3bbd None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-91f948d8-df11-4d77-a168-a7bc9a47ec84 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:36.070018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:36.070934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:36.071849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:36.071849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:36.071849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:36.071849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:36.071849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:36.071849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:36.071849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:36.071849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:36.071849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 16:10:36.071849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:36.075847 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 262/520] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:36.076696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f948d8-df11-4d77-a168-a7bc9a47ec84 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:36.100039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fab80-2df8-47ff-8b9f-ab7ebf7dc54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:36.100737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fab80-2df8-47ff-8b9f-ab7ebf7dc54b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:36.101026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fab80-2df8-47ff-8b9f-ab7ebf7dc54b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:36.101339 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fab80-2df8-47ff-8b9f-ab7ebf7dc54b None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:36.102068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fab80-2df8-47ff-8b9f-ab7ebf7dc54b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:36.102379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fab80-2df8-47ff-8b9f-ab7ebf7dc54b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:36.103753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fab80-2df8-47ff-8b9f-ab7ebf7dc54b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:36.117422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 259/521] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:36.118271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fab80-2df8-47ff-8b9f-ab7ebf7dc54b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:36.187287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f948d8-df11-4d77-a168-a7bc9a47ec84 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:36.223206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:36.225035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099d93d-d812-4e46-835d-89e9962494ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:36.225883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099d93d-d812-4e46-835d-89e9962494ae None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:36.226152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fab80-2df8-47ff-8b9f-ab7ebf7dc54b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:36.226255 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099d93d-d812-4e46-835d-89e9962494ae None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:36.226440 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099d93d-d812-4e46-835d-89e9962494ae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:36.237103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099d93d-d812-4e46-835d-89e9962494ae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:36.238670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099d93d-d812-4e46-835d-89e9962494ae None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-3099d93d-d812-4e46-835d-89e9962494ae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:36.253200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:36.254211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:36.255133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:36.255133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:36.255133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:36.255133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:36.255133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:36.255133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:36.255133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:36.255133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:36.255133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 16:10:36.255133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:36.259029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 263/522] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:36.259860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099d93d-d812-4e46-835d-89e9962494ae None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:36.265147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d311685-b7a7-4ee4-a75e-3160f23414ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:36.265878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d311685-b7a7-4ee4-a75e-3160f23414ae None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:36.267851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d311685-b7a7-4ee4-a75e-3160f23414ae None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:36.267851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d311685-b7a7-4ee4-a75e-3160f23414ae None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:36.267851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d311685-b7a7-4ee4-a75e-3160f23414ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:36.267851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d311685-b7a7-4ee4-a75e-3160f23414ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:36.269989 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d311685-b7a7-4ee4-a75e-3160f23414ae None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:36.275502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:36.290288 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 260/523] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:36.291125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d311685-b7a7-4ee4-a75e-3160f23414ae None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:36.368721 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099d93d-d812-4e46-835d-89e9962494ae None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:36.401677 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d311685-b7a7-4ee4-a75e-3160f23414ae None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:36.403839 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c38e78-0c74-43f7-9800-d6bb035e66db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:36.404516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c38e78-0c74-43f7-9800-d6bb035e66db None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:36.404805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c38e78-0c74-43f7-9800-d6bb035e66db None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:36.405082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c38e78-0c74-43f7-9800-d6bb035e66db None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:36.405959 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c38e78-0c74-43f7-9800-d6bb035e66db None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:36.406271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c38e78-0c74-43f7-9800-d6bb035e66db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:36.407712 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c38e78-0c74-43f7-9800-d6bb035e66db None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:36.424863 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 264/524] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Jul 12 16:10:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:36.425606 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c38e78-0c74-43f7-9800-d6bb035e66db None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:36.445080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd45899-7f08-41f8-950b-3eefc9a18fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:36.446281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd45899-7f08-41f8-950b-3eefc9a18fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:36.446753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd45899-7f08-41f8-950b-3eefc9a18fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:36.447212 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd45899-7f08-41f8-950b-3eefc9a18fd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:36.460500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd45899-7f08-41f8-950b-3eefc9a18fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:36.462241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd45899-7f08-41f8-950b-3eefc9a18fd8 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-bfd45899-7f08-41f8-950b-3eefc9a18fd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:36.477944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:36.478820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:36.479680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:36.479680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:36.479680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:36.479680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:36.479680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:36.479680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:36.479680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:36.479680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:36.479680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 261/525] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:36.480232 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd45899-7f08-41f8-950b-3eefc9a18fd8 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:36.506572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:36.510632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:36.542222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c38e78-0c74-43f7-9800-d6bb035e66db None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:36.577805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfbd2e-57ca-49fd-a77b-f0702cc42c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:36.578483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfbd2e-57ca-49fd-a77b-f0702cc42c07 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:36.578770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfbd2e-57ca-49fd-a77b-f0702cc42c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:36.579048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfbd2e-57ca-49fd-a77b-f0702cc42c07 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:36.579892 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfbd2e-57ca-49fd-a77b-f0702cc42c07 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:36.580207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfbd2e-57ca-49fd-a77b-f0702cc42c07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:36.581726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfbd2e-57ca-49fd-a77b-f0702cc42c07 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:36.586854 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd45899-7f08-41f8-950b-3eefc9a18fd8 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:36.602762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 265/526] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Jul 12 16:10:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:36.602762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfbd2e-57ca-49fd-a77b-f0702cc42c07 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:36.627354 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243c560-7040-491a-b5d1-963c00776a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:36.628019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243c560-7040-491a-b5d1-963c00776a6b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:36.628305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243c560-7040-491a-b5d1-963c00776a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:36.628609 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243c560-7040-491a-b5d1-963c00776a6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:36.629483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243c560-7040-491a-b5d1-963c00776a6b None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=f36355ce7ff841f3bd9e228fbad64a83) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:36.629799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243c560-7040-491a-b5d1-963c00776a6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:36.631235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243c560-7040-491a-b5d1-963c00776a6b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:36.645150 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 262/527] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:36 2022] GET /identity/v3/role_assignments?user.id=f36355ce7ff841f3bd9e228fbad64a83&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:36.645150 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243c560-7040-491a-b5d1-963c00776a6b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:36.746092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfbd2e-57ca-49fd-a77b-f0702cc42c07 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:36.749588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:36.772700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243c560-7040-491a-b5d1-963c00776a6b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:36.778816 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:36.787765 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c93c5-152a-4958-9f5b-f56ae2ccea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:36.788475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c93c5-152a-4958-9f5b-f56ae2ccea2e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:36.788761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c93c5-152a-4958-9f5b-f56ae2ccea2e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:36.789077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c93c5-152a-4958-9f5b-f56ae2ccea2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:36.833077 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d885985-4d45-42cd-8218-4951defd3f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:36.833871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d885985-4d45-42cd-8218-4951defd3f79 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:36.834160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d885985-4d45-42cd-8218-4951defd3f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:36.834438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d885985-4d45-42cd-8218-4951defd3f79 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:36.835235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d885985-4d45-42cd-8218-4951defd3f79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:36.835545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d885985-4d45-42cd-8218-4951defd3f79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:36.836970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d885985-4d45-42cd-8218-4951defd3f79 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:36.854286 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 263/528] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:36.855635 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d885985-4d45-42cd-8218-4951defd3f79 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:36.884577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c93c5-152a-4958-9f5b-f56ae2ccea2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:36.886352 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c93c5-152a-4958-9f5b-f56ae2ccea2e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:36.985018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d885985-4d45-42cd-8218-4951defd3f79 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:37.021297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 266/529] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:37.022489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c93c5-152a-4958-9f5b-f56ae2ccea2e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:37.037291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0f124-2f15-4c4c-927e-e0b61fd4f8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:37.038009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0f124-2f15-4c4c-927e-e0b61fd4f8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:37.038223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0f124-2f15-4c4c-927e-e0b61fd4f8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:37.038501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0f124-2f15-4c4c-927e-e0b61fd4f8e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:37.053915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:37.055343 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:37.117883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0f124-2f15-4c4c-927e-e0b61fd4f8e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:37.119339 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0f124-2f15-4c4c-927e-e0b61fd4f8e7 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:37.139197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c93c5-152a-4958-9f5b-f56ae2ccea2e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:37.175971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c4904-b8d0-4877-a1f3-a3f64b4331c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:37.176616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c4904-b8d0-4877-a1f3-a3f64b4331c8 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:37.176896 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c4904-b8d0-4877-a1f3-a3f64b4331c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:37.177205 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c4904-b8d0-4877-a1f3-a3f64b4331c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:37.178138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c4904-b8d0-4877-a1f3-a3f64b4331c8 None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=f9f9ba17c2634999b350b887a5229e63) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:37.178471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c4904-b8d0-4877-a1f3-a3f64b4331c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:37.180021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c4904-b8d0-4877-a1f3-a3f64b4331c8 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:37.186214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 267/530] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:37 2022] GET /identity/v3/role_assignments?user.id=f9f9ba17c2634999b350b887a5229e63&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:37.187109 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c4904-b8d0-4877-a1f3-a3f64b4331c8 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:37.255682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 264/531] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:37.261511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0f124-2f15-4c4c-927e-e0b61fd4f8e7 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:37.336432 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:37.354623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c4904-b8d0-4877-a1f3-a3f64b4331c8 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:37.366931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:37.416527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeec6f-55ad-4feb-9b08-5b02756126f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:37.417865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeec6f-55ad-4feb-9b08-5b02756126f0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:37.418318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeec6f-55ad-4feb-9b08-5b02756126f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:37.418997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeec6f-55ad-4feb-9b08-5b02756126f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:37.432998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eeec6f-55ad-4feb-9b08-5b02756126f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:37.434807 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eeec6f-55ad-4feb-9b08-5b02756126f0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-64eeec6f-55ad-4feb-9b08-5b02756126f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:37.455729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:37.457426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:37.458320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:37.458320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:37.458320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:37.458320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:37.459711 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0f124-2f15-4c4c-927e-e0b61fd4f8e7 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:37.465509 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 268/532] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:37.467973 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeec6f-55ad-4feb-9b08-5b02756126f0 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:37.541467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fb0b4-9cb1-43c9-abaa-2436eae9ed27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:37.542277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb0b4-9cb1-43c9-abaa-2436eae9ed27 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:37.542564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb0b4-9cb1-43c9-abaa-2436eae9ed27 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:37.542836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb0b4-9cb1-43c9-abaa-2436eae9ed27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:37.560544 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fb0b4-9cb1-43c9-abaa-2436eae9ed27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:37.562096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fb0b4-9cb1-43c9-abaa-2436eae9ed27 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-ba7fb0b4-9cb1-43c9-abaa-2436eae9ed27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:37.596005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:37.596880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:37.598353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:37.598353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:37.598353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:37.598353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:37.601856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeec6f-55ad-4feb-9b08-5b02756126f0 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:37.605625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 265/533] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:37.611048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fb0b4-9cb1-43c9-abaa-2436eae9ed27 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:37.663454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9255fa-dd1d-4b23-84d0-4aa049c6e131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:37.664125 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9255fa-dd1d-4b23-84d0-4aa049c6e131 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:37.664407 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9255fa-dd1d-4b23-84d0-4aa049c6e131 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:37.664677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9255fa-dd1d-4b23-84d0-4aa049c6e131 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:37.665422 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9255fa-dd1d-4b23-84d0-4aa049c6e131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:37.665728 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9255fa-dd1d-4b23-84d0-4aa049c6e131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:37.667096 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9255fa-dd1d-4b23-84d0-4aa049c6e131 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:37.694905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 269/534] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:37.698850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9255fa-dd1d-4b23-84d0-4aa049c6e131 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:37.709448 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:37.771704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:37.785752 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fb0b4-9cb1-43c9-abaa-2436eae9ed27 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:37.852470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58360ee5-a784-4731-97ba-02d8e49af365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:37.853098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58360ee5-a784-4731-97ba-02d8e49af365 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:37.853404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58360ee5-a784-4731-97ba-02d8e49af365 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:37.853679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58360ee5-a784-4731-97ba-02d8e49af365 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:37.854403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58360ee5-a784-4731-97ba-02d8e49af365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:37.854709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58360ee5-a784-4731-97ba-02d8e49af365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:37.856164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58360ee5-a784-4731-97ba-02d8e49af365 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:37.883017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 266/535] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:37.884954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc5688-7001-4c11-ab6f-9b59e69c64b7 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:37.885469 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc5688-7001-4c11-ab6f-9b59e69c64b7 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:37.885755 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc5688-7001-4c11-ab6f-9b59e69c64b7 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:37.886986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 267/536] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:37.889662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc5688-7001-4c11-ab6f-9b59e69c64b7 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:37.893078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9255fa-dd1d-4b23-84d0-4aa049c6e131 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:37.937782 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dcc70-aacb-4356-a879-6634b80282cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:37.938590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dcc70-aacb-4356-a879-6634b80282cd None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:37.938855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dcc70-aacb-4356-a879-6634b80282cd None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:37.939658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dcc70-aacb-4356-a879-6634b80282cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:37.947972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dcc70-aacb-4356-a879-6634b80282cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:37.949472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dcc70-aacb-4356-a879-6634b80282cd None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-4b0dcc70-aacb-4356-a879-6634b80282cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:37.968516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:37.970687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:37.973313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:37.973313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:37.973313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:37.973313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:37.973313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:37.973313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:37.973313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:37.973313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:37.973313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 270/537] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:37.973313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e6b86-5480-48ca-9f93-9d6bb84fff3f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:37.973313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e6b86-5480-48ca-9f93-9d6bb84fff3f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:37.974670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e6b86-5480-48ca-9f93-9d6bb84fff3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:38.006466 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-225e6b86-5480-48ca-9f93-9d6bb84fff3f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:38.007905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-225e6b86-5480-48ca-9f93-9d6bb84fff3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:38.028685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc5688-7001-4c11-ab6f-9b59e69c64b7 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:38.074192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5ad1f-adee-4aff-a225-69de6ff873be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:38.075489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5ad1f-adee-4aff-a225-69de6ff873be None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:38.075819 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5ad1f-adee-4aff-a225-69de6ff873be None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:38.076095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5ad1f-adee-4aff-a225-69de6ff873be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:38.084375 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:38.087559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5ad1f-adee-4aff-a225-69de6ff873be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:38.089923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5ad1f-adee-4aff-a225-69de6ff873be None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:38.093495 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 271/538] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:38.094482 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e6b86-5480-48ca-9f93-9d6bb84fff3f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-96c5ad1f-adee-4aff-a225-69de6ff873be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:38.107804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:38.108684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:38.109559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:38.109559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:38.109559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:38.109559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:38.109559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:38.109559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:38.109559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:38.109559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:38.111564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 268/539] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:38.121806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5ad1f-adee-4aff-a225-69de6ff873be None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:38.142386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:38.205209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e6b86-5480-48ca-9f93-9d6bb84fff3f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:38.232043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5ad1f-adee-4aff-a225-69de6ff873be None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:38.240594 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b78ad-b8a4-42d6-a272-dd5e31db1344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:38.241328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b78ad-b8a4-42d6-a272-dd5e31db1344 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:38.241570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b78ad-b8a4-42d6-a272-dd5e31db1344 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:38.241855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b78ad-b8a4-42d6-a272-dd5e31db1344 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:38.242646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b78ad-b8a4-42d6-a272-dd5e31db1344 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:38.242959 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b78ad-b8a4-42d6-a272-dd5e31db1344 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:38.244517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b78ad-b8a4-42d6-a272-dd5e31db1344 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:38.263205 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 272/540] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:38.264118 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b78ad-b8a4-42d6-a272-dd5e31db1344 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:38.271997 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9eaa5-1348-40a9-ba6b-3a79c5442a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:38.272918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9eaa5-1348-40a9-ba6b-3a79c5442a72 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:38.273499 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9eaa5-1348-40a9-ba6b-3a79c5442a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:38.273970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9eaa5-1348-40a9-ba6b-3a79c5442a72 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:38.274950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9eaa5-1348-40a9-ba6b-3a79c5442a72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:38.275570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9eaa5-1348-40a9-ba6b-3a79c5442a72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:38.277323 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9eaa5-1348-40a9-ba6b-3a79c5442a72 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:38.291181 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 269/541] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:38.292352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9eaa5-1348-40a9-ba6b-3a79c5442a72 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:38.322552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:38.369798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b78ad-b8a4-42d6-a272-dd5e31db1344 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:38.377191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:38.402716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9eaa5-1348-40a9-ba6b-3a79c5442a72 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:38.404878 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf781e-0b61-4f7b-8ef3-a860d23c9185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:38.406243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf781e-0b61-4f7b-8ef3-a860d23c9185 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:38.406243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf781e-0b61-4f7b-8ef3-a860d23c9185 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:38.406436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf781e-0b61-4f7b-8ef3-a860d23c9185 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:38.419075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf781e-0b61-4f7b-8ef3-a860d23c9185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-ebbf781e-0b61-4f7b-8ef3-a860d23c9185 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:38.428059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:38.428949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:38.429755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:38.429755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:38.429755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:38.429755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:38.429755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:38.429755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:38.429755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:38.429755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:38.429755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:38.429755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:38.429755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:38.429755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:38.434317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 273/542] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:38.435225 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf781e-0b61-4f7b-8ef3-a860d23c9185 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:38.445231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae1ad3-6190-45f4-8fcc-01ebc2c6bea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:38.446277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae1ad3-6190-45f4-8fcc-01ebc2c6bea0 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:38.446756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae1ad3-6190-45f4-8fcc-01ebc2c6bea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:38.447243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae1ad3-6190-45f4-8fcc-01ebc2c6bea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:38.458718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae1ad3-6190-45f4-8fcc-01ebc2c6bea0 None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=f6a4da4c1dca40f5bb5d158a6f33d9dc) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:38.459249 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae1ad3-6190-45f4-8fcc-01ebc2c6bea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:38.461000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae1ad3-6190-45f4-8fcc-01ebc2c6bea0 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:38.467997 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 270/543] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:38 2022] GET /identity/v3/role_assignments?user.id=f6a4da4c1dca40f5bb5d158a6f33d9dc&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:38.469325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae1ad3-6190-45f4-8fcc-01ebc2c6bea0 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:38.553421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf781e-0b61-4f7b-8ef3-a860d23c9185 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:38.573525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:38.593331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde07ac3-b517-477a-a343-4a60847b2822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:38.594157 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde07ac3-b517-477a-a343-4a60847b2822 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:38.594448 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde07ac3-b517-477a-a343-4a60847b2822 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:38.594832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde07ac3-b517-477a-a343-4a60847b2822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:38.595741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde07ac3-b517-477a-a343-4a60847b2822 None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=835679599bc74ed5b1b481e9be4700c5) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:38.596061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde07ac3-b517-477a-a343-4a60847b2822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:38.598425 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde07ac3-b517-477a-a343-4a60847b2822 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:38.605504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 274/544] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:38 2022] GET /identity/v3/role_assignments?user.id=835679599bc74ed5b1b481e9be4700c5&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:38.611323 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae1ad3-6190-45f4-8fcc-01ebc2c6bea0 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:38.650017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c438a23-9697-493f-b84d-8e7e7d37738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:38.650627 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c438a23-9697-493f-b84d-8e7e7d37738b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:38.650914 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c438a23-9697-493f-b84d-8e7e7d37738b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:38.651193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c438a23-9697-493f-b84d-8e7e7d37738b None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:38.651957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c438a23-9697-493f-b84d-8e7e7d37738b None admin] RBAC: Adding query filter params (name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:38.652267 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c438a23-9697-493f-b84d-8e7e7d37738b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:38.653696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c438a23-9697-493f-b84d-8e7e7d37738b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:38.664072 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 271/545] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:38.669341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde07ac3-b517-477a-a343-4a60847b2822 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:38.825291 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde07ac3-b517-477a-a343-4a60847b2822 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:38.864138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70889cb-2fdd-4201-b5e9-33150510fc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:38.864941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70889cb-2fdd-4201-b5e9-33150510fc3d None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:38.869368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70889cb-2fdd-4201-b5e9-33150510fc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:38.869368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70889cb-2fdd-4201-b5e9-33150510fc3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:38.876776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70889cb-2fdd-4201-b5e9-33150510fc3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:38.878319 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70889cb-2fdd-4201-b5e9-33150510fc3d None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-a70889cb-2fdd-4201-b5e9-33150510fc3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:38.896679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:38.898045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:38.898876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:38.898876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:38.898876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:38.898876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:38.898876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 275/546] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:38.903754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c438a23-9697-493f-b84d-8e7e7d37738b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:38.906856 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:38.951532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f4fe5-57a0-4a59-aa88-976c09dd144a None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:38.952166 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f4fe5-57a0-4a59-aa88-976c09dd144a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:38.952595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f4fe5-57a0-4a59-aa88-976c09dd144a None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:38.954362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 276/547] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:38.962528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f9c0-f825-4491-8a6d-b7f97202b174 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:38.962819 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f9c0-f825-4491-8a6d-b7f97202b174 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:38.963100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f9c0-f825-4491-8a6d-b7f97202b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:38.996525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-1af4f9c0-f825-4491-8a6d-b7f97202b174 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:38.998629 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1af4f9c0-f825-4491-8a6d-b7f97202b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:39.056094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c438a23-9697-493f-b84d-8e7e7d37738b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:39.062471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:39.106365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdc144-a275-44b3-96b3-29e9d5d2cf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:39.107043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdc144-a275-44b3-96b3-29e9d5d2cf67 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:39.107560 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdc144-a275-44b3-96b3-29e9d5d2cf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:39.107560 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdc144-a275-44b3-96b3-29e9d5d2cf67 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:39.108304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdc144-a275-44b3-96b3-29e9d5d2cf67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:39.108606 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdc144-a275-44b3-96b3-29e9d5d2cf67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:39.109999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdc144-a275-44b3-96b3-29e9d5d2cf67 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:39.132021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 272/548] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:39.140752 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdc144-a275-44b3-96b3-29e9d5d2cf67 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:39.154891 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 277/549] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:39.181233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4f9c0-f825-4491-8a6d-b7f97202b174 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:39.238993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:39.315756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdc144-a275-44b3-96b3-29e9d5d2cf67 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:39.343328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4f9c0-f825-4491-8a6d-b7f97202b174 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:39.381622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521df3b-f259-4777-8ba5-9005410c22a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:39.382813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521df3b-f259-4777-8ba5-9005410c22a7 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:39.383391 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521df3b-f259-4777-8ba5-9005410c22a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:39.383869 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521df3b-f259-4777-8ba5-9005410c22a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:39.386386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad843f-2674-48ea-910c-1b6efb8c6ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:39.387196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad843f-2674-48ea-910c-1b6efb8c6ceb None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:39.387485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad843f-2674-48ea-910c-1b6efb8c6ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:39.388026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad843f-2674-48ea-910c-1b6efb8c6ceb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:39.396859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521df3b-f259-4777-8ba5-9005410c22a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:39.400597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad843f-2674-48ea-910c-1b6efb8c6ceb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:39.402079 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad843f-2674-48ea-910c-1b6efb8c6ceb None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-8521df3b-f259-4777-8ba5-9005410c22a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:39.405733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:39.406615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:39.407446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:39.407446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:39.407446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:39.407446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:39.407446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:39.407446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:39.407446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:39.407446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:39.407446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:39.407446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:39.407446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:39.407446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:39.411134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 278/550] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:39.417095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521df3b-f259-4777-8ba5-9005410c22a7 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-45ad843f-2674-48ea-910c-1b6efb8c6ceb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:39.430369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:39.431531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:39.432467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:39.432467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:39.432467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:39.432467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:39.432467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:39.432467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:39.432467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:39.432467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:39.432467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 16:10:39.432467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:39.436241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 273/551] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:10:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:39.437516 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad843f-2674-48ea-910c-1b6efb8c6ceb None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:39.446501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:39.534468 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521df3b-f259-4777-8ba5-9005410c22a7 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:39.571940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64591785-418e-43ad-bb1f-5b940bd9f2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:39.573077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64591785-418e-43ad-bb1f-5b940bd9f2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:39.573600 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64591785-418e-43ad-bb1f-5b940bd9f2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:39.574082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64591785-418e-43ad-bb1f-5b940bd9f2f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:39.575062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64591785-418e-43ad-bb1f-5b940bd9f2f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:39.575670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64591785-418e-43ad-bb1f-5b940bd9f2f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:39.577390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64591785-418e-43ad-bb1f-5b940bd9f2f4 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:39.587020 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 279/552] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:39.592173 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad843f-2674-48ea-910c-1b6efb8c6ceb None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:39.593378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41027d4f-a7e7-4ae3-b7b5-191f6abbab76 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:39.593984 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41027d4f-a7e7-4ae3-b7b5-191f6abbab76 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:39.594471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41027d4f-a7e7-4ae3-b7b5-191f6abbab76 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:39.596254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 280/553] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:39.597733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41027d4f-a7e7-4ae3-b7b5-191f6abbab76 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:39.621530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:39.633787 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df825d-4f28-4bc5-871f-e20e47f114f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:39.634461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df825d-4f28-4bc5-871f-e20e47f114f9 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:39.634747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df825d-4f28-4bc5-871f-e20e47f114f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:39.635022 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df825d-4f28-4bc5-871f-e20e47f114f9 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:39.635867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df825d-4f28-4bc5-871f-e20e47f114f9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:39.638797 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df825d-4f28-4bc5-871f-e20e47f114f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:39.638797 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df825d-4f28-4bc5-871f-e20e47f114f9 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:39.678314 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 274/554] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Jul 12 16:10:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:39.679590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538aa0c-e442-48d3-aef8-10bac7d61f37 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:39.679891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538aa0c-e442-48d3-aef8-10bac7d61f37 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:39.680172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538aa0c-e442-48d3-aef8-10bac7d61f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:39.690998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:39.699494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-8538aa0c-e442-48d3-aef8-10bac7d61f37 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:39.701541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8538aa0c-e442-48d3-aef8-10bac7d61f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:39.712017 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41027d4f-a7e7-4ae3-b7b5-191f6abbab76 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:39.749779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ccfc6-180b-4bd4-a051-4a851c3b34b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:39.750985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ccfc6-180b-4bd4-a051-4a851c3b34b5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:39.751479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ccfc6-180b-4bd4-a051-4a851c3b34b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:39.752042 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ccfc6-180b-4bd4-a051-4a851c3b34b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:39.763193 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ccfc6-180b-4bd4-a051-4a851c3b34b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:39.765087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ccfc6-180b-4bd4-a051-4a851c3b34b5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:39.781398 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 275/555] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:39.782365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538aa0c-e442-48d3-aef8-10bac7d61f37 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-6c0ccfc6-180b-4bd4-a051-4a851c3b34b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:39.784862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:39.786259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:39.787132 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:39.787132 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:39.787132 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:39.787132 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:39.789472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 281/556] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:39.795216 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ccfc6-180b-4bd4-a051-4a851c3b34b5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:39.913145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538aa0c-e442-48d3-aef8-10bac7d61f37 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:39.913654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ccfc6-180b-4bd4-a051-4a851c3b34b5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:39.926033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:39.955610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a538f-c129-4827-a2af-defe3616cad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:39.956416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a538f-c129-4827-a2af-defe3616cad0 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:39.956848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a538f-c129-4827-a2af-defe3616cad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:39.957144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a538f-c129-4827-a2af-defe3616cad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:39.963848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcfb7c-8921-4038-80e5-8a02328a7c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:39.964540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcfb7c-8921-4038-80e5-8a02328a7c01 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:39.964827 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcfb7c-8921-4038-80e5-8a02328a7c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:39.965108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcfb7c-8921-4038-80e5-8a02328a7c01 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:39.966051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcfb7c-8921-4038-80e5-8a02328a7c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:39.966391 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcfb7c-8921-4038-80e5-8a02328a7c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:39.968455 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcfb7c-8921-4038-80e5-8a02328a7c01 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:39.970841 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:39.984926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 282/557] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:39.986183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcfb7c-8921-4038-80e5-8a02328a7c01 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:40.047555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a538f-c129-4827-a2af-defe3616cad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:40.049212 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a538f-c129-4827-a2af-defe3616cad0 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:40.100794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcfb7c-8921-4038-80e5-8a02328a7c01 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:40.136356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964fb38-aec1-42a7-91c1-3f93d92681b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:40.137339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964fb38-aec1-42a7-91c1-3f93d92681b6 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:40.137725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964fb38-aec1-42a7-91c1-3f93d92681b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:40.138753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964fb38-aec1-42a7-91c1-3f93d92681b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:40.149746 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964fb38-aec1-42a7-91c1-3f93d92681b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-5964fb38-aec1-42a7-91c1-3f93d92681b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:40.157546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:40.159153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:40.160769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:40.160769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:40.160769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:40.160769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:40.160769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:40.160769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:40.160769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:40.160769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:40.160769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:40.160769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:40.160769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:40.160769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:40.167508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 283/559] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:40.167645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 276/559] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:40.167645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a538f-c129-4827-a2af-defe3616cad0 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:40.168106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964fb38-aec1-42a7-91c1-3f93d92681b6 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:40.177591 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:40.225810 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:40.271849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964fb38-aec1-42a7-91c1-3f93d92681b6 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:40.275131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a538f-c129-4827-a2af-defe3616cad0 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:40.307316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda21a53-120a-4b30-a05c-df1a9550eeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:40.308628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda21a53-120a-4b30-a05c-df1a9550eeff None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:40.309137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda21a53-120a-4b30-a05c-df1a9550eeff None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:40.309610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda21a53-120a-4b30-a05c-df1a9550eeff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:40.313146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192a949-485a-4285-a86f-81b556c1dfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:40.313751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a949-485a-4285-a86f-81b556c1dfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:40.314365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a949-485a-4285-a86f-81b556c1dfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:40.314726 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a949-485a-4285-a86f-81b556c1dfa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:40.319113 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda21a53-120a-4b30-a05c-df1a9550eeff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:40.320784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda21a53-120a-4b30-a05c-df1a9550eeff None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:40.326710 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192a949-485a-4285-a86f-81b556c1dfa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:40.328250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192a949-485a-4285-a86f-81b556c1dfa6 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-cda21a53-120a-4b30-a05c-df1a9550eeff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:40.335916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:40.336976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:40.337963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:40.337963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:40.337963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:40.337963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:40.337963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:40.337963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:40.337963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:40.337963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:40.337963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:10:40.337963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:40.340585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 284/560] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 16:10:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:40.341627 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda21a53-120a-4b30-a05c-df1a9550eeff None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-e192a949-485a-4285-a86f-81b556c1dfa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:40.348223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:40.349135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:40.350136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:40.350136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:40.350136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:40.350136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:40.354001 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 277/561] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:40.354997 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192a949-485a-4285-a86f-81b556c1dfa6 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:40.424477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:40.449378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda21a53-120a-4b30-a05c-df1a9550eeff None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:40.465256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:40.469953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192a949-485a-4285-a86f-81b556c1dfa6 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:40.486649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650982a-eba6-45b0-972e-ecc2c97083cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:40.487639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650982a-eba6-45b0-972e-ecc2c97083cf None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:40.488168 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650982a-eba6-45b0-972e-ecc2c97083cf None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:40.488609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650982a-eba6-45b0-972e-ecc2c97083cf None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:40.489569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650982a-eba6-45b0-972e-ecc2c97083cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:40.490041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650982a-eba6-45b0-972e-ecc2c97083cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:40.491579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650982a-eba6-45b0-972e-ecc2c97083cf None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:40.500672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 285/562] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:40.501717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650982a-eba6-45b0-972e-ecc2c97083cf None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:40.506151 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056cf97-ac69-4053-83f2-67be7718ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:40.506828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056cf97-ac69-4053-83f2-67be7718ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:40.507170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056cf97-ac69-4053-83f2-67be7718ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:40.507862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056cf97-ac69-4053-83f2-67be7718ccf5 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:40.508877 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056cf97-ac69-4053-83f2-67be7718ccf5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:40.509245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056cf97-ac69-4053-83f2-67be7718ccf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:40.510714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056cf97-ac69-4053-83f2-67be7718ccf5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:40.531953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 278/563] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 16:10:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:40.533007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056cf97-ac69-4053-83f2-67be7718ccf5 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:40.611490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650982a-eba6-45b0-972e-ecc2c97083cf None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:40.647325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccc0b9-dc02-4689-8dbc-f01fcd705ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:40.648328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc0b9-dc02-4689-8dbc-f01fcd705ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:40.648824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc0b9-dc02-4689-8dbc-f01fcd705ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:40.649405 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc0b9-dc02-4689-8dbc-f01fcd705ba6 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:40.650329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccc0b9-dc02-4689-8dbc-f01fcd705ba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:40.650867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccc0b9-dc02-4689-8dbc-f01fcd705ba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:40.652460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccc0b9-dc02-4689-8dbc-f01fcd705ba6 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:40.661191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056cf97-ac69-4053-83f2-67be7718ccf5 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:40.666023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 286/564] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:40.667098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccc0b9-dc02-4689-8dbc-f01fcd705ba6 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:40.694189 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:40.705808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:40.712978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce0854-280a-4cf4-9700-9c612d374311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:40.713889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0854-280a-4cf4-9700-9c612d374311 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:40.714246 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0854-280a-4cf4-9700-9c612d374311 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:40.714597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0854-280a-4cf4-9700-9c612d374311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:40.728417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce0854-280a-4cf4-9700-9c612d374311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:40.730794 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce0854-280a-4cf4-9700-9c612d374311 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-6dce0854-280a-4cf4-9700-9c612d374311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:40.755678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:40.756601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:40.757528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:40.757528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:40.757528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:40.757528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:40.757528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 279/565] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:40.758267 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce0854-280a-4cf4-9700-9c612d374311 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:40.782582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccc0b9-dc02-4689-8dbc-f01fcd705ba6 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:40.820824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bfaa1-d41d-4a67-bfea-366cdb1f0108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:40.822189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bfaa1-d41d-4a67-bfea-366cdb1f0108 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:40.822675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bfaa1-d41d-4a67-bfea-366cdb1f0108 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:40.823152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bfaa1-d41d-4a67-bfea-366cdb1f0108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:40.836681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bfaa1-d41d-4a67-bfea-366cdb1f0108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:40.838254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bfaa1-d41d-4a67-bfea-366cdb1f0108 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-019bfaa1-d41d-4a67-bfea-366cdb1f0108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:40.857637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:40.862229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:40.864321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:40.864321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:40.864321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:40.864321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:40.864321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 287/566] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:40.864321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bfaa1-d41d-4a67-bfea-366cdb1f0108 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:40.894971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce0854-280a-4cf4-9700-9c612d374311 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:40.934972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48208f72-2e6d-4d6b-8265-2ef61882b063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:40.935948 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48208f72-2e6d-4d6b-8265-2ef61882b063 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:40.936063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48208f72-2e6d-4d6b-8265-2ef61882b063 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:40.936325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48208f72-2e6d-4d6b-8265-2ef61882b063 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:40.943875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48208f72-2e6d-4d6b-8265-2ef61882b063 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:40.945351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48208f72-2e6d-4d6b-8265-2ef61882b063 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:40.954956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-48208f72-2e6d-4d6b-8265-2ef61882b063 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:40.959551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:40.960616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:40.961624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:40.961624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:40.961624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:40.961624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:40.961624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:40.961624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:40.961624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:40.961624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:40.961624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 280/567] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:40.961624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48208f72-2e6d-4d6b-8265-2ef61882b063 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:40.968156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bfaa1-d41d-4a67-bfea-366cdb1f0108 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:40.993040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:41.001288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5cf4f-f8b1-4e12-81f7-7452625a79ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:41.001949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5cf4f-f8b1-4e12-81f7-7452625a79ba None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.002233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5cf4f-f8b1-4e12-81f7-7452625a79ba None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.002512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5cf4f-f8b1-4e12-81f7-7452625a79ba None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.003227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5cf4f-f8b1-4e12-81f7-7452625a79ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:41.004063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5cf4f-f8b1-4e12-81f7-7452625a79ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:41.005455 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5cf4f-f8b1-4e12-81f7-7452625a79ba None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:41.016824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 288/568] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:41.018282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1294d60-5c02-4fb1-8cbd-b8d7bea08074 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.018575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1294d60-5c02-4fb1-8cbd-b8d7bea08074 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.018859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1294d60-5c02-4fb1-8cbd-b8d7bea08074 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.020717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 289/569] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:41.023137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e410829-c60c-4985-944b-b00907084eaf None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.023137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e410829-c60c-4985-944b-b00907084eaf None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.023137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e410829-c60c-4985-944b-b00907084eaf None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.027952 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 290/570] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:41.028705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e410829-c60c-4985-944b-b00907084eaf None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:41.064861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48208f72-2e6d-4d6b-8265-2ef61882b063 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:41.098082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc0bd9-bd65-447c-92c5-34d5b6eba54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:41.098733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0bd9-bd65-447c-92c5-34d5b6eba54b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.099015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0bd9-bd65-447c-92c5-34d5b6eba54b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.099290 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0bd9-bd65-447c-92c5-34d5b6eba54b None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.100007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc0bd9-bd65-447c-92c5-34d5b6eba54b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:41.100313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc0bd9-bd65-447c-92c5-34d5b6eba54b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:41.101706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc0bd9-bd65-447c-92c5-34d5b6eba54b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:41.113605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 281/571] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:41.114391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc0bd9-bd65-447c-92c5-34d5b6eba54b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:41.136311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e410829-c60c-4985-944b-b00907084eaf None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:41.171854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ed25c-864b-4145-a6a0-a7211bdab273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:41.172507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ed25c-864b-4145-a6a0-a7211bdab273 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.172796 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ed25c-864b-4145-a6a0-a7211bdab273 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.173076 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ed25c-864b-4145-a6a0-a7211bdab273 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.173890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ed25c-864b-4145-a6a0-a7211bdab273 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:41.174203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ed25c-864b-4145-a6a0-a7211bdab273 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:41.175705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ed25c-864b-4145-a6a0-a7211bdab273 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:41.186915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 291/572] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:41.190643 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5180d48-710c-4b3d-afdb-6c9f6135e921 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.191454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5180d48-710c-4b3d-afdb-6c9f6135e921 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.191724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5180d48-710c-4b3d-afdb-6c9f6135e921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.202282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:41.207985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e5180d48-710c-4b3d-afdb-6c9f6135e921 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:41.209306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e5180d48-710c-4b3d-afdb-6c9f6135e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:41.211225 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:41.211503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc0bd9-bd65-447c-92c5-34d5b6eba54b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:41.244658 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5696f-54ef-42ae-b824-04437304c6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:41.245501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5696f-54ef-42ae-b824-04437304c6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.245776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5696f-54ef-42ae-b824-04437304c6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.246052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5696f-54ef-42ae-b824-04437304c6a2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.253285 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5696f-54ef-42ae-b824-04437304c6a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:41.255296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5696f-54ef-42ae-b824-04437304c6a2 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-0cb5696f-54ef-42ae-b824-04437304c6a2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:41.269949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:41.271084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:41.272087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:41.272087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:41.272087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:41.272087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:41.272087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:41.272087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:41.272087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:41.272087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:41.272087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 16:10:41.272087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:41.272087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 282/573] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:41.272685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8bd6-ce05-40ef-a3f3-776d8b468c32 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.272685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8bd6-ce05-40ef-a3f3-776d8b468c32 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.272906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8bd6-ce05-40ef-a3f3-776d8b468c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.277488 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 292/574] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:41.278473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5180d48-710c-4b3d-afdb-6c9f6135e921 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:41.293595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-c9af8bd6-ce05-40ef-a3f3-776d8b468c32 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:41.294777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c9af8bd6-ce05-40ef-a3f3-776d8b468c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:41.361018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 283/575] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:41.361872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af8bd6-ce05-40ef-a3f3-776d8b468c32 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:41.396973 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5180d48-710c-4b3d-afdb-6c9f6135e921 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:41.430797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246cec7-1bd7-4b8e-8c6e-aeac1d70fb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:41.431669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246cec7-1bd7-4b8e-8c6e-aeac1d70fb96 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.431961 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246cec7-1bd7-4b8e-8c6e-aeac1d70fb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.432240 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246cec7-1bd7-4b8e-8c6e-aeac1d70fb96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.438901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246cec7-1bd7-4b8e-8c6e-aeac1d70fb96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:41.440623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246cec7-1bd7-4b8e-8c6e-aeac1d70fb96 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:41.443109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:41.443276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-2246cec7-1bd7-4b8e-8c6e-aeac1d70fb96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:41.456036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:41.457832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:41.458971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:41.458971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:41.458971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:41.458971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:41.458971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:41.458971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:41.458971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:41.458971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:41.458971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 293/576] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:41.458971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246cec7-1bd7-4b8e-8c6e-aeac1d70fb96 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:41.465873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af8bd6-ce05-40ef-a3f3-776d8b468c32 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:41.501554 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac59fc6-2650-4021-8c91-9c6626c13a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:41.502209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac59fc6-2650-4021-8c91-9c6626c13a76 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.502491 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac59fc6-2650-4021-8c91-9c6626c13a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.502764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac59fc6-2650-4021-8c91-9c6626c13a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.503627 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac59fc6-2650-4021-8c91-9c6626c13a76 None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=143798e5887b49338f0000de5b55be68) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:41.503939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac59fc6-2650-4021-8c91-9c6626c13a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:41.505400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac59fc6-2650-4021-8c91-9c6626c13a76 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:41.510801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 284/577] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:41 2022] GET /identity/v3/role_assignments?user.id=143798e5887b49338f0000de5b55be68&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:41.511570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac59fc6-2650-4021-8c91-9c6626c13a76 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:41.568064 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246cec7-1bd7-4b8e-8c6e-aeac1d70fb96 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:41.609095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f8f78-3d58-45bc-aed1-82656e19c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:41.610244 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f8f78-3d58-45bc-aed1-82656e19c826 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.610595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f8f78-3d58-45bc-aed1-82656e19c826 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.610935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f8f78-3d58-45bc-aed1-82656e19c826 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.611974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f8f78-3d58-45bc-aed1-82656e19c826 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:41.612346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f8f78-3d58-45bc-aed1-82656e19c826 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:41.613938 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f8f78-3d58-45bc-aed1-82656e19c826 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:41.639497 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac59fc6-2650-4021-8c91-9c6626c13a76 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:41.639736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 294/578] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Jul 12 16:10:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:41.639736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f8f78-3d58-45bc-aed1-82656e19c826 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:41.681160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d93e5-310b-41da-bc6c-dcc96bc41683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:41.681958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d93e5-310b-41da-bc6c-dcc96bc41683 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.682247 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d93e5-310b-41da-bc6c-dcc96bc41683 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.682528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d93e5-310b-41da-bc6c-dcc96bc41683 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.695620 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d93e5-310b-41da-bc6c-dcc96bc41683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:41.701756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-206d93e5-310b-41da-bc6c-dcc96bc41683 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:41.703955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:41.705099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:41.706185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:41.706185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:41.706185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:41.706185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:41.706185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:41.706185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:41.706185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:41.706185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:41.706185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:41.706185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:41.706185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:41.706185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:41.710656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 285/579] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:41.711425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d93e5-310b-41da-bc6c-dcc96bc41683 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:41.720440 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:41.752032 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f8f78-3d58-45bc-aed1-82656e19c826 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:41.789105 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940f936-e833-4636-8f81-c2427d9f040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:41.790055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940f936-e833-4636-8f81-c2427d9f040f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.790343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940f936-e833-4636-8f81-c2427d9f040f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.790617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940f936-e833-4636-8f81-c2427d9f040f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.801726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940f936-e833-4636-8f81-c2427d9f040f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-c940f936-e833-4636-8f81-c2427d9f040f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:41.810192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:41.811363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 295/580] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:41.818134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940f936-e833-4636-8f81-c2427d9f040f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:41.821452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d93e5-310b-41da-bc6c-dcc96bc41683 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:41.857195 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73d482-da49-4eb4-98fe-526933604fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:41.857868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73d482-da49-4eb4-98fe-526933604fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.858155 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73d482-da49-4eb4-98fe-526933604fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.858436 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73d482-da49-4eb4-98fe-526933604fe2 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.859232 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73d482-da49-4eb4-98fe-526933604fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:41.859546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73d482-da49-4eb4-98fe-526933604fe2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:41.860971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73d482-da49-4eb4-98fe-526933604fe2 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:41.878667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 286/581] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:41.878667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73d482-da49-4eb4-98fe-526933604fe2 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:41.929308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940f936-e833-4636-8f81-c2427d9f040f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:41.946850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:41.949484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:41.965603 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e9c47-a57a-4124-929e-d65ae5f9490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:41.966699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e9c47-a57a-4124-929e-d65ae5f9490e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:41.967070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e9c47-a57a-4124-929e-d65ae5f9490e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:41.967412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e9c47-a57a-4124-929e-d65ae5f9490e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:41.978827 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e9c47-a57a-4124-929e-d65ae5f9490e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:41.980348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e9c47-a57a-4124-929e-d65ae5f9490e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:41.986542 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73d482-da49-4eb4-98fe-526933604fe2 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-697e9c47-a57a-4124-929e-d65ae5f9490e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:41.998515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:41.999616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:42.000698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:42.000698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:42.000698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:42.000698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:42.000921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 296/582] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:42.001649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e9c47-a57a-4124-929e-d65ae5f9490e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:42.030176 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8b91a-5c3c-4fd2-b316-5a4d016aa7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:42.030850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8b91a-5c3c-4fd2-b316-5a4d016aa7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:42.031139 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8b91a-5c3c-4fd2-b316-5a4d016aa7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:42.031416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8b91a-5c3c-4fd2-b316-5a4d016aa7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:42.032164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8b91a-5c3c-4fd2-b316-5a4d016aa7d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:42.032474 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8b91a-5c3c-4fd2-b316-5a4d016aa7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:42.033861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8b91a-5c3c-4fd2-b316-5a4d016aa7d5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:42.043617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 287/583] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:42.044239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8b91a-5c3c-4fd2-b316-5a4d016aa7d5 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:42.111767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e9c47-a57a-4124-929e-d65ae5f9490e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:42.148754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcb2e1-b6fb-422a-9d2f-169574b93cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:42.149631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcb2e1-b6fb-422a-9d2f-169574b93cdf None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:42.149994 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcb2e1-b6fb-422a-9d2f-169574b93cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:42.150374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcb2e1-b6fb-422a-9d2f-169574b93cdf None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:42.151220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcb2e1-b6fb-422a-9d2f-169574b93cdf None admin] RBAC: Adding query filter params (name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:42.151628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcb2e1-b6fb-422a-9d2f-169574b93cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:42.152737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8b91a-5c3c-4fd2-b316-5a4d016aa7d5 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:42.153208 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcb2e1-b6fb-422a-9d2f-169574b93cdf None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:42.164011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 297/584] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:42.164903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcb2e1-b6fb-422a-9d2f-169574b93cdf None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:42.185453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:42.194284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f65a64-64a5-4e76-b5ff-3f2b40a1eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:42.195185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f65a64-64a5-4e76-b5ff-3f2b40a1eda5 None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:42.195476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f65a64-64a5-4e76-b5ff-3f2b40a1eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:42.196311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f65a64-64a5-4e76-b5ff-3f2b40a1eda5 None admin] PATH_INFO: `/v3/projects/2101dde305df44bc90d33b01976e8265/users/f36355ce7ff841f3bd9e228fbad64a83/roles/b3ce4434b13d4e46a67de5728f7ee232` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:42.202522 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:42.211415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f65a64-64a5-4e76-b5ff-3f2b40a1eda5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2101dde305df44bc90d33b01976e8265, user_id=f36355ce7ff841f3bd9e228fbad64a83, role_id=b3ce4434b13d4e46a67de5728f7ee232)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:42.213761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f65a64-64a5-4e76-b5ff-3f2b40a1eda5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:42.273511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcb2e1-b6fb-422a-9d2f-169574b93cdf None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:42.297320 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 288/585] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:10:42 2022] PUT /identity/v3/projects/2101dde305df44bc90d33b01976e8265/users/f36355ce7ff841f3bd9e228fbad64a83/roles/b3ce4434b13d4e46a67de5728f7ee232 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:10:42.305632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f65a64-64a5-4e76-b5ff-3f2b40a1eda5 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:42.308499 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d216213-16b3-4eb3-8429-234637391c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:42.309214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d216213-16b3-4eb3-8429-234637391c3d None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:42.309499 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d216213-16b3-4eb3-8429-234637391c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:42.309789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d216213-16b3-4eb3-8429-234637391c3d None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:42.310530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d216213-16b3-4eb3-8429-234637391c3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:42.310843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d216213-16b3-4eb3-8429-234637391c3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:42.312359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d216213-16b3-4eb3-8429-234637391c3d None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:42.331195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 298/586] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:42.332896 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d216213-16b3-4eb3-8429-234637391c3d None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:42.444857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f65a64-64a5-4e76-b5ff-3f2b40a1eda5 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:42.459708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:42.473760 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d216213-16b3-4eb3-8429-234637391c3d None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:42.496851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e711569-824d-4347-87d6-a2ca4360869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:42.497690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e711569-824d-4347-87d6-a2ca4360869d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:42.497988 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e711569-824d-4347-87d6-a2ca4360869d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:42.498427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e711569-824d-4347-87d6-a2ca4360869d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:42.510653 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e711569-824d-4347-87d6-a2ca4360869d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:42.512123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e711569-824d-4347-87d6-a2ca4360869d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:42.527987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e075f6-fb20-4a60-98eb-3a84ea02bfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:42.529145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e075f6-fb20-4a60-98eb-3a84ea02bfed None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:42.529686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e075f6-fb20-4a60-98eb-3a84ea02bfed None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:42.530212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e075f6-fb20-4a60-98eb-3a84ea02bfed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-8e711569-824d-4347-87d6-a2ca4360869d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:42.532605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:42.533522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:42.534449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:42.534449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:42.534449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:42.534449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:42.534449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 289/587] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:42.540117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e711569-824d-4347-87d6-a2ca4360869d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:42.546728 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e075f6-fb20-4a60-98eb-3a84ea02bfed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:42.548494 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e075f6-fb20-4a60-98eb-3a84ea02bfed None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:42.572941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-a2e075f6-fb20-4a60-98eb-3a84ea02bfed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:42.576362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:42.577297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:42.578214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:42.578214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:42.578214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:42.578214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:42.578973 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 299/588] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:42.579652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e075f6-fb20-4a60-98eb-3a84ea02bfed None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:42.655289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e711569-824d-4347-87d6-a2ca4360869d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:42.684549 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e075f6-fb20-4a60-98eb-3a84ea02bfed None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:42.695970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300970ca-a797-44fe-91d6-8779510f0e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:42.697044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300970ca-a797-44fe-91d6-8779510f0e93 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:42.697667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300970ca-a797-44fe-91d6-8779510f0e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:42.698163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300970ca-a797-44fe-91d6-8779510f0e93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:42.705793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300970ca-a797-44fe-91d6-8779510f0e93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:42.708410 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300970ca-a797-44fe-91d6-8779510f0e93 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:42.718967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8edbf-f02d-44c2-bb20-fa067a1328c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:42.719626 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8edbf-f02d-44c2-bb20-fa067a1328c4 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:42.719903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8edbf-f02d-44c2-bb20-fa067a1328c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:42.720177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8edbf-f02d-44c2-bb20-fa067a1328c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:42.720892 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8edbf-f02d-44c2-bb20-fa067a1328c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:42.721218 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8edbf-f02d-44c2-bb20-fa067a1328c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:42.723256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8edbf-f02d-44c2-bb20-fa067a1328c4 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-300970ca-a797-44fe-91d6-8779510f0e93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:42.726394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:42.727264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:42.728263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:42.728263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:42.728263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:42.728263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:42.728263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:42.728263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:42.728263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:42.728263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:42.730546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 290/589] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:42.731536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300970ca-a797-44fe-91d6-8779510f0e93 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:42.736054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 300/590] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:42.737069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8edbf-f02d-44c2-bb20-fa067a1328c4 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:42.740091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:42.830064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:42.838044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8edbf-f02d-44c2-bb20-fa067a1328c4 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:42.840430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300970ca-a797-44fe-91d6-8779510f0e93 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:42.874306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d821ab-fb46-40f8-b79b-cfcfd46bd774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:42.874957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d821ab-fb46-40f8-b79b-cfcfd46bd774 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:42.875244 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d821ab-fb46-40f8-b79b-cfcfd46bd774 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:42.875519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d821ab-fb46-40f8-b79b-cfcfd46bd774 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:42.876312 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d821ab-fb46-40f8-b79b-cfcfd46bd774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:42.876620 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d821ab-fb46-40f8-b79b-cfcfd46bd774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:42.877663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ca032-b8b2-4dab-944c-e4ba098ff43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:42.878083 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d821ab-fb46-40f8-b79b-cfcfd46bd774 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:42.879263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca032-b8b2-4dab-944c-e4ba098ff43a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:42.879739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca032-b8b2-4dab-944c-e4ba098ff43a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:42.880262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca032-b8b2-4dab-944c-e4ba098ff43a None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:42.881281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ca032-b8b2-4dab-944c-e4ba098ff43a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:42.881812 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ca032-b8b2-4dab-944c-e4ba098ff43a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:42.883298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ca032-b8b2-4dab-944c-e4ba098ff43a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:42.896739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 301/591] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:42.896739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d821ab-fb46-40f8-b79b-cfcfd46bd774 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:42.901380 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 291/592] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:42.913089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ca032-b8b2-4dab-944c-e4ba098ff43a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:43.025158 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:43.065011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d821ab-fb46-40f8-b79b-cfcfd46bd774 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:43.074557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ca032-b8b2-4dab-944c-e4ba098ff43a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:43.101174 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cee3cd-0a59-4586-a0c8-f73f6373d48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:43.102120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cee3cd-0a59-4586-a0c8-f73f6373d48a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:43.102768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cee3cd-0a59-4586-a0c8-f73f6373d48a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:43.102768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cee3cd-0a59-4586-a0c8-f73f6373d48a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:43.110866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cee3cd-0a59-4586-a0c8-f73f6373d48a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:43.112410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cee3cd-0a59-4586-a0c8-f73f6373d48a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:43.115314 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2e3e3-325a-4f33-a6cd-3a3d40802dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:43.116476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2e3e3-325a-4f33-a6cd-3a3d40802dfe None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:43.116906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2e3e3-325a-4f33-a6cd-3a3d40802dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:43.117359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2e3e3-325a-4f33-a6cd-3a3d40802dfe None admin] PATH_INFO: `/v3/projects/2101dde305df44bc90d33b01976e8265/users/f9f9ba17c2634999b350b887a5229e63/roles/b3ce4434b13d4e46a67de5728f7ee232` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-23cee3cd-0a59-4586-a0c8-f73f6373d48a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:43.128219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:43.129954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:43.131156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:43.131156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:43.131156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:43.131156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:43.131156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:43.131156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:43.131156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:43.131156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:43.131156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 16:10:43.131156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:43.133088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 302/593] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:43.134087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cee3cd-0a59-4586-a0c8-f73f6373d48a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:43.138072 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2e3e3-325a-4f33-a6cd-3a3d40802dfe None admin] RBAC: Authorizing `identity:create_grant(project_id=2101dde305df44bc90d33b01976e8265, user_id=f9f9ba17c2634999b350b887a5229e63, role_id=b3ce4434b13d4e46a67de5728f7ee232)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:43.139696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2e3e3-325a-4f33-a6cd-3a3d40802dfe None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:43.197540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:43.209938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 292/594] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:10:42 2022] PUT /identity/v3/projects/2101dde305df44bc90d33b01976e8265/users/f9f9ba17c2634999b350b887a5229e63/roles/b3ce4434b13d4e46a67de5728f7ee232 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:10:43.211597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2e3e3-325a-4f33-a6cd-3a3d40802dfe None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:43.272443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cee3cd-0a59-4586-a0c8-f73f6373d48a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:43.299076 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:43.320547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc307c9-b365-43d3-89c9-849a99f673ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:43.321664 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc307c9-b365-43d3-89c9-849a99f673ff None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:43.322093 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc307c9-b365-43d3-89c9-849a99f673ff None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:43.322543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc307c9-b365-43d3-89c9-849a99f673ff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:43.331711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc307c9-b365-43d3-89c9-849a99f673ff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:43.333605 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc307c9-b365-43d3-89c9-849a99f673ff None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-3cc307c9-b365-43d3-89c9-849a99f673ff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:43.350674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:43.351910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:43.353088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:43.353088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:43.353088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:43.353088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:43.353088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:43.353088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:43.353088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:43.353088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:43.353088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 16:10:43.353088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:43.355607 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 303/595] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:43.361143 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc307c9-b365-43d3-89c9-849a99f673ff None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:43.405020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2e3e3-325a-4f33-a6cd-3a3d40802dfe None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:43.479008 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc307c9-b365-43d3-89c9-849a99f673ff None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:43.480612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b3a00-fadf-4894-bf99-e87b85d92f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:43.481471 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3a00-fadf-4894-bf99-e87b85d92f98 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:43.481867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3a00-fadf-4894-bf99-e87b85d92f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:43.482273 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3a00-fadf-4894-bf99-e87b85d92f98 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:43.483422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b3a00-fadf-4894-bf99-e87b85d92f98 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:43.483660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b3a00-fadf-4894-bf99-e87b85d92f98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:43.485342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b3a00-fadf-4894-bf99-e87b85d92f98 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:43.517459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24cb13-7334-4093-940f-194d33087bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:43.518230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 293/596] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Jul 12 16:10:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:43.518626 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24cb13-7334-4093-940f-194d33087bff None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:43.519672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24cb13-7334-4093-940f-194d33087bff None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:43.520155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24cb13-7334-4093-940f-194d33087bff None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:43.521275 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24cb13-7334-4093-940f-194d33087bff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:43.521755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24cb13-7334-4093-940f-194d33087bff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:43.523453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24cb13-7334-4093-940f-194d33087bff None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:43.523996 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b3a00-fadf-4894-bf99-e87b85d92f98 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:43.544644 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 304/597] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Jul 12 16:10:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:43.550634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24cb13-7334-4093-940f-194d33087bff None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:43.599012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:43.605563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:43.656392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b3a00-fadf-4894-bf99-e87b85d92f98 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:43.664178 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24cb13-7334-4093-940f-194d33087bff None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:43.699534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ef7e1-e004-402f-8394-e1d76436b789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:43.700475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ef7e1-e004-402f-8394-e1d76436b789 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:43.700867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ef7e1-e004-402f-8394-e1d76436b789 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:43.701285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ef7e1-e004-402f-8394-e1d76436b789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:43.702208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a06c1-814a-40f3-8bc9-315443b85979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:43.703157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a06c1-814a-40f3-8bc9-315443b85979 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:43.703747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a06c1-814a-40f3-8bc9-315443b85979 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:43.704481 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a06c1-814a-40f3-8bc9-315443b85979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:43.711955 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ef7e1-e004-402f-8394-e1d76436b789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:43.713574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ef7e1-e004-402f-8394-e1d76436b789 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:43.717053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a06c1-814a-40f3-8bc9-315443b85979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:43.718761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a06c1-814a-40f3-8bc9-315443b85979 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-913ef7e1-e004-402f-8394-e1d76436b789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:43.732295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:43.733397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:43.734507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:43.734507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:43.734507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:43.734507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:43.736212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 305/598] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:43.738141 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718165e2-bfbe-41c7-9414-eaa7485c337c None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:43.738544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718165e2-bfbe-41c7-9414-eaa7485c337c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:43.738922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718165e2-bfbe-41c7-9414-eaa7485c337c None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:43.740281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 306/599] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-d02a06c1-814a-40f3-8bc9-315443b85979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:43.741907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:43.742808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:43.743722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:43.743722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:43.743722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:43.743722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:43.745540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 294/600] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:43.750170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718165e2-bfbe-41c7-9414-eaa7485c337c None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:43.752597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9cc7c-6ff9-4016-be88-3187eacbaae0 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:43.753061 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9cc7c-6ff9-4016-be88-3187eacbaae0 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:43.754094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9cc7c-6ff9-4016-be88-3187eacbaae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:43.774810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-28b9cc7c-6ff9-4016-be88-3187eacbaae0 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:43.776718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-28b9cc7c-6ff9-4016-be88-3187eacbaae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:43.850160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:43.858895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 295/601] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:43.860349 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9cc7c-6ff9-4016-be88-3187eacbaae0 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:43.861619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718165e2-bfbe-41c7-9414-eaa7485c337c None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:43.914412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee4f96-ae8b-4bf1-836c-5e953505fb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:43.915252 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee4f96-ae8b-4bf1-836c-5e953505fb0e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:43.916209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee4f96-ae8b-4bf1-836c-5e953505fb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:43.916601 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee4f96-ae8b-4bf1-836c-5e953505fb0e None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:43.917473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee4f96-ae8b-4bf1-836c-5e953505fb0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:43.917890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee4f96-ae8b-4bf1-836c-5e953505fb0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:43.919269 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:43.920808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee4f96-ae8b-4bf1-836c-5e953505fb0e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:43.935584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 307/602] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:43.941373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee4f96-ae8b-4bf1-836c-5e953505fb0e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:44.001916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9cc7c-6ff9-4016-be88-3187eacbaae0 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:44.046219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f038e3-42c1-4735-87a8-92724f635c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:44.047065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f038e3-42c1-4735-87a8-92724f635c4f None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:44.047519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f038e3-42c1-4735-87a8-92724f635c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:44.047838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f038e3-42c1-4735-87a8-92724f635c4f None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:44.048799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f038e3-42c1-4735-87a8-92724f635c4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:44.049082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f038e3-42c1-4735-87a8-92724f635c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:44.050607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f038e3-42c1-4735-87a8-92724f635c4f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:44.058980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee4f96-ae8b-4bf1-836c-5e953505fb0e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:44.067313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 296/603] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:44.068344 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f038e3-42c1-4735-87a8-92724f635c4f None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:44.109794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0c87e-fcd7-4078-9944-18ae62b65b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:44.110833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c87e-fcd7-4078-9944-18ae62b65b1d None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:44.111767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c87e-fcd7-4078-9944-18ae62b65b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:44.112196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c87e-fcd7-4078-9944-18ae62b65b1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:44.126580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0c87e-fcd7-4078-9944-18ae62b65b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-b1c0c87e-fcd7-4078-9944-18ae62b65b1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:44.137786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:44.138968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:44.140003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:44.140003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:44.140003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:44.140003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:44.140003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:44.140003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:44.140003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:44.140003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:44.140003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:44.140003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:44.140003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:44.140003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:44.147335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 308/604] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:44.148333 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0c87e-fcd7-4078-9944-18ae62b65b1d None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:44.165957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:44.183241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:44.186477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f038e3-42c1-4735-87a8-92724f635c4f None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:44.233530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496c5a6-56e6-4c16-93cb-d7e7865f2647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:44.234728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c5a6-56e6-4c16-93cb-d7e7865f2647 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:44.235441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c5a6-56e6-4c16-93cb-d7e7865f2647 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:44.235862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c5a6-56e6-4c16-93cb-d7e7865f2647 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:44.245862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496c5a6-56e6-4c16-93cb-d7e7865f2647 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:44.248289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496c5a6-56e6-4c16-93cb-d7e7865f2647 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:44.268469 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0c87e-fcd7-4078-9944-18ae62b65b1d None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-e496c5a6-56e6-4c16-93cb-d7e7865f2647 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:44.268832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:44.269980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:44.271117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:44.271117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:44.271117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:44.271117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:44.271117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:44.271117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:44.271117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:44.271117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:44.279170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 297/605] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:44.280712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496c5a6-56e6-4c16-93cb-d7e7865f2647 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:44.309680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe75dae-5b01-4b6f-b525-b9e92d29c72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:44.310564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe75dae-5b01-4b6f-b525-b9e92d29c72b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:44.310985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe75dae-5b01-4b6f-b525-b9e92d29c72b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:44.311365 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe75dae-5b01-4b6f-b525-b9e92d29c72b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:44.319754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe75dae-5b01-4b6f-b525-b9e92d29c72b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:44.321693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe75dae-5b01-4b6f-b525-b9e92d29c72b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-5fe75dae-5b01-4b6f-b525-b9e92d29c72b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:44.336309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:44.337443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:44.338569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:44.338569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:44.338569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:44.338569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:44.338569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:44.338569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:44.338569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:44.338569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:44.340507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 309/606] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:44.341466 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe75dae-5b01-4b6f-b525-b9e92d29c72b None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:44.404315 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496c5a6-56e6-4c16-93cb-d7e7865f2647 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:44.424557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:44.445024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906400a9-6d1f-4e7e-87e1-81f7ee293d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:44.445846 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906400a9-6d1f-4e7e-87e1-81f7ee293d4d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:44.446170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906400a9-6d1f-4e7e-87e1-81f7ee293d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:44.446514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906400a9-6d1f-4e7e-87e1-81f7ee293d4d None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:44.447335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906400a9-6d1f-4e7e-87e1-81f7ee293d4d None admin] RBAC: Adding query filter params (name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:44.447750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906400a9-6d1f-4e7e-87e1-81f7ee293d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:44.450911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906400a9-6d1f-4e7e-87e1-81f7ee293d4d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:44.458158 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe75dae-5b01-4b6f-b525-b9e92d29c72b None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:44.460612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 298/607] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:44.461706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906400a9-6d1f-4e7e-87e1-81f7ee293d4d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:44.492744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:44.501076 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430bfd9-5524-41a9-a5e6-0e042bb448d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:44.509267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430bfd9-5524-41a9-a5e6-0e042bb448d1 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:44.509267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430bfd9-5524-41a9-a5e6-0e042bb448d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:44.509267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430bfd9-5524-41a9-a5e6-0e042bb448d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:44.509267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430bfd9-5524-41a9-a5e6-0e042bb448d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:44.509267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430bfd9-5524-41a9-a5e6-0e042bb448d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:44.509267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430bfd9-5524-41a9-a5e6-0e042bb448d1 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:44.518544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 310/608] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:44.519921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb3a09-46b0-4cd2-91c4-40341f1941c0 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:44.520260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb3a09-46b0-4cd2-91c4-40341f1941c0 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:44.520593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb3a09-46b0-4cd2-91c4-40341f1941c0 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:44.525991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 311/609] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:44.526805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb3a09-46b0-4cd2-91c4-40341f1941c0 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:44.576441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906400a9-6d1f-4e7e-87e1-81f7ee293d4d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:44.611241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7269-42c1-4055-b42e-d620fe8109c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:44.611907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7269-42c1-4055-b42e-d620fe8109c6 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:44.612192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7269-42c1-4055-b42e-d620fe8109c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:44.612465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7269-42c1-4055-b42e-d620fe8109c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:44.613912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f7269-42c1-4055-b42e-d620fe8109c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:44.614229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f7269-42c1-4055-b42e-d620fe8109c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:44.615653 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f7269-42c1-4055-b42e-d620fe8109c6 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:44.632861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 299/610] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:44.632861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7269-42c1-4055-b42e-d620fe8109c6 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:44.640114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb3a09-46b0-4cd2-91c4-40341f1941c0 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:44.671470 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:44.676699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3247f2-b664-4de6-b885-d9c3e2bcfd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:44.688269 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3247f2-b664-4de6-b885-d9c3e2bcfd6e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:44.688269 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3247f2-b664-4de6-b885-d9c3e2bcfd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:44.688269 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3247f2-b664-4de6-b885-d9c3e2bcfd6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:44.689722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3247f2-b664-4de6-b885-d9c3e2bcfd6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:44.691201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3247f2-b664-4de6-b885-d9c3e2bcfd6e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-5d3247f2-b664-4de6-b885-d9c3e2bcfd6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:44.709557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:44.710521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:44.711417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:44.711417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:44.711417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:44.711417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:44.711417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 312/611] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:44.713086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60ec0c-5469-4887-b554-64181e30112e None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:44.713086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60ec0c-5469-4887-b554-64181e30112e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:44.713086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60ec0c-5469-4887-b554-64181e30112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:44.723031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:44.729828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-4e60ec0c-5469-4887-b554-64181e30112e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:44.731012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4e60ec0c-5469-4887-b554-64181e30112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:44.742562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7269-42c1-4055-b42e-d620fe8109c6 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:44.778735 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5813346-a90b-4e82-a487-5f205c5a3f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:44.779997 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5813346-a90b-4e82-a487-5f205c5a3f27 None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:44.780585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5813346-a90b-4e82-a487-5f205c5a3f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:44.780936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5813346-a90b-4e82-a487-5f205c5a3f27 None admin] PATH_INFO: `/v3/projects/2101dde305df44bc90d33b01976e8265/users/835679599bc74ed5b1b481e9be4700c5/roles/b3ce4434b13d4e46a67de5728f7ee232` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:44.796932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5813346-a90b-4e82-a487-5f205c5a3f27 None admin] RBAC: Authorizing `identity:create_grant(project_id=2101dde305df44bc90d33b01976e8265, user_id=835679599bc74ed5b1b481e9be4700c5, role_id=b3ce4434b13d4e46a67de5728f7ee232)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:44.798146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 313/612] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:44.798481 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5813346-a90b-4e82-a487-5f205c5a3f27 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:44.798781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60ec0c-5469-4887-b554-64181e30112e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:44.897819 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60ec0c-5469-4887-b554-64181e30112e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:44.908709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 300/613] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:10:44 2022] PUT /identity/v3/projects/2101dde305df44bc90d33b01976e8265/users/835679599bc74ed5b1b481e9be4700c5/roles/b3ce4434b13d4e46a67de5728f7ee232 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:10:44.910407 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5813346-a90b-4e82-a487-5f205c5a3f27 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:44.921155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:44.951574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ff568-7246-4dce-9e3a-8938ceec68f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:44.952727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ff568-7246-4dce-9e3a-8938ceec68f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:44.953054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ff568-7246-4dce-9e3a-8938ceec68f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:44.953377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ff568-7246-4dce-9e3a-8938ceec68f1 None admin] PATH_INFO: `/v3/projects/2101dde305df44bc90d33b01976e8265/users/f6a4da4c1dca40f5bb5d158a6f33d9dc/roles/b3ce4434b13d4e46a67de5728f7ee232` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:44.974041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ff568-7246-4dce-9e3a-8938ceec68f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2101dde305df44bc90d33b01976e8265, user_id=f6a4da4c1dca40f5bb5d158a6f33d9dc, role_id=b3ce4434b13d4e46a67de5728f7ee232)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:44.975709 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ff568-7246-4dce-9e3a-8938ceec68f1 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:45.034725 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5813346-a90b-4e82-a487-5f205c5a3f27 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:45.042823 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 314/614] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:10:44 2022] PUT /identity/v3/projects/2101dde305df44bc90d33b01976e8265/users/f6a4da4c1dca40f5bb5d158a6f33d9dc/roles/b3ce4434b13d4e46a67de5728f7ee232 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:10:45.044718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ff568-7246-4dce-9e3a-8938ceec68f1 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:45.090773 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:45.098581 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6daca-a844-4fc7-be11-0f4bdb8070e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:45.099716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6daca-a844-4fc7-be11-0f4bdb8070e1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:45.100183 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6daca-a844-4fc7-be11-0f4bdb8070e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:45.100707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6daca-a844-4fc7-be11-0f4bdb8070e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:45.101879 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6daca-a844-4fc7-be11-0f4bdb8070e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:45.102379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6daca-a844-4fc7-be11-0f4bdb8070e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:45.104119 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6daca-a844-4fc7-be11-0f4bdb8070e1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:45.119465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 301/615] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:45.125698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6daca-a844-4fc7-be11-0f4bdb8070e1 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:45.183728 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ff568-7246-4dce-9e3a-8938ceec68f1 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:45.235947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98597956-f51f-4d34-8a03-fe0b8d281f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:45.237162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98597956-f51f-4d34-8a03-fe0b8d281f10 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:45.237162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98597956-f51f-4d34-8a03-fe0b8d281f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:45.237481 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98597956-f51f-4d34-8a03-fe0b8d281f10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:45.249254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98597956-f51f-4d34-8a03-fe0b8d281f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-98597956-f51f-4d34-8a03-fe0b8d281f10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:45.257916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:45.258904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:45.259733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:45.259733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:45.259733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:45.259733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:45.259733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:45.259733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:45.259733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:45.259733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:45.259733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:45.259733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:45.259733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:45.259733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:45.259733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 315/616] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:45.264937 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98597956-f51f-4d34-8a03-fe0b8d281f10 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:45.268258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6daca-a844-4fc7-be11-0f4bdb8070e1 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:45.300376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:45.310478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819e0ae-1a7a-4403-8924-7bf9cc6a279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:45.311544 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819e0ae-1a7a-4403-8924-7bf9cc6a279e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:45.312258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819e0ae-1a7a-4403-8924-7bf9cc6a279e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:45.312375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819e0ae-1a7a-4403-8924-7bf9cc6a279e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:45.322116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819e0ae-1a7a-4403-8924-7bf9cc6a279e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:45.323582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819e0ae-1a7a-4403-8924-7bf9cc6a279e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-8819e0ae-1a7a-4403-8924-7bf9cc6a279e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:45.340493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:45.341781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:45.343021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:45.343021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:45.343021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:45.343021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:45.343021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:45.343021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:45.343021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:45.343021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:45.343021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 16:10:45.343021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:45.343021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 302/617] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:10:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:45.347451 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819e0ae-1a7a-4403-8924-7bf9cc6a279e None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:45.426190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98597956-f51f-4d34-8a03-fe0b8d281f10 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:45.445484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:45.486642 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fd84d-49ed-4a3c-bf6f-7877ff8589a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:45.487244 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fd84d-49ed-4a3c-bf6f-7877ff8589a3 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:45.487552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fd84d-49ed-4a3c-bf6f-7877ff8589a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:45.488359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fd84d-49ed-4a3c-bf6f-7877ff8589a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:45.489139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fd84d-49ed-4a3c-bf6f-7877ff8589a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:45.489632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fd84d-49ed-4a3c-bf6f-7877ff8589a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:45.491039 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fd84d-49ed-4a3c-bf6f-7877ff8589a3 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:45.505870 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 316/618] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:45.510028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fd84d-49ed-4a3c-bf6f-7877ff8589a3 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:45.534498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819e0ae-1a7a-4403-8924-7bf9cc6a279e None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:45.593178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bee58-06dd-45ad-82fb-5c53c8a32d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:45.593931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bee58-06dd-45ad-82fb-5c53c8a32d85 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:45.594218 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bee58-06dd-45ad-82fb-5c53c8a32d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:45.594496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bee58-06dd-45ad-82fb-5c53c8a32d85 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:45.595356 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8bee58-06dd-45ad-82fb-5c53c8a32d85 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:45.595669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8bee58-06dd-45ad-82fb-5c53c8a32d85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:45.597671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8bee58-06dd-45ad-82fb-5c53c8a32d85 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:45.632881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 303/619] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Jul 12 16:10:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:45.638509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bee58-06dd-45ad-82fb-5c53c8a32d85 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:45.664889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:45.690273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fd84d-49ed-4a3c-bf6f-7877ff8589a3 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:45.757175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80ac56-5a5a-4c3f-ad15-dc2cf8585e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:45.757914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80ac56-5a5a-4c3f-ad15-dc2cf8585e79 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:45.758194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80ac56-5a5a-4c3f-ad15-dc2cf8585e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:45.758465 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80ac56-5a5a-4c3f-ad15-dc2cf8585e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:45.771238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80ac56-5a5a-4c3f-ad15-dc2cf8585e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:45.773494 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80ac56-5a5a-4c3f-ad15-dc2cf8585e79 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:45.789042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bee58-06dd-45ad-82fb-5c53c8a32d85 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-cc80ac56-5a5a-4c3f-ad15-dc2cf8585e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:45.795737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:45.796633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:45.797560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:45.797560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:45.797560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:45.797560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:45.799417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 317/620] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:45.800041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9061-85ad-49b8-83c7-df998810b65e None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:45.800860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9061-85ad-49b8-83c7-df998810b65e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:45.801157 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9061-85ad-49b8-83c7-df998810b65e None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:45.806395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 318/621] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:45.806395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e9061-85ad-49b8-83c7-df998810b65e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:45.817494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:45.835312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbd9d2-7458-45cf-99a3-56f999c806c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:45.836575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbd9d2-7458-45cf-99a3-56f999c806c4 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:45.837062 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbd9d2-7458-45cf-99a3-56f999c806c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:45.842647 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbd9d2-7458-45cf-99a3-56f999c806c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:45.848769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbd9d2-7458-45cf-99a3-56f999c806c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:45.850516 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbd9d2-7458-45cf-99a3-56f999c806c4 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-a6dbd9d2-7458-45cf-99a3-56f999c806c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:45.870324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:45.875261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:45.876405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:45.876405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:45.876405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:45.876405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:45.876405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 304/622] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:45.876405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a501a-9431-4857-91e8-0d8ab0ce8e9f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:45.876405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a501a-9431-4857-91e8-0d8ab0ce8e9f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:45.876405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a501a-9431-4857-91e8-0d8ab0ce8e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:45.895503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-6e6a501a-9431-4857-91e8-0d8ab0ce8e9f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:45.896857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6e6a501a-9431-4857-91e8-0d8ab0ce8e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:45.911824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e9061-85ad-49b8-83c7-df998810b65e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:45.949565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c550f-24a8-4a44-b251-d46280573d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:45.950289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c550f-24a8-4a44-b251-d46280573d5f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:45.950571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c550f-24a8-4a44-b251-d46280573d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:45.950848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c550f-24a8-4a44-b251-d46280573d5f None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:45.951649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c550f-24a8-4a44-b251-d46280573d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:45.951955 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c550f-24a8-4a44-b251-d46280573d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:45.953749 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c550f-24a8-4a44-b251-d46280573d5f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:45.960851 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:45.966736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 319/623] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:45.967666 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c550f-24a8-4a44-b251-d46280573d5f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:45.977198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 305/624] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:45.978450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a501a-9431-4857-91e8-0d8ab0ce8e9f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:46.074460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c550f-24a8-4a44-b251-d46280573d5f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:46.090790 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:46.100139 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a501a-9431-4857-91e8-0d8ab0ce8e9f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:46.111544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b95c8-a454-44eb-b260-eaf1a5902445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:46.112400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b95c8-a454-44eb-b260-eaf1a5902445 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:46.113454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b95c8-a454-44eb-b260-eaf1a5902445 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:46.113899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b95c8-a454-44eb-b260-eaf1a5902445 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:46.114765 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b95c8-a454-44eb-b260-eaf1a5902445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:46.115231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b95c8-a454-44eb-b260-eaf1a5902445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:46.116803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b95c8-a454-44eb-b260-eaf1a5902445 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:46.131422 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 320/625] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:46.132540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b95c8-a454-44eb-b260-eaf1a5902445 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:46.136792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad448cb-f36d-42cb-841d-5a69b589b6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:46.137380 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad448cb-f36d-42cb-841d-5a69b589b6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:46.137665 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad448cb-f36d-42cb-841d-5a69b589b6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:46.137987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad448cb-f36d-42cb-841d-5a69b589b6e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:46.145854 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad448cb-f36d-42cb-841d-5a69b589b6e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:46.147117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad448cb-f36d-42cb-841d-5a69b589b6e1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-dad448cb-f36d-42cb-841d-5a69b589b6e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:46.162045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:46.163010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:46.163961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:46.163961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:46.163961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:46.163961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:46.163961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:46.163961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:46.163961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:46.163961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:46.163961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:10:46.163961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:46.163961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 306/626] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 16:10:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:46.164564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad448cb-f36d-42cb-841d-5a69b589b6e1 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:46.202260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:46.248352 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b95c8-a454-44eb-b260-eaf1a5902445 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:46.268426 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad448cb-f36d-42cb-841d-5a69b589b6e1 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:46.287646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817d206-4e9a-4cdc-8187-58168cddf454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:46.288825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d206-4e9a-4cdc-8187-58168cddf454 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:46.289326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d206-4e9a-4cdc-8187-58168cddf454 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:46.289871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d206-4e9a-4cdc-8187-58168cddf454 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:46.303554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817d206-4e9a-4cdc-8187-58168cddf454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:46.306259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1bdc6-4804-49cc-a08d-c841bd0af062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:46.307093 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1bdc6-4804-49cc-a08d-c841bd0af062 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:46.307378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1bdc6-4804-49cc-a08d-c841bd0af062 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:46.307650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1bdc6-4804-49cc-a08d-c841bd0af062 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-5817d206-4e9a-4cdc-8187-58168cddf454 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:46.312794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:46.313927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:46.315239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:46.315239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:46.315239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:46.315239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:46.315239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:46.315239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:46.315239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:46.315239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:46.315239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:46.315239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:46.315239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:46.315239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:46.317828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 321/627] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:46.318974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817d206-4e9a-4cdc-8187-58168cddf454 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:46.322799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1bdc6-4804-49cc-a08d-c841bd0af062 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:46.324880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1bdc6-4804-49cc-a08d-c841bd0af062 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-18f1bdc6-4804-49cc-a08d-c841bd0af062 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:46.340478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:46.341764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:46.342869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:46.342869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:46.342869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:46.342869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:46.342869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:46.342869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:46.342869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:46.342869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:46.344060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 307/628] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:46.344948 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1bdc6-4804-49cc-a08d-c841bd0af062 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:46.360469 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:46.435129 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817d206-4e9a-4cdc-8187-58168cddf454 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:46.448659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1bdc6-4804-49cc-a08d-c841bd0af062 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:46.454131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:46.474922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcdf38-11f1-4295-beb4-ad50f5998a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:46.475798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcdf38-11f1-4295-beb4-ad50f5998a92 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:46.476308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcdf38-11f1-4295-beb4-ad50f5998a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:46.476728 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcdf38-11f1-4295-beb4-ad50f5998a92 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:46.477845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcdf38-11f1-4295-beb4-ad50f5998a92 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:46.478299 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcdf38-11f1-4295-beb4-ad50f5998a92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:46.480100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcdf38-11f1-4295-beb4-ad50f5998a92 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:46.484991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a3d8a-9651-4c0e-9ec0-4bfdc3773f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:46.485754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a3d8a-9651-4c0e-9ec0-4bfdc3773f99 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:46.486108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a3d8a-9651-4c0e-9ec0-4bfdc3773f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:46.486452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a3d8a-9651-4c0e-9ec0-4bfdc3773f99 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:46.487263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a3d8a-9651-4c0e-9ec0-4bfdc3773f99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:46.487661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a3d8a-9651-4c0e-9ec0-4bfdc3773f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:46.489145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a3d8a-9651-4c0e-9ec0-4bfdc3773f99 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:46.501999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 308/629] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:46.502935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a3d8a-9651-4c0e-9ec0-4bfdc3773f99 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:46.505727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 322/630] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 16:10:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:46.511766 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcdf38-11f1-4295-beb4-ad50f5998a92 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:46.602129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:46.621876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcdf38-11f1-4295-beb4-ad50f5998a92 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:46.634196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a3d8a-9651-4c0e-9ec0-4bfdc3773f99 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:46.659429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb1d27-3710-4435-855d-1872c1974a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:46.660939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb1d27-3710-4435-855d-1872c1974a09 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:46.661331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb1d27-3710-4435-855d-1872c1974a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:46.661675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb1d27-3710-4435-855d-1872c1974a09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:46.673324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb1d27-3710-4435-855d-1872c1974a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:46.675686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb1d27-3710-4435-855d-1872c1974a09 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:46.677058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4e89a-8ac6-4d2c-96f2-3644a4946c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:46.678201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4e89a-8ac6-4d2c-96f2-3644a4946c73 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:46.679055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4e89a-8ac6-4d2c-96f2-3644a4946c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:46.679533 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4e89a-8ac6-4d2c-96f2-3644a4946c73 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:46.680505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4e89a-8ac6-4d2c-96f2-3644a4946c73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:46.680989 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4e89a-8ac6-4d2c-96f2-3644a4946c73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:46.682573 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4e89a-8ac6-4d2c-96f2-3644a4946c73 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-2abb1d27-3710-4435-855d-1872c1974a09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:46.696615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:46.697570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:46.698441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:46.698441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:46.698441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:46.698441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:46.700021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 309/632] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:46.701084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4e89a-8ac6-4d2c-96f2-3644a4946c73 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:46.702686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 323/632] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:46.703599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb1d27-3710-4435-855d-1872c1974a09 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:46.736029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:46.830639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb1d27-3710-4435-855d-1872c1974a09 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:46.831026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4e89a-8ac6-4d2c-96f2-3644a4946c73 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:46.868855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e2acd-fde5-46d2-9b10-5ff40189cdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:46.869649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e2acd-fde5-46d2-9b10-5ff40189cdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:46.870027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e2acd-fde5-46d2-9b10-5ff40189cdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:46.870528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e2acd-fde5-46d2-9b10-5ff40189cdf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:46.873348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:46.881330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436304cd-f11b-4988-a2b5-33ce1d08aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:46.882081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436304cd-f11b-4988-a2b5-33ce1d08aa51 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:46.882409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436304cd-f11b-4988-a2b5-33ce1d08aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:46.882690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436304cd-f11b-4988-a2b5-33ce1d08aa51 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:46.886672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436304cd-f11b-4988-a2b5-33ce1d08aa51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:46.887265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436304cd-f11b-4988-a2b5-33ce1d08aa51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:46.889617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436304cd-f11b-4988-a2b5-33ce1d08aa51 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:46.906697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 324/633] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:46.908052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436304cd-f11b-4988-a2b5-33ce1d08aa51 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:46.957413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e2acd-fde5-46d2-9b10-5ff40189cdf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:46.959096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e2acd-fde5-46d2-9b10-5ff40189cdf1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:47.029267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:47.044573 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436304cd-f11b-4988-a2b5-33ce1d08aa51 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:47.087903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 310/634] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:47.087903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e2acd-fde5-46d2-9b10-5ff40189cdf1 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:47.092341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68377e-0611-4c8e-a0cd-cb94c2f9eb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:47.093445 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68377e-0611-4c8e-a0cd-cb94c2f9eb74 None admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:47.093881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68377e-0611-4c8e-a0cd-cb94c2f9eb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:47.094338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68377e-0611-4c8e-a0cd-cb94c2f9eb74 None admin] PATH_INFO: `/v3/projects/2101dde305df44bc90d33b01976e8265/users/143798e5887b49338f0000de5b55be68/roles/b3ce4434b13d4e46a67de5728f7ee232` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:47.116376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68377e-0611-4c8e-a0cd-cb94c2f9eb74 None admin] RBAC: Authorizing `identity:create_grant(project_id=2101dde305df44bc90d33b01976e8265, user_id=143798e5887b49338f0000de5b55be68, role_id=b3ce4434b13d4e46a67de5728f7ee232)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:47.118802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68377e-0611-4c8e-a0cd-cb94c2f9eb74 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:47.127214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:47.205154 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 325/635] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:10:46 2022] PUT /identity/v3/projects/2101dde305df44bc90d33b01976e8265/users/143798e5887b49338f0000de5b55be68/roles/b3ce4434b13d4e46a67de5728f7ee232 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:10:47.205154 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68377e-0611-4c8e-a0cd-cb94c2f9eb74 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:47.209200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e2acd-fde5-46d2-9b10-5ff40189cdf1 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:47.269028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edc4f3-daa7-44aa-a284-f05b549cffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:47.269958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edc4f3-daa7-44aa-a284-f05b549cffaf None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:47.270201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edc4f3-daa7-44aa-a284-f05b549cffaf None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:47.270476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edc4f3-daa7-44aa-a284-f05b549cffaf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:47.279143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edc4f3-daa7-44aa-a284-f05b549cffaf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:47.280848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edc4f3-daa7-44aa-a284-f05b549cffaf None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-22edc4f3-daa7-44aa-a284-f05b549cffaf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:47.300968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:47.302122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:47.303816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:47.303816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:47.303816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:47.303816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:47.303816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:47.303816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:47.303816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:47.303816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:47.303816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 16:10:47.303816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:47.303816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 311/636] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:47.305145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4e683-223c-4baa-b5fd-845ceb6fded5 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:47.305446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4e683-223c-4baa-b5fd-845ceb6fded5 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:47.305721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4e683-223c-4baa-b5fd-845ceb6fded5 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:47.307685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 312/637] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:47.308666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476e3fc-48e3-40d0-a9e8-4576c41a66d2 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:47.309146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476e3fc-48e3-40d0-a9e8-4576c41a66d2 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:47.309426 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476e3fc-48e3-40d0-a9e8-4576c41a66d2 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:47.315486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 313/638] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:47.315486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476e3fc-48e3-40d0-a9e8-4576c41a66d2 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:47.357431 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68377e-0611-4c8e-a0cd-cb94c2f9eb74 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:47.401466 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbfc79-86e9-4889-abd0-1770a373bf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:47.402196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbfc79-86e9-4889-abd0-1770a373bf54 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:47.402481 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbfc79-86e9-4889-abd0-1770a373bf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:47.402759 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbfc79-86e9-4889-abd0-1770a373bf54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:47.413688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:47.415041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbfc79-86e9-4889-abd0-1770a373bf54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:47.417600 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbfc79-86e9-4889-abd0-1770a373bf54 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:47.420364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:47.428746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476e3fc-48e3-40d0-a9e8-4576c41a66d2 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-1abbfc79-86e9-4889-abd0-1770a373bf54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:47.435980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:47.436916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:47.437877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:47.437877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:47.437877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:47.437877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:47.437877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 326/639] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:47.438578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1477b6d-9305-49b5-b6b2-1f366b98482b None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:47.439441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1477b6d-9305-49b5-b6b2-1f366b98482b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:47.439441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1477b6d-9305-49b5-b6b2-1f366b98482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:47.459103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-d1477b6d-9305-49b5-b6b2-1f366b98482b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:47.460346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d1477b6d-9305-49b5-b6b2-1f366b98482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:47.473064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20266a36-3bc9-426b-a1e4-bcefa9b8c117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:47.476684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20266a36-3bc9-426b-a1e4-bcefa9b8c117 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:47.476684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20266a36-3bc9-426b-a1e4-bcefa9b8c117 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:47.476684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20266a36-3bc9-426b-a1e4-bcefa9b8c117 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:47.476684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20266a36-3bc9-426b-a1e4-bcefa9b8c117 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:47.476684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20266a36-3bc9-426b-a1e4-bcefa9b8c117 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:47.477175 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20266a36-3bc9-426b-a1e4-bcefa9b8c117 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:47.499351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 314/640] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Jul 12 16:10:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:47.499351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e0ce8-2102-4377-bd9d-1136efdaf9bc None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:47.499351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e0ce8-2102-4377-bd9d-1136efdaf9bc None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:47.499351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e0ce8-2102-4377-bd9d-1136efdaf9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:47.515776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-d54e0ce8-2102-4377-bd9d-1136efdaf9bc None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:47.516972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d54e0ce8-2102-4377-bd9d-1136efdaf9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:47.538071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 327/641] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:47.539775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1477b6d-9305-49b5-b6b2-1f366b98482b None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:47.589673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 315/642] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:47.590893 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e0ce8-2102-4377-bd9d-1136efdaf9bc None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:47.662152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1477b6d-9305-49b5-b6b2-1f366b98482b None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:47.683268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:47.693491 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:47.698977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06032468-36ba-4e42-ba37-6469587d2e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:47.699871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06032468-36ba-4e42-ba37-6469587d2e8c None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:47.699982 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06032468-36ba-4e42-ba37-6469587d2e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:47.700180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06032468-36ba-4e42-ba37-6469587d2e8c None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:47.700902 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06032468-36ba-4e42-ba37-6469587d2e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:47.701241 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06032468-36ba-4e42-ba37-6469587d2e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:47.702617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06032468-36ba-4e42-ba37-6469587d2e8c None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:47.712788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e0ce8-2102-4377-bd9d-1136efdaf9bc None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:47.718882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 328/643] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:47.718882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06032468-36ba-4e42-ba37-6469587d2e8c None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:47.752796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f57068-0d7c-423f-9196-a7b70ffcfe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:47.753993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57068-0d7c-423f-9196-a7b70ffcfe62 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:47.754277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57068-0d7c-423f-9196-a7b70ffcfe62 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:47.754555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57068-0d7c-423f-9196-a7b70ffcfe62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:47.823582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06032468-36ba-4e42-ba37-6469587d2e8c None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:47.828997 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f57068-0d7c-423f-9196-a7b70ffcfe62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:47.830890 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f57068-0d7c-423f-9196-a7b70ffcfe62 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:47.860490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5014d95-0387-4298-9ad7-a901223b0779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:47.861306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5014d95-0387-4298-9ad7-a901223b0779 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:47.861600 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5014d95-0387-4298-9ad7-a901223b0779 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:47.861886 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5014d95-0387-4298-9ad7-a901223b0779 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:47.872938 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5014d95-0387-4298-9ad7-a901223b0779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-e5014d95-0387-4298-9ad7-a901223b0779 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:47.880655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:47.881716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:47.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:47.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:47.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:47.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:47.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:47.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:47.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:47.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:47.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:47.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:47.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:47.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:47.882622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 329/644] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:47.883365 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5014d95-0387-4298-9ad7-a901223b0779 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:47.922700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:47.929054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:47.941977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 316/645] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:47.947021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f57068-0d7c-423f-9196-a7b70ffcfe62 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:47.989565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5014d95-0387-4298-9ad7-a901223b0779 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:48.025792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7f54b-4461-4f0d-9ea2-0d27ea4300fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:48.026949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f54b-4461-4f0d-9ea2-0d27ea4300fc None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:48.027237 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f54b-4461-4f0d-9ea2-0d27ea4300fc None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:48.027520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f54b-4461-4f0d-9ea2-0d27ea4300fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:48.038732 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7f54b-4461-4f0d-9ea2-0d27ea4300fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-12d7f54b-4461-4f0d-9ea2-0d27ea4300fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:48.046426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:48.047560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:48.048754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:48.048754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:48.048754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:48.048754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:48.048754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:48.048754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:48.048754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:48.048754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:48.048754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:48.048754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:48.048754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:48.048754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:48.052825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 330/646] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:48.052963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f57068-0d7c-423f-9196-a7b70ffcfe62 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:48.053599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7f54b-4461-4f0d-9ea2-0d27ea4300fc None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:48.088074 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d9767-b11d-41bb-a19d-fe959b1269a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:48.088999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9767-b11d-41bb-a19d-fe959b1269a1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:48.089384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9767-b11d-41bb-a19d-fe959b1269a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:48.089738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9767-b11d-41bb-a19d-fe959b1269a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:48.096417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d9767-b11d-41bb-a19d-fe959b1269a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:48.098561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d9767-b11d-41bb-a19d-fe959b1269a1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-cf8d9767-b11d-41bb-a19d-fe959b1269a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:48.113495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:48.114616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:48.115562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:48.115562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:48.115562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:48.115562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:48.115562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:48.115562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:48.115562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:48.115562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:48.115562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 317/647] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:48.116078 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d9767-b11d-41bb-a19d-fe959b1269a1 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:48.159446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:48.162663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:48.166104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7f54b-4461-4f0d-9ea2-0d27ea4300fc None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:48.199326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fb93d-f92e-4c8a-a14c-1bb0a9ac302a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:48.200097 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fb93d-f92e-4c8a-a14c-1bb0a9ac302a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:48.200430 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fb93d-f92e-4c8a-a14c-1bb0a9ac302a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:48.200767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fb93d-f92e-4c8a-a14c-1bb0a9ac302a None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:48.201619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fb93d-f92e-4c8a-a14c-1bb0a9ac302a None admin] RBAC: Adding query filter params (name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:48.201989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fb93d-f92e-4c8a-a14c-1bb0a9ac302a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:48.203959 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fb93d-f92e-4c8a-a14c-1bb0a9ac302a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:48.212314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 331/648] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:48.213322 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fb93d-f92e-4c8a-a14c-1bb0a9ac302a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:48.224488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d9767-b11d-41bb-a19d-fe959b1269a1 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:48.261570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5cb3f-5bb1-4b7c-94a5-d34793ad19a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:48.262371 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5cb3f-5bb1-4b7c-94a5-d34793ad19a4 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:48.262660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5cb3f-5bb1-4b7c-94a5-d34793ad19a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:48.262943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5cb3f-5bb1-4b7c-94a5-d34793ad19a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:48.273464 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5cb3f-5bb1-4b7c-94a5-d34793ad19a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:48.274921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5cb3f-5bb1-4b7c-94a5-d34793ad19a4 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-eed5cb3f-5bb1-4b7c-94a5-d34793ad19a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:48.293738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:48.294867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:48.295926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:48.295926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:48.295926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:48.295926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:48.299973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 318/649] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:48.300762 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5cb3f-5bb1-4b7c-94a5-d34793ad19a4 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:48.325305 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fb93d-f92e-4c8a-a14c-1bb0a9ac302a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:48.361587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586d4ba-9dc5-4dd3-9f9e-f050cff67bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:48.362254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586d4ba-9dc5-4dd3-9f9e-f050cff67bfc None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:48.362537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586d4ba-9dc5-4dd3-9f9e-f050cff67bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:48.362803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586d4ba-9dc5-4dd3-9f9e-f050cff67bfc None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:48.363545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586d4ba-9dc5-4dd3-9f9e-f050cff67bfc None admin] RBAC: Adding query filter params (name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:48.363849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586d4ba-9dc5-4dd3-9f9e-f050cff67bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:48.365231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586d4ba-9dc5-4dd3-9f9e-f050cff67bfc None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:48.375614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 332/650] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:48.377484 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586d4ba-9dc5-4dd3-9f9e-f050cff67bfc None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:48.402056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:48.408926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5cb3f-5bb1-4b7c-94a5-d34793ad19a4 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:48.410075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:48.444488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d7ddc-2a93-4af4-956b-f73b592e83a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:48.445169 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d7ddc-2a93-4af4-956b-f73b592e83a4 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:48.445458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d7ddc-2a93-4af4-956b-f73b592e83a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:48.445735 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d7ddc-2a93-4af4-956b-f73b592e83a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:48.446526 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d7ddc-2a93-4af4-956b-f73b592e83a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:48.446834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d7ddc-2a93-4af4-956b-f73b592e83a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:48.450533 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d7ddc-2a93-4af4-956b-f73b592e83a4 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:48.464392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 319/651] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:48.465243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d7ddc-2a93-4af4-956b-f73b592e83a4 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:48.505163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586d4ba-9dc5-4dd3-9f9e-f050cff67bfc None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:48.543613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c13a55-4e61-43ff-a217-b4699303e8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:48.544402 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c13a55-4e61-43ff-a217-b4699303e8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:48.544684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c13a55-4e61-43ff-a217-b4699303e8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:48.544958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c13a55-4e61-43ff-a217-b4699303e8d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:48.555437 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c13a55-4e61-43ff-a217-b4699303e8d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:48.556871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c13a55-4e61-43ff-a217-b4699303e8d0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-93c13a55-4e61-43ff-a217-b4699303e8d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:48.574179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:48.575265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:48.576358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:48.576358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:48.576358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:48.576358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:48.577406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d7ddc-2a93-4af4-956b-f73b592e83a4 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:48.579954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 333/652] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:48.580792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c13a55-4e61-43ff-a217-b4699303e8d0 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:48.617551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ee223-961c-436f-b403-1f831fa66966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:48.618215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ee223-961c-436f-b403-1f831fa66966 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:48.618501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ee223-961c-436f-b403-1f831fa66966 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:48.618779 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ee223-961c-436f-b403-1f831fa66966 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:48.619496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ee223-961c-436f-b403-1f831fa66966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:48.619803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ee223-961c-436f-b403-1f831fa66966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:48.621314 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ee223-961c-436f-b403-1f831fa66966 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:48.634400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 320/653] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:48.635188 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ee223-961c-436f-b403-1f831fa66966 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:48.651198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:48.662699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:48.685131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c13a55-4e61-43ff-a217-b4699303e8d0 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:48.721861 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d7875-8e09-4341-bddc-03b749469242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:48.723211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d7875-8e09-4341-bddc-03b749469242 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:48.723494 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d7875-8e09-4341-bddc-03b749469242 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:48.723762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d7875-8e09-4341-bddc-03b749469242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:48.734416 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d7875-8e09-4341-bddc-03b749469242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:48.735871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d7875-8e09-4341-bddc-03b749469242 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:48.743715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ee223-961c-436f-b403-1f831fa66966 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-898d7875-8e09-4341-bddc-03b749469242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:48.752722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:48.753854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:48.754772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:48.754772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:48.754772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:48.754772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:48.754772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 334/654] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:48.755067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d7875-8e09-4341-bddc-03b749469242 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:48.783435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530050a-d432-4d54-aae0-5aef32e10498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:48.784095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530050a-d432-4d54-aae0-5aef32e10498 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:48.784397 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530050a-d432-4d54-aae0-5aef32e10498 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:48.785242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530050a-d432-4d54-aae0-5aef32e10498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:48.786063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530050a-d432-4d54-aae0-5aef32e10498 None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=f36355ce7ff841f3bd9e228fbad64a83) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:48.786379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530050a-d432-4d54-aae0-5aef32e10498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:48.787799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530050a-d432-4d54-aae0-5aef32e10498 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:48.794488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 321/655] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:48 2022] GET /identity/v3/role_assignments?user.id=f36355ce7ff841f3bd9e228fbad64a83&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:48.795425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530050a-d432-4d54-aae0-5aef32e10498 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:48.884048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d7875-8e09-4341-bddc-03b749469242 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:48.894519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:48.916898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:48.925406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530050a-d432-4d54-aae0-5aef32e10498 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:48.926035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c020ca0-e493-4dfa-ba1a-8f435928f415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:48.926907 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c020ca0-e493-4dfa-ba1a-8f435928f415 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:48.927346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c020ca0-e493-4dfa-ba1a-8f435928f415 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:48.927844 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c020ca0-e493-4dfa-ba1a-8f435928f415 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:48.928726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c020ca0-e493-4dfa-ba1a-8f435928f415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:48.929195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c020ca0-e493-4dfa-ba1a-8f435928f415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:48.936608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c020ca0-e493-4dfa-ba1a-8f435928f415 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:48.944601 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 335/656] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:48.945861 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c020ca0-e493-4dfa-ba1a-8f435928f415 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:48.967693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3fbac-26e6-4de5-844e-af74acb5ec66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:48.968680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3fbac-26e6-4de5-844e-af74acb5ec66 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:48.969067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3fbac-26e6-4de5-844e-af74acb5ec66 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:48.969477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3fbac-26e6-4de5-844e-af74acb5ec66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:48.978252 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3fbac-26e6-4de5-844e-af74acb5ec66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:48.979636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3fbac-26e6-4de5-844e-af74acb5ec66 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-00b3fbac-26e6-4de5-844e-af74acb5ec66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:48.998857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:48.999978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:49.001100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:49.001100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:49.001100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:49.001100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:49.001100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:49.001100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:49.001100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:49.001100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:49.002536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 322/657] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:49.003566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3fbac-26e6-4de5-844e-af74acb5ec66 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:49.078182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c020ca0-e493-4dfa-ba1a-8f435928f415 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:49.120337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82c553-a6be-4f0c-a576-a50c246dc4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:49.121714 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82c553-a6be-4f0c-a576-a50c246dc4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:49.122238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82c553-a6be-4f0c-a576-a50c246dc4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:49.122611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82c553-a6be-4f0c-a576-a50c246dc4d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:49.123679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82c553-a6be-4f0c-a576-a50c246dc4d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:49.124082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82c553-a6be-4f0c-a576-a50c246dc4d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:49.126329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82c553-a6be-4f0c-a576-a50c246dc4d8 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:49.127615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3fbac-26e6-4de5-844e-af74acb5ec66 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:49.147406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 336/658] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:49.147406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82c553-a6be-4f0c-a576-a50c246dc4d8 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:49.168744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071ffd0-1888-4e47-aa5a-a637c9452c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:49.169758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071ffd0-1888-4e47-aa5a-a637c9452c2a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:49.170146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071ffd0-1888-4e47-aa5a-a637c9452c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:49.170501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071ffd0-1888-4e47-aa5a-a637c9452c2a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:49.181006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071ffd0-1888-4e47-aa5a-a637c9452c2a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:49.182547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071ffd0-1888-4e47-aa5a-a637c9452c2a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:49.184649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-2071ffd0-1888-4e47-aa5a-a637c9452c2a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:49.198872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:49.206087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:49.207636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:49.207636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:49.207636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:49.207636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:49.207636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:49.207636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:49.207636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:49.207636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:49.207636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 16:10:49.207636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:49.207636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 323/659] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:49.207636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071ffd0-1888-4e47-aa5a-a637c9452c2a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:49.219571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:49.273098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82c553-a6be-4f0c-a576-a50c246dc4d8 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:49.307917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7263ff-eb1d-45e6-8a84-970fb27badbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:49.308574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7263ff-eb1d-45e6-8a84-970fb27badbc None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:49.308925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7263ff-eb1d-45e6-8a84-970fb27badbc None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:49.309472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7263ff-eb1d-45e6-8a84-970fb27badbc None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:49.310014 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7263ff-eb1d-45e6-8a84-970fb27badbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:49.310318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7263ff-eb1d-45e6-8a84-970fb27badbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:49.311763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7263ff-eb1d-45e6-8a84-970fb27badbc None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:49.329623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 337/660] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:49.329623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7263ff-eb1d-45e6-8a84-970fb27badbc None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:49.339223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071ffd0-1888-4e47-aa5a-a637c9452c2a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:49.375685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395477a-e996-47f9-8186-febdf1366f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:49.376483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395477a-e996-47f9-8186-febdf1366f03 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:49.376762 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395477a-e996-47f9-8186-febdf1366f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:49.377050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395477a-e996-47f9-8186-febdf1366f03 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:49.385385 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395477a-e996-47f9-8186-febdf1366f03 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:49.386843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395477a-e996-47f9-8186-febdf1366f03 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-3395477a-e996-47f9-8186-febdf1366f03 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:49.402470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:49.403663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:49.404798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:49.404798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:49.404798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:49.404798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:49.404798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:49.404798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:49.404798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:49.404798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:49.404798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 16:10:49.404798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:49.404798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 324/661] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:49.405487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03511991-42e5-4d36-b8f5-4b558fc4764a None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:49.405487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03511991-42e5-4d36-b8f5-4b558fc4764a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:49.405731 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03511991-42e5-4d36-b8f5-4b558fc4764a None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:49.409146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 325/662] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:49.409146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03511991-42e5-4d36-b8f5-4b558fc4764a None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:49.436217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7263ff-eb1d-45e6-8a84-970fb27badbc None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:49.446604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:49.478060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:49.479394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf51e3-eb6d-4fd9-8915-bb916b26927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:49.480367 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf51e3-eb6d-4fd9-8915-bb916b26927d None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:49.480654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf51e3-eb6d-4fd9-8915-bb916b26927d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:49.481088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf51e3-eb6d-4fd9-8915-bb916b26927d None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:49.482062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf51e3-eb6d-4fd9-8915-bb916b26927d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:49.482636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf51e3-eb6d-4fd9-8915-bb916b26927d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:49.484148 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf51e3-eb6d-4fd9-8915-bb916b26927d None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:49.507274 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 338/663] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Jul 12 16:10:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:49.507274 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf51e3-eb6d-4fd9-8915-bb916b26927d None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:49.529451 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03511991-42e5-4d36-b8f5-4b558fc4764a None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:49.564597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb584b-0953-4f91-a500-2a50062ba118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:49.565568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb584b-0953-4f91-a500-2a50062ba118 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:49.566415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb584b-0953-4f91-a500-2a50062ba118 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:49.566696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb584b-0953-4f91-a500-2a50062ba118 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:49.567535 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb584b-0953-4f91-a500-2a50062ba118 None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=f9f9ba17c2634999b350b887a5229e63) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:49.567849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb584b-0953-4f91-a500-2a50062ba118 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:49.569299 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb584b-0953-4f91-a500-2a50062ba118 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:49.581555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 326/664] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:49 2022] GET /identity/v3/role_assignments?user.id=f9f9ba17c2634999b350b887a5229e63&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:49.581555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ed339-e882-403a-af95-fec17b1df1dc None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:49.581555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ed339-e882-403a-af95-fec17b1df1dc None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:49.581555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ed339-e882-403a-af95-fec17b1df1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:49.600656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e87ed339-e882-403a-af95-fec17b1df1dc None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:49.602187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e87ed339-e882-403a-af95-fec17b1df1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:49.638613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf51e3-eb6d-4fd9-8915-bb916b26927d None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:49.681259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 327/665] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:49.682312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ed339-e882-403a-af95-fec17b1df1dc None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:49.688320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2cd4c-190d-4dd4-bbeb-e4dc5939ef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:49.689567 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2cd4c-190d-4dd4-bbeb-e4dc5939ef8e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:49.690045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2cd4c-190d-4dd4-bbeb-e4dc5939ef8e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:49.690495 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2cd4c-190d-4dd4-bbeb-e4dc5939ef8e None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:49.692744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2cd4c-190d-4dd4-bbeb-e4dc5939ef8e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:49.693272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2cd4c-190d-4dd4-bbeb-e4dc5939ef8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:49.695397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2cd4c-190d-4dd4-bbeb-e4dc5939ef8e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:49.721937 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 339/666] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Jul 12 16:10:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:49.723366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2cd4c-190d-4dd4-bbeb-e4dc5939ef8e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:49.749846 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:49.762209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:49.804231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ed339-e882-403a-af95-fec17b1df1dc None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:49.842882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebe17e-e333-4886-9d7a-024e47ceb7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:49.843537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebe17e-e333-4886-9d7a-024e47ceb7ac None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:49.843821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebe17e-e333-4886-9d7a-024e47ceb7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:49.844092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebe17e-e333-4886-9d7a-024e47ceb7ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:49.844913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2cd4c-190d-4dd4-bbeb-e4dc5939ef8e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:49.884758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea04ea-2349-4fba-94bb-2930b0dd9e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:49.885680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea04ea-2349-4fba-94bb-2930b0dd9e16 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:49.886074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea04ea-2349-4fba-94bb-2930b0dd9e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:49.886346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea04ea-2349-4fba-94bb-2930b0dd9e16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:49.898347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea04ea-2349-4fba-94bb-2930b0dd9e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-7dea04ea-2349-4fba-94bb-2930b0dd9e16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:49.907215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:49.908207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 340/667] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:49.909302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea04ea-2349-4fba-94bb-2930b0dd9e16 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:49.929783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebe17e-e333-4886-9d7a-024e47ceb7ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:49.932124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebe17e-e333-4886-9d7a-024e47ceb7ac None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:49.995029 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:49.999868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:50.026647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea04ea-2349-4fba-94bb-2930b0dd9e16 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:50.051513 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 328/668] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:50.052762 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebe17e-e333-4886-9d7a-024e47ceb7ac None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:50.073178 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39be2a-fa0a-40e9-9dbf-ea136f9ef903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:50.073848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39be2a-fa0a-40e9-9dbf-ea136f9ef903 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:50.074139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39be2a-fa0a-40e9-9dbf-ea136f9ef903 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:50.074417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39be2a-fa0a-40e9-9dbf-ea136f9ef903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:50.161062 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebe17e-e333-4886-9d7a-024e47ceb7ac None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:50.168306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39be2a-fa0a-40e9-9dbf-ea136f9ef903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:50.170522 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39be2a-fa0a-40e9-9dbf-ea136f9ef903 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:50.202511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e44b15-2c61-43c5-ae90-57d5c002cfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:50.203465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e44b15-2c61-43c5-ae90-57d5c002cfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:50.203763 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e44b15-2c61-43c5-ae90-57d5c002cfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:50.204048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e44b15-2c61-43c5-ae90-57d5c002cfc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:50.204805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e44b15-2c61-43c5-ae90-57d5c002cfc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:50.205317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e44b15-2c61-43c5-ae90-57d5c002cfc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:50.208026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e44b15-2c61-43c5-ae90-57d5c002cfc1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:50.218822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 329/669] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:50.219730 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e44b15-2c61-43c5-ae90-57d5c002cfc1 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:50.240091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:50.284953 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:50.304089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 341/670] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:50.305055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39be2a-fa0a-40e9-9dbf-ea136f9ef903 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:50.355086 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e44b15-2c61-43c5-ae90-57d5c002cfc1 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:50.401478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8401cfa-55ab-440b-83e2-3fe28b897c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:50.402517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8401cfa-55ab-440b-83e2-3fe28b897c6a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:50.402951 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8401cfa-55ab-440b-83e2-3fe28b897c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:50.403873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8401cfa-55ab-440b-83e2-3fe28b897c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:50.417158 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39be2a-fa0a-40e9-9dbf-ea136f9ef903 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:50.420412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8401cfa-55ab-440b-83e2-3fe28b897c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:50.422043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8401cfa-55ab-440b-83e2-3fe28b897c6a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-a8401cfa-55ab-440b-83e2-3fe28b897c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:50.441715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:50.442871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:50.443994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:50.443994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:50.443994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:50.443994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:50.443994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 330/671] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:50.444274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8401cfa-55ab-440b-83e2-3fe28b897c6a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:50.472998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a95c62-e292-4334-9df6-dcecbd07b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:50.474027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a95c62-e292-4334-9df6-dcecbd07b04a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:50.474616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a95c62-e292-4334-9df6-dcecbd07b04a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:50.475040 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a95c62-e292-4334-9df6-dcecbd07b04a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:50.488985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a95c62-e292-4334-9df6-dcecbd07b04a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:50.491149 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a95c62-e292-4334-9df6-dcecbd07b04a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-07a95c62-e292-4334-9df6-dcecbd07b04a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:50.514926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:50.516068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:50.517227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:50.517227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:50.517227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:50.517227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:50.519502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:50.519688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 342/672] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:50.520528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a95c62-e292-4334-9df6-dcecbd07b04a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:50.562986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8401cfa-55ab-440b-83e2-3fe28b897c6a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:50.566536 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:50.602880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dd5d7-eb82-48f4-aecc-e41e71f108e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:50.604151 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dd5d7-eb82-48f4-aecc-e41e71f108e1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:50.604829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dd5d7-eb82-48f4-aecc-e41e71f108e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:50.605442 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08dd5d7-eb82-48f4-aecc-e41e71f108e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:50.617548 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08dd5d7-eb82-48f4-aecc-e41e71f108e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:50.619409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08dd5d7-eb82-48f4-aecc-e41e71f108e1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-b08dd5d7-eb82-48f4-aecc-e41e71f108e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:50.639020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:50.639957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:50.640857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:50.640857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:50.640857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:50.640857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:50.642012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a95c62-e292-4334-9df6-dcecbd07b04a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:50.643093 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 331/673] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:50.644839 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dd5d7-eb82-48f4-aecc-e41e71f108e1 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:50.688231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f231f-759c-4803-bcab-3a8a2394f3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:50.689679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f231f-759c-4803-bcab-3a8a2394f3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:50.690194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f231f-759c-4803-bcab-3a8a2394f3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:50.691233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f231f-759c-4803-bcab-3a8a2394f3c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:50.692263 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f231f-759c-4803-bcab-3a8a2394f3c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:50.692823 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f231f-759c-4803-bcab-3a8a2394f3c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:50.694599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f231f-759c-4803-bcab-3a8a2394f3c5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:50.708274 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 343/674] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:50.709471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f231f-759c-4803-bcab-3a8a2394f3c5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:50.765320 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08dd5d7-eb82-48f4-aecc-e41e71f108e1 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:50.786617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:50.806732 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e62ef-460b-4d17-b3c0-875f0d793ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:50.807405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e62ef-460b-4d17-b3c0-875f0d793ccb None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:50.807689 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e62ef-460b-4d17-b3c0-875f0d793ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:50.807967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e62ef-460b-4d17-b3c0-875f0d793ccb None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:50.809220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e62ef-460b-4d17-b3c0-875f0d793ccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:50.809538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e62ef-460b-4d17-b3c0-875f0d793ccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:50.811221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e62ef-460b-4d17-b3c0-875f0d793ccb None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:50.817313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:50.824965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f231f-759c-4803-bcab-3a8a2394f3c5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:50.827008 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 332/675] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:50.828771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e62ef-460b-4d17-b3c0-875f0d793ccb None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:50.865427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31153-ea8d-4e6c-beb7-369e477fb81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:50.866541 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31153-ea8d-4e6c-beb7-369e477fb81f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:50.867135 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31153-ea8d-4e6c-beb7-369e477fb81f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:50.867664 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31153-ea8d-4e6c-beb7-369e477fb81f None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:50.868573 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f31153-ea8d-4e6c-beb7-369e477fb81f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:50.869104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f31153-ea8d-4e6c-beb7-369e477fb81f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:50.870854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f31153-ea8d-4e6c-beb7-369e477fb81f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:50.884554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 344/676] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:50.885737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31153-ea8d-4e6c-beb7-369e477fb81f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:50.971789 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e62ef-460b-4d17-b3c0-875f0d793ccb None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:51.006067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31153-ea8d-4e6c-beb7-369e477fb81f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:51.015947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4696f-b351-4c6d-be28-b19f859e124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:51.016747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4696f-b351-4c6d-be28-b19f859e124b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:51.017035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4696f-b351-4c6d-be28-b19f859e124b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:51.017342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4696f-b351-4c6d-be28-b19f859e124b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:51.023999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4696f-b351-4c6d-be28-b19f859e124b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:51.025470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4696f-b351-4c6d-be28-b19f859e124b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-6ba4696f-b351-4c6d-be28-b19f859e124b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:51.038923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:51.039809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:51.040693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:51.040693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:51.040693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:51.040693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:51.040693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:51.040693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:51.040693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:51.040693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:51.040693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 333/677] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:51.041232 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4696f-b351-4c6d-be28-b19f859e124b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:51.047743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2ae44-6f1c-4419-b7d5-3c44a4d10062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:51.048878 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ae44-6f1c-4419-b7d5-3c44a4d10062 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:51.049257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ae44-6f1c-4419-b7d5-3c44a4d10062 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:51.049588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ae44-6f1c-4419-b7d5-3c44a4d10062 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:51.058283 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2ae44-6f1c-4419-b7d5-3c44a4d10062 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:51.059843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2ae44-6f1c-4419-b7d5-3c44a4d10062 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-f6a2ae44-6f1c-4419-b7d5-3c44a4d10062 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:51.076115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:51.077078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:51.078075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:51.078075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:51.078075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:51.078075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:51.078075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:51.078075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:51.078075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:51.078075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:51.078075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 16:10:51.078075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:51.078075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 345/678] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:10:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:51.078738 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8ac94-f1ef-44f3-abf0-330586cd1035 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:51.078738 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8ac94-f1ef-44f3-abf0-330586cd1035 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:51.079386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8ac94-f1ef-44f3-abf0-330586cd1035 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:51.084261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 346/679] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:51.084885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8ac94-f1ef-44f3-abf0-330586cd1035 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:51.090313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:51.104021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:51.154686 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4696f-b351-4c6d-be28-b19f859e124b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:51.187919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8ac94-f1ef-44f3-abf0-330586cd1035 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:51.193107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeeae88-e0ce-41a7-8c8d-92ffff7651c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:51.193929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeae88-e0ce-41a7-8c8d-92ffff7651c7 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:51.194217 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeae88-e0ce-41a7-8c8d-92ffff7651c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:51.194498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeae88-e0ce-41a7-8c8d-92ffff7651c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:51.201091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeeae88-e0ce-41a7-8c8d-92ffff7651c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:51.202572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeeae88-e0ce-41a7-8c8d-92ffff7651c7 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-6aeeae88-e0ce-41a7-8c8d-92ffff7651c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:51.216745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:51.217688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:51.218577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:51.218577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:51.218577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:51.218577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:51.218577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:51.218577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:51.218577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:51.218577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:51.222579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 334/680] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:51.223318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeeae88-e0ce-41a7-8c8d-92ffff7651c7 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:51.225372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b2f3d-b99f-4082-ad4b-d141ceb49529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:51.226031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b2f3d-b99f-4082-ad4b-d141ceb49529 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:51.226314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b2f3d-b99f-4082-ad4b-d141ceb49529 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:51.226586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b2f3d-b99f-4082-ad4b-d141ceb49529 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:51.227376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b2f3d-b99f-4082-ad4b-d141ceb49529 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:51.227700 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b2f3d-b99f-4082-ad4b-d141ceb49529 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:51.229131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b2f3d-b99f-4082-ad4b-d141ceb49529 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:51.242066 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 347/681] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:51.243291 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9093ef-c59c-4525-9451-41174408082f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:51.243582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9093ef-c59c-4525-9451-41174408082f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:51.243855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9093ef-c59c-4525-9451-41174408082f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:51.260911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-cc9093ef-c59c-4525-9451-41174408082f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:51.262123 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-cc9093ef-c59c-4525-9451-41174408082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:51.327320 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:51.330843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeeae88-e0ce-41a7-8c8d-92ffff7651c7 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:51.341246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 348/682] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:51.341246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9093ef-c59c-4525-9451-41174408082f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:51.357947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:51.367780 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629570e-6834-4146-b419-7554307f2218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:51.368554 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629570e-6834-4146-b419-7554307f2218 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:51.368857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629570e-6834-4146-b419-7554307f2218 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:51.369143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629570e-6834-4146-b419-7554307f2218 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:51.370062 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629570e-6834-4146-b419-7554307f2218 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:51.372147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629570e-6834-4146-b419-7554307f2218 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:51.372147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629570e-6834-4146-b419-7554307f2218 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:51.391205 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 335/683] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Jul 12 16:10:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:51.391870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629570e-6834-4146-b419-7554307f2218 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:51.465840 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9093ef-c59c-4525-9451-41174408082f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:51.502500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0b9c0-dadc-4e0a-a6b7-91d57960faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:51.503162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0b9c0-dadc-4e0a-a6b7-91d57960faf7 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:51.503451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0b9c0-dadc-4e0a-a6b7-91d57960faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:51.503727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0b9c0-dadc-4e0a-a6b7-91d57960faf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:51.504193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629570e-6834-4146-b419-7554307f2218 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:51.504514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0b9c0-dadc-4e0a-a6b7-91d57960faf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:51.504823 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0b9c0-dadc-4e0a-a6b7-91d57960faf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:51.506312 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0b9c0-dadc-4e0a-a6b7-91d57960faf7 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:51.518537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 349/684] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:51.519263 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0b9c0-dadc-4e0a-a6b7-91d57960faf7 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:51.545206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd970fbb-0360-4784-938f-dac6c6722903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:51.545873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd970fbb-0360-4784-938f-dac6c6722903 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:51.546160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd970fbb-0360-4784-938f-dac6c6722903 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:51.546443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd970fbb-0360-4784-938f-dac6c6722903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:51.547284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd970fbb-0360-4784-938f-dac6c6722903 None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=835679599bc74ed5b1b481e9be4700c5) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:51.547605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd970fbb-0360-4784-938f-dac6c6722903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:51.549030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd970fbb-0360-4784-938f-dac6c6722903 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:51.561158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 336/685] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:51 2022] GET /identity/v3/role_assignments?user.id=835679599bc74ed5b1b481e9be4700c5&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:51.561158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd970fbb-0360-4784-938f-dac6c6722903 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:51.585388 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:51.600059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:51.650124 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0b9c0-dadc-4e0a-a6b7-91d57960faf7 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:51.687518 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd970fbb-0360-4784-938f-dac6c6722903 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:51.693312 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b9f40-72c3-4346-9255-244375af48a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:51.694242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b9f40-72c3-4346-9255-244375af48a3 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:51.694602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b9f40-72c3-4346-9255-244375af48a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:51.694955 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b9f40-72c3-4346-9255-244375af48a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:51.709498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b9f40-72c3-4346-9255-244375af48a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-d70b9f40-72c3-4346-9255-244375af48a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:51.719296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:51.720318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:51.721217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:51.721217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:51.721217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:51.721217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:51.721217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:51.721217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:51.721217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:51.721217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:51.721217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:51.721217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:51.721217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:51.721217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:51.725199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 350/686] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:10:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:51.726446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b9f40-72c3-4346-9255-244375af48a3 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:51.744973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b559381-1010-4c04-b282-373b60ffa472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:51.745751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559381-1010-4c04-b282-373b60ffa472 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:51.746037 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559381-1010-4c04-b282-373b60ffa472 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:51.746313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559381-1010-4c04-b282-373b60ffa472 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:51.834684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b559381-1010-4c04-b282-373b60ffa472 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:51.836312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b559381-1010-4c04-b282-373b60ffa472 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:51.850881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b9f40-72c3-4346-9255-244375af48a3 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:51.858741 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:51.882111 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:51.890317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402996ff-adfb-4b5c-a9d1-aed0caa89a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:51.891027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402996ff-adfb-4b5c-a9d1-aed0caa89a32 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:51.891373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402996ff-adfb-4b5c-a9d1-aed0caa89a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:51.891651 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402996ff-adfb-4b5c-a9d1-aed0caa89a32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:51.892514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402996ff-adfb-4b5c-a9d1-aed0caa89a32 None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=f6a4da4c1dca40f5bb5d158a6f33d9dc) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:51.892829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402996ff-adfb-4b5c-a9d1-aed0caa89a32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:51.894847 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402996ff-adfb-4b5c-a9d1-aed0caa89a32 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:51.905151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 351/687] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:51 2022] GET /identity/v3/role_assignments?user.id=f6a4da4c1dca40f5bb5d158a6f33d9dc&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:51.905151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402996ff-adfb-4b5c-a9d1-aed0caa89a32 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:51.955899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 337/688] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:51.957739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb154d5-2c5b-4f24-90d7-1f85d2299e58 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:51.958131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb154d5-2c5b-4f24-90d7-1f85d2299e58 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:51.958609 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb154d5-2c5b-4f24-90d7-1f85d2299e58 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:51.964241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 338/689] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:51.965401 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb154d5-2c5b-4f24-90d7-1f85d2299e58 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:52.015739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402996ff-adfb-4b5c-a9d1-aed0caa89a32 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:52.053462 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33a017-2b0a-4eab-b9fe-8d5ab318d872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:52.054143 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a017-2b0a-4eab-b9fe-8d5ab318d872 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:52.054424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a017-2b0a-4eab-b9fe-8d5ab318d872 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:52.054697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a017-2b0a-4eab-b9fe-8d5ab318d872 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:52.055462 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33a017-2b0a-4eab-b9fe-8d5ab318d872 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:52.055767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33a017-2b0a-4eab-b9fe-8d5ab318d872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:52.057186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33a017-2b0a-4eab-b9fe-8d5ab318d872 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:52.067771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 352/690] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:52.069090 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62afb9-7f78-4eb4-b3e1-33bd170d8b6d None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:52.069416 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62afb9-7f78-4eb4-b3e1-33bd170d8b6d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:52.069747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62afb9-7f78-4eb4-b3e1-33bd170d8b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:52.087604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-7b62afb9-7f78-4eb4-b3e1-33bd170d8b6d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:52.088087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-7b62afb9-7f78-4eb4-b3e1-33bd170d8b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:52.111999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb154d5-2c5b-4f24-90d7-1f85d2299e58 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:52.149023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:52.156882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:52.165372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc9355-112f-4db0-8356-5d838880cca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:52.166300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc9355-112f-4db0-8356-5d838880cca6 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:52.166647 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc9355-112f-4db0-8356-5d838880cca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:52.167200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc9355-112f-4db0-8356-5d838880cca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:52.180262 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 353/691] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:52.180459 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc9355-112f-4db0-8356-5d838880cca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:52.181553 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62afb9-7f78-4eb4-b3e1-33bd170d8b6d None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:52.182334 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc9355-112f-4db0-8356-5d838880cca6 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-9ebc9355-112f-4db0-8356-5d838880cca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:52.202767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:52.203885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:52.205045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:52.205045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:52.205045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:52.205045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:52.205045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 339/692] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:52.210061 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc9355-112f-4db0-8356-5d838880cca6 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:52.310610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62afb9-7f78-4eb4-b3e1-33bd170d8b6d None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:52.313169 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc9355-112f-4db0-8356-5d838880cca6 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:52.349255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0c92-af01-4b4c-839e-71dcbdcc6128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:52.350300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0c92-af01-4b4c-839e-71dcbdcc6128 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:52.350731 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0c92-af01-4b4c-839e-71dcbdcc6128 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:52.351182 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0c92-af01-4b4c-839e-71dcbdcc6128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:52.353966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12fda3-eeaf-4772-b7a0-3b6c6cbefcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:52.355154 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12fda3-eeaf-4772-b7a0-3b6c6cbefcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:52.355552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12fda3-eeaf-4772-b7a0-3b6c6cbefcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:52.355936 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12fda3-eeaf-4772-b7a0-3b6c6cbefcc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:52.362703 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a0c92-af01-4b4c-839e-71dcbdcc6128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:52.364416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a0c92-af01-4b4c-839e-71dcbdcc6128 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:52.368688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12fda3-eeaf-4772-b7a0-3b6c6cbefcc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:52.370348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12fda3-eeaf-4772-b7a0-3b6c6cbefcc5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-ef6a0c92-af01-4b4c-839e-71dcbdcc6128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:52.383880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:52.385229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:52.386126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:52.386126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:52.386126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:52.386126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:52.392735 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 340/693] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:52.394365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0c92-af01-4b4c-839e-71dcbdcc6128 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-5d12fda3-eeaf-4772-b7a0-3b6c6cbefcc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:52.395059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:52.395906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:52.396820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:52.396820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:52.396820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:52.396820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:52.396820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 354/694] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:52.397349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12fda3-eeaf-4772-b7a0-3b6c6cbefcc5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:52.426061 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:52.445837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:52.511949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0c92-af01-4b4c-839e-71dcbdcc6128 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:52.541735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12fda3-eeaf-4772-b7a0-3b6c6cbefcc5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:52.560736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e328095-812b-4036-b876-71243b0de796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:52.561918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e328095-812b-4036-b876-71243b0de796 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:52.562758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e328095-812b-4036-b876-71243b0de796 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:52.563216 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e328095-812b-4036-b876-71243b0de796 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:52.564375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e328095-812b-4036-b876-71243b0de796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:52.564856 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e328095-812b-4036-b876-71243b0de796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:52.567906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e328095-812b-4036-b876-71243b0de796 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:52.582243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b1b8-7a7a-4328-a1ea-55a30495d0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:52.587222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b1b8-7a7a-4328-a1ea-55a30495d0ef None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:52.587222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b1b8-7a7a-4328-a1ea-55a30495d0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:52.587222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b1b8-7a7a-4328-a1ea-55a30495d0ef None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:52.587222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b1b8-7a7a-4328-a1ea-55a30495d0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:52.587222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b1b8-7a7a-4328-a1ea-55a30495d0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:52.587222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b1b8-7a7a-4328-a1ea-55a30495d0ef None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:52.587954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 341/695] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:52.589352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e328095-812b-4036-b876-71243b0de796 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:52.600370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 355/696] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:52.601321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b1b8-7a7a-4328-a1ea-55a30495d0ef None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:52.704971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:52.718319 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:52.726318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e328095-812b-4036-b876-71243b0de796 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:52.726456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b1b8-7a7a-4328-a1ea-55a30495d0ef None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:52.768091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1eedd3-c378-40e1-8719-b933dca3529e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:52.768920 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1eedd3-c378-40e1-8719-b933dca3529e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:52.769251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1eedd3-c378-40e1-8719-b933dca3529e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:52.769531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1eedd3-c378-40e1-8719-b933dca3529e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:52.770165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047cf2d-52e1-49de-bdaf-4553d50990cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:52.771591 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047cf2d-52e1-49de-bdaf-4553d50990cd None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:52.772081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047cf2d-52e1-49de-bdaf-4553d50990cd None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:52.773039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047cf2d-52e1-49de-bdaf-4553d50990cd None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:52.774401 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047cf2d-52e1-49de-bdaf-4553d50990cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:52.774891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047cf2d-52e1-49de-bdaf-4553d50990cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:52.776439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047cf2d-52e1-49de-bdaf-4553d50990cd None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:52.778432 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1eedd3-c378-40e1-8719-b933dca3529e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:52.780570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1eedd3-c378-40e1-8719-b933dca3529e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:52.791136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 342/697] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:52.792274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047cf2d-52e1-49de-bdaf-4553d50990cd None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-fc1eedd3-c378-40e1-8719-b933dca3529e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:52.797487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:52.798381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:52.799282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:52.799282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:52.799282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:52.799282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:52.799282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:52.799282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:52.799282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:52.799282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:52.803839 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 356/698] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:52.805374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1eedd3-c378-40e1-8719-b933dca3529e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:52.916241 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1eedd3-c378-40e1-8719-b933dca3529e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:52.930271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047cf2d-52e1-49de-bdaf-4553d50990cd None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:52.953671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18183a73-15bf-4469-be67-5ea8f197f2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:52.954257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18183a73-15bf-4469-be67-5ea8f197f2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:52.954540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18183a73-15bf-4469-be67-5ea8f197f2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:52.954821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18183a73-15bf-4469-be67-5ea8f197f2a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:52.962763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18183a73-15bf-4469-be67-5ea8f197f2a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:52.964167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18183a73-15bf-4469-be67-5ea8f197f2a2 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:52.974600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbe4a3-7f50-47cf-97ac-088a64bb7cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:52.975539 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbe4a3-7f50-47cf-97ac-088a64bb7cb0 None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:52.976017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbe4a3-7f50-47cf-97ac-088a64bb7cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:52.976485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbe4a3-7f50-47cf-97ac-088a64bb7cb0 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:52.977416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbe4a3-7f50-47cf-97ac-088a64bb7cb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-18183a73-15bf-4469-be67-5ea8f197f2a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:52.978855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:52.979757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:52.980798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:52.980798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:52.980798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:52.980798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:52.980798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:52.980798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:52.980798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:52.980798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:52.980798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:10:52.980798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:52.980798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 357/699] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 16:10:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:52.981443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18183a73-15bf-4469-be67-5ea8f197f2a2 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:52.982208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbe4a3-7f50-47cf-97ac-088a64bb7cb0 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:53.004053 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:53.048005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:53.061430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 343/700] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:10:52 2022] POST /identity/v3/users => generated 254 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:10:53.062733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbe4a3-7f50-47cf-97ac-088a64bb7cb0 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:53.102212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18183a73-15bf-4469-be67-5ea8f197f2a2 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:53.147429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84999c9-90b1-435b-86c6-7983b155b726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:53.148115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84999c9-90b1-435b-86c6-7983b155b726 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:53.148527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84999c9-90b1-435b-86c6-7983b155b726 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:53.148810 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84999c9-90b1-435b-86c6-7983b155b726 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:53.149862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84999c9-90b1-435b-86c6-7983b155b726 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:53.150178 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84999c9-90b1-435b-86c6-7983b155b726 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:53.152320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84999c9-90b1-435b-86c6-7983b155b726 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:53.177236 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 358/701] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:53.177236 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84999c9-90b1-435b-86c6-7983b155b726 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:53.288322 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:53.314840 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84999c9-90b1-435b-86c6-7983b155b726 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:53.319213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbe4a3-7f50-47cf-97ac-088a64bb7cb0 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:53.352736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4a349-ba35-41e9-a78b-679b6112441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:53.353416 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4a349-ba35-41e9-a78b-679b6112441b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:53.353697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4a349-ba35-41e9-a78b-679b6112441b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:53.353971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4a349-ba35-41e9-a78b-679b6112441b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:53.354798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4a349-ba35-41e9-a78b-679b6112441b None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=143798e5887b49338f0000de5b55be68) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:53.355342 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4a349-ba35-41e9-a78b-679b6112441b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:53.357524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4a349-ba35-41e9-a78b-679b6112441b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:53.369170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 359/702] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:53 2022] GET /identity/v3/role_assignments?user.id=143798e5887b49338f0000de5b55be68&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:53.371331 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beba18f-1240-49c2-bd61-f0b2eced77c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:53.372072 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba18f-1240-49c2-bd61-f0b2eced77c4 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:53.372357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba18f-1240-49c2-bd61-f0b2eced77c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:53.372634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba18f-1240-49c2-bd61-f0b2eced77c4 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:53.373536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beba18f-1240-49c2-bd61-f0b2eced77c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:53.373849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beba18f-1240-49c2-bd61-f0b2eced77c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:53.375306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beba18f-1240-49c2-bd61-f0b2eced77c4 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:53.396989 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 344/703] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 16:10:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:53.406377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4a349-ba35-41e9-a78b-679b6112441b None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:53.537460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4a349-ba35-41e9-a78b-679b6112441b None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:53.579726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34be17-2242-4d29-b2b6-93dc13484ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:53.580777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34be17-2242-4d29-b2b6-93dc13484ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:53.581063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34be17-2242-4d29-b2b6-93dc13484ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:53.581431 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34be17-2242-4d29-b2b6-93dc13484ac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:53.591559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:53.657734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34be17-2242-4d29-b2b6-93dc13484ac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:53.660100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34be17-2242-4d29-b2b6-93dc13484ac3 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:53.765977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 360/704] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:53.771233 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beba18f-1240-49c2-bd61-f0b2eced77c4 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:53.825219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d17a8-1ab4-48f9-badb-40f0562f3aa2 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:53.825860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d17a8-1ab4-48f9-badb-40f0562f3aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:53.826344 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d17a8-1ab4-48f9-badb-40f0562f3aa2 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:53.828151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 361/705] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:53.833678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8e839-e818-4bab-81ff-f124b926f167 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:53.834232 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8e839-e818-4bab-81ff-f124b926f167 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:53.834713 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8e839-e818-4bab-81ff-f124b926f167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:53.849481 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:53.858873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-8fe8e839-e818-4bab-81ff-f124b926f167 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:53.876851 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8fe8e839-e818-4bab-81ff-f124b926f167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:53.887815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beba18f-1240-49c2-bd61-f0b2eced77c4 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:53.895454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:53.932217 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b614f7-38ed-4108-ad86-77b3dd57e767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:53.933031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b614f7-38ed-4108-ad86-77b3dd57e767 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:53.933373 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b614f7-38ed-4108-ad86-77b3dd57e767 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:53.933702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b614f7-38ed-4108-ad86-77b3dd57e767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:53.939970 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 362/706] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 16:10:53.945380 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b614f7-38ed-4108-ad86-77b3dd57e767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:53.946829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b614f7-38ed-4108-ad86-77b3dd57e767 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:53.963879 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8e839-e818-4bab-81ff-f124b926f167 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-81b614f7-38ed-4108-ad86-77b3dd57e767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:53.965987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:53.966861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:53.967798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:53.967798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:53.967798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:53.967798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:53.967798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 345/707] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:53.974811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b614f7-38ed-4108-ad86-77b3dd57e767 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:54.093691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b614f7-38ed-4108-ad86-77b3dd57e767 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:54.101009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8e839-e818-4bab-81ff-f124b926f167 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:54.109006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:54.144317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec7907-81af-4de4-b1fe-5421555bf0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:54.145465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec7907-81af-4de4-b1fe-5421555bf0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:54.145966 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec7907-81af-4de4-b1fe-5421555bf0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:54.146455 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec7907-81af-4de4-b1fe-5421555bf0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:54.154601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec7907-81af-4de4-b1fe-5421555bf0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:54.155376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec7907-81af-4de4-b1fe-5421555bf0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:54.157075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec7907-81af-4de4-b1fe-5421555bf0a1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:54.175415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 346/708] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:54.181492 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec7907-81af-4de4-b1fe-5421555bf0a1 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:54.298685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec7907-81af-4de4-b1fe-5421555bf0a1 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:54.302077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a0c1-f4e6-48b6-9cd9-ae22de92736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:54.302821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a0c1-f4e6-48b6-9cd9-ae22de92736a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:54.303100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a0c1-f4e6-48b6-9cd9-ae22de92736a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:54.303373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a0c1-f4e6-48b6-9cd9-ae22de92736a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:54.304035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a0c1-f4e6-48b6-9cd9-ae22de92736a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:54.305463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a0c1-f4e6-48b6-9cd9-ae22de92736a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-c691a0c1-f4e6-48b6-9cd9-ae22de92736a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:54.323127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:54.324226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 16:10:54.325108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:54.325978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 363/709] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Jul 12 16:10:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:54.327473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1588ac-a6a8-49ba-9563-94bcc38c915f None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:54.327686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1588ac-a6a8-49ba-9563-94bcc38c915f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:54.327965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1588ac-a6a8-49ba-9563-94bcc38c915f None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:54.329564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 364/710] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:54.330851 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1588ac-a6a8-49ba-9563-94bcc38c915f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:54.344781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8be03-e2a1-49cb-a314-efa9a5002d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:54.346509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8be03-e2a1-49cb-a314-efa9a5002d29 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:54.346997 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8be03-e2a1-49cb-a314-efa9a5002d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:54.347423 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8be03-e2a1-49cb-a314-efa9a5002d29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:54.356897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8be03-e2a1-49cb-a314-efa9a5002d29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:54.359008 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8be03-e2a1-49cb-a314-efa9a5002d29 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:54.366182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-6ad8be03-e2a1-49cb-a314-efa9a5002d29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:54.380057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:54.387935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:54.388843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:54.388843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:54.388843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:54.388843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:54.388843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:54.388843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:54.388843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:54.388843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:54.388843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 347/711] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:54.388843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697a446-7894-48ea-a488-a1e0aabe7b11 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:54.388843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697a446-7894-48ea-a488-a1e0aabe7b11 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:54.389716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697a446-7894-48ea-a488-a1e0aabe7b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:54.404108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-5697a446-7894-48ea-a488-a1e0aabe7b11 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:54.406314 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5697a446-7894-48ea-a488-a1e0aabe7b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:54.433610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:54.474571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1588ac-a6a8-49ba-9563-94bcc38c915f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:54.484007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 348/712] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:54.485277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697a446-7894-48ea-a488-a1e0aabe7b11 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:54.517513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3bc4-a976-41a2-a328-c2618b3c789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:54.518550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3bc4-a976-41a2-a328-c2618b3c789a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:54.519904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3bc4-a976-41a2-a328-c2618b3c789a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:54.520294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3bc4-a976-41a2-a328-c2618b3c789a None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:54.521377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3bc4-a976-41a2-a328-c2618b3c789a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:54.521804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3bc4-a976-41a2-a328-c2618b3c789a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:54.523265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3bc4-a976-41a2-a328-c2618b3c789a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:54.535129 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 365/713] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Jul 12 16:10:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:54.536343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3bc4-a976-41a2-a328-c2618b3c789a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:54.594983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697a446-7894-48ea-a488-a1e0aabe7b11 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:54.645140 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b9468-c697-4b31-a41d-9c1c2e736ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:54.645140 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b9468-c697-4b31-a41d-9c1c2e736ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:54.645140 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b9468-c697-4b31-a41d-9c1c2e736ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:54.645140 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b9468-c697-4b31-a41d-9c1c2e736ea1 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:54.645639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b9468-c697-4b31-a41d-9c1c2e736ea1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:54.645639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b9468-c697-4b31-a41d-9c1c2e736ea1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:54.645639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b9468-c697-4b31-a41d-9c1c2e736ea1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:54.656213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 349/714] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:54.657257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b9468-c697-4b31-a41d-9c1c2e736ea1 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:54.667752 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:54.676338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3bc4-a976-41a2-a328-c2618b3c789a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:54.687109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:54.716049 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365ce3d-deca-4e17-9241-12fb2c64cd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:54.717155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ce3d-deca-4e17-9241-12fb2c64cd6c None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:54.717639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ce3d-deca-4e17-9241-12fb2c64cd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:54.718066 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ce3d-deca-4e17-9241-12fb2c64cd6c None admin] PATH_INFO: `/v3/services/network` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:54.718901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365ce3d-deca-4e17-9241-12fb2c64cd6c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:54.720477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365ce3d-deca-4e17-9241-12fb2c64cd6c None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-c365ce3d-deca-4e17-9241-12fb2c64cd6c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:54.733433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:54.734687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 16:10:54.735663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:54.737818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 366/715] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:54 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:54.744428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365ce3d-deca-4e17-9241-12fb2c64cd6c None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:54.763219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b9468-c697-4b31-a41d-9c1c2e736ea1 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:54.799724 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc089e9-b8ac-4fb5-bd98-b37b9b8a1e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:54.800425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc089e9-b8ac-4fb5-bd98-b37b9b8a1e4d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:54.800707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc089e9-b8ac-4fb5-bd98-b37b9b8a1e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:54.800987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc089e9-b8ac-4fb5-bd98-b37b9b8a1e4d None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:54.801733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc089e9-b8ac-4fb5-bd98-b37b9b8a1e4d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:54.802045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc089e9-b8ac-4fb5-bd98-b37b9b8a1e4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:54.803837 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc089e9-b8ac-4fb5-bd98-b37b9b8a1e4d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:54.811618 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 350/716] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Jul 12 16:10:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:54.812586 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc089e9-b8ac-4fb5-bd98-b37b9b8a1e4d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:54.858032 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365ce3d-deca-4e17-9241-12fb2c64cd6c None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:54.903761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756a7fa-c2a0-4267-a0bc-b269c8a4a9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:54.904837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756a7fa-c2a0-4267-a0bc-b269c8a4a9bf None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:54.905366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756a7fa-c2a0-4267-a0bc-b269c8a4a9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:54.905909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756a7fa-c2a0-4267-a0bc-b269c8a4a9bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:54.906994 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756a7fa-c2a0-4267-a0bc-b269c8a4a9bf None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=f36355ce7ff841f3bd9e228fbad64a83) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:54.907528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756a7fa-c2a0-4267-a0bc-b269c8a4a9bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:54.910224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756a7fa-c2a0-4267-a0bc-b269c8a4a9bf None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:54.918288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 367/717] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:54 2022] GET /identity/v3/role_assignments?user.id=f36355ce7ff841f3bd9e228fbad64a83&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:54.965497 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:54.992436 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc089e9-b8ac-4fb5-bd98-b37b9b8a1e4d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:55.034304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdcb0b-8b6e-44c6-8376-07ce655d28fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:55.035464 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdcb0b-8b6e-44c6-8376-07ce655d28fb None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:55.035756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdcb0b-8b6e-44c6-8376-07ce655d28fb None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:55.036042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdcb0b-8b6e-44c6-8376-07ce655d28fb None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:55.036875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdcb0b-8b6e-44c6-8376-07ce655d28fb None admin] RBAC: Adding query filter params (name=network) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:55.037317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdcb0b-8b6e-44c6-8376-07ce655d28fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:55.038783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdcb0b-8b6e-44c6-8376-07ce655d28fb None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:55.044406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 351/718] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 16:10:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:55.050443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756a7fa-c2a0-4267-a0bc-b269c8a4a9bf None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:55.086610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:55.173639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756a7fa-c2a0-4267-a0bc-b269c8a4a9bf None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:55.213449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90830b4a-147e-4f73-b773-1bc48f8aaf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:55.214551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90830b4a-147e-4f73-b773-1bc48f8aaf74 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:55.215042 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90830b4a-147e-4f73-b773-1bc48f8aaf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:55.215523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90830b4a-147e-4f73-b773-1bc48f8aaf74 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:55.216438 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90830b4a-147e-4f73-b773-1bc48f8aaf74 None admin] RBAC: Adding query filter params (type=network) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:55.216963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90830b4a-147e-4f73-b773-1bc48f8aaf74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:55.218587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90830b4a-147e-4f73-b773-1bc48f8aaf74 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:55.225176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 368/719] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 16:10:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:55.733800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a65c-cc14-4ee2-9ec7-f7352c7a3a62 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:55.734290 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a65c-cc14-4ee2-9ec7-f7352c7a3a62 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:55.734290 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a65c-cc14-4ee2-9ec7-f7352c7a3a62 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:55.735943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 352/720] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:55.741953 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbd197-8012-4133-b472-0ebb11cd8ea4 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:55.742406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbd197-8012-4133-b472-0ebb11cd8ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:55.742593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbd197-8012-4133-b472-0ebb11cd8ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:55.766114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-2bbbd197-8012-4133-b472-0ebb11cd8ea4 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:55.767312 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-2bbbd197-8012-4133-b472-0ebb11cd8ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:55.847307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 369/721] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:55.890618 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5a65c-cc14-4ee2-9ec7-f7352c7a3a62 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:56.019400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5a65c-cc14-4ee2-9ec7-f7352c7a3a62 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:56.063696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da242b14-e193-416c-90ab-63356d232345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:56.064776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242b14-e193-416c-90ab-63356d232345 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:56.065064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242b14-e193-416c-90ab-63356d232345 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:56.065367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242b14-e193-416c-90ab-63356d232345 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:56.076654 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da242b14-e193-416c-90ab-63356d232345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-da242b14-e193-416c-90ab-63356d232345 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:56.085281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:56.086209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:56.087066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:56.087066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:56.087066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:56.087066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:56.087066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:56.087066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:56.087066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:56.087066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:56.087066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:56.087066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:56.087066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:10:56.087066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:56.087066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 353/722] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:10:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:56.092625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbd197-8012-4133-b472-0ebb11cd8ea4 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:56.115914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:56.240525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbd197-8012-4133-b472-0ebb11cd8ea4 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:56.286794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ebd31-fb43-4765-bc04-61c8c281dd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:56.287106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab5139-8796-4918-ac3c-f0f55ebb313a None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:56.287106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab5139-8796-4918-ac3c-f0f55ebb313a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:56.287419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab5139-8796-4918-ac3c-f0f55ebb313a None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:56.287587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ebd31-fb43-4765-bc04-61c8c281dd65 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:56.287740 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ebd31-fb43-4765-bc04-61c8c281dd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:56.287915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ebd31-fb43-4765-bc04-61c8c281dd65 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:56.288769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 354/723] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:56.288939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ebd31-fb43-4765-bc04-61c8c281dd65 None admin] RBAC: Adding query filter params (name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:56.289152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ebd31-fb43-4765-bc04-61c8c281dd65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:56.290414 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ebd31-fb43-4765-bc04-61c8c281dd65 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:56.302353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a322ad-e04a-44d2-b843-7a58c2ff527d None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:56.302985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a322ad-e04a-44d2-b843-7a58c2ff527d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:56.303164 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 370/724] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:10:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:56.303712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a322ad-e04a-44d2-b843-7a58c2ff527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:56.308367 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ebd31-fb43-4765-bc04-61c8c281dd65 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:56.325047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a7a322ad-e04a-44d2-b843-7a58c2ff527d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:56.326294 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a7a322ad-e04a-44d2-b843-7a58c2ff527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:56.328711 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:56.412781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 355/725] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:56.454860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a322ad-e04a-44d2-b843-7a58c2ff527d None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:56.458960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:56.482975 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ebd31-fb43-4765-bc04-61c8c281dd65 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:56.526434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7b145-ed53-4a4f-a28d-a681f94bc324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:56.528319 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7b145-ed53-4a4f-a28d-a681f94bc324 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:56.529904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7b145-ed53-4a4f-a28d-a681f94bc324 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:56.530373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7b145-ed53-4a4f-a28d-a681f94bc324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:56.553165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7b145-ed53-4a4f-a28d-a681f94bc324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:56.555165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7b145-ed53-4a4f-a28d-a681f94bc324 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-cea7b145-ed53-4a4f-a28d-a681f94bc324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:56.585617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:56.586623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:56.587528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:56.587528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:56.587528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:56.587528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:56.590098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 371/726] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:56.595741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7b145-ed53-4a4f-a28d-a681f94bc324 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:56.699343 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a322ad-e04a-44d2-b843-7a58c2ff527d None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:56.750881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7b145-ed53-4a4f-a28d-a681f94bc324 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:56.786445 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:56.792821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff68443-d995-4631-b63e-7b23851d3fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:56.792968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374610fb-2c80-45ca-aa20-9945d0408256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:56.793753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374610fb-2c80-45ca-aa20-9945d0408256 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:56.794043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374610fb-2c80-45ca-aa20-9945d0408256 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:56.794323 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374610fb-2c80-45ca-aa20-9945d0408256 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:56.795030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff68443-d995-4631-b63e-7b23851d3fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:56.795517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff68443-d995-4631-b63e-7b23851d3fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:56.796160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff68443-d995-4631-b63e-7b23851d3fb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:56.797105 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff68443-d995-4631-b63e-7b23851d3fb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:56.797596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff68443-d995-4631-b63e-7b23851d3fb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:56.807559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff68443-d995-4631-b63e-7b23851d3fb5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:56.812969 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 372/727] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:56.819410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff68443-d995-4631-b63e-7b23851d3fb5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:56.822840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:56.834226 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374610fb-2c80-45ca-aa20-9945d0408256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-374610fb-2c80-45ca-aa20-9945d0408256 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:56.842272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:56.843319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:56.844220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:56.844220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:56.844220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:56.844220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:56.844220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:56.844220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:56.844220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:56.844220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:56.844220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:56.844220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:56.844220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:56.844220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:56.844220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 356/728] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:10:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:56.850245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374610fb-2c80-45ca-aa20-9945d0408256 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:56.936529 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff68443-d995-4631-b63e-7b23851d3fb5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:56.974219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba1de6-c6f8-44ad-90d1-f03bf2c4a339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:56.975444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba1de6-c6f8-44ad-90d1-f03bf2c4a339 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:56.975936 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba1de6-c6f8-44ad-90d1-f03bf2c4a339 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:56.976442 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba1de6-c6f8-44ad-90d1-f03bf2c4a339 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:56.984722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba1de6-c6f8-44ad-90d1-f03bf2c4a339 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:56.986456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba1de6-c6f8-44ad-90d1-f03bf2c4a339 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-16ba1de6-c6f8-44ad-90d1-f03bf2c4a339 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:57.003669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:57.004649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:57.005639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:57.005639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:57.005639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:57.005639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:57.005639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:57.005639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:57.005639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:57.005639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:57.005639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 16:10:57.005639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:57.008275 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 373/729] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 16:10:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:57.013875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba1de6-c6f8-44ad-90d1-f03bf2c4a339 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:57.071511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:57.107332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374610fb-2c80-45ca-aa20-9945d0408256 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:57.122610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba1de6-c6f8-44ad-90d1-f03bf2c4a339 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:57.158324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6be8b6-2ca1-49d1-82d1-56c33b56c895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:57.159523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6be8b6-2ca1-49d1-82d1-56c33b56c895 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:57.160020 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6be8b6-2ca1-49d1-82d1-56c33b56c895 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:57.160524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6be8b6-2ca1-49d1-82d1-56c33b56c895 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:57.161616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6be8b6-2ca1-49d1-82d1-56c33b56c895 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:57.162135 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6be8b6-2ca1-49d1-82d1-56c33b56c895 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:57.163791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6be8b6-2ca1-49d1-82d1-56c33b56c895 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:57.183029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 374/730] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Jul 12 16:10:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:10:57.189102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6be8b6-2ca1-49d1-82d1-56c33b56c895 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:57.199049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18ef1c-0f81-4328-af2b-617b716caf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:57.199741 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18ef1c-0f81-4328-af2b-617b716caf43 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:57.200076 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18ef1c-0f81-4328-af2b-617b716caf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:57.200345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18ef1c-0f81-4328-af2b-617b716caf43 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:57.201102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18ef1c-0f81-4328-af2b-617b716caf43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:57.201431 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18ef1c-0f81-4328-af2b-617b716caf43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:57.202809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18ef1c-0f81-4328-af2b-617b716caf43 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:57.211967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 357/731] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:57.213297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd39ff-738a-4a5e-af67-42e707629d44 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:57.213587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd39ff-738a-4a5e-af67-42e707629d44 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:57.213916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd39ff-738a-4a5e-af67-42e707629d44 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:57.215438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 358/732] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:57.220048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd39ff-738a-4a5e-af67-42e707629d44 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:57.294554 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:57.314500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6be8b6-2ca1-49d1-82d1-56c33b56c895 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:57.326611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:57.341102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd39ff-738a-4a5e-af67-42e707629d44 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:57.353525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cedb60-af2e-4ebb-b58e-7a255cd59985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:57.357539 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cedb60-af2e-4ebb-b58e-7a255cd59985 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:57.357539 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cedb60-af2e-4ebb-b58e-7a255cd59985 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:57.357539 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cedb60-af2e-4ebb-b58e-7a255cd59985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:57.384048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b6d5c-cda8-473b-b409-6c704d5afd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:57.385208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6d5c-cda8-473b-b409-6c704d5afd8f None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:57.385558 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6d5c-cda8-473b-b409-6c704d5afd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:57.385837 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6d5c-cda8-473b-b409-6c704d5afd8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:57.400194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b6d5c-cda8-473b-b409-6c704d5afd8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:57.401668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b6d5c-cda8-473b-b409-6c704d5afd8f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-809b6d5c-cda8-473b-b409-6c704d5afd8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:57.422985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:57.424902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:57.426834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:57.426834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:57.426834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:57.426834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:57.428875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 359/733] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:57.430954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902df03-17a5-4f04-a251-850c57a44062 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:57.431243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902df03-17a5-4f04-a251-850c57a44062 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:57.431520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902df03-17a5-4f04-a251-850c57a44062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:57.444860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cedb60-af2e-4ebb-b58e-7a255cd59985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:57.446817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cedb60-af2e-4ebb-b58e-7a255cd59985 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:57.455374 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-b902df03-17a5-4f04-a251-850c57a44062 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:57.457162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b902df03-17a5-4f04-a251-850c57a44062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:57.536001 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 360/734] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:57.536719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902df03-17a5-4f04-a251-850c57a44062 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:57.581443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:57.582268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 375/735] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:57.583989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fae42d-ab01-49cb-b499-d79be9d9a890 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:57.584397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fae42d-ab01-49cb-b499-d79be9d9a890 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:57.584576 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fae42d-ab01-49cb-b499-d79be9d9a890 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:57.585989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 376/736] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:57.586541 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fae42d-ab01-49cb-b499-d79be9d9a890 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:57.599308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:57.650298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902df03-17a5-4f04-a251-850c57a44062 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:57.685402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e359bc7-5f10-485d-960c-cf9a498181de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:57.686076 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359bc7-5f10-485d-960c-cf9a498181de None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:57.686364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359bc7-5f10-485d-960c-cf9a498181de None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:57.686644 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359bc7-5f10-485d-960c-cf9a498181de None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:57.687374 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e359bc7-5f10-485d-960c-cf9a498181de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:57.687684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e359bc7-5f10-485d-960c-cf9a498181de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:57.689336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e359bc7-5f10-485d-960c-cf9a498181de None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:57.700963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fae42d-ab01-49cb-b499-d79be9d9a890 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:57.701520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 361/737] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:57.702760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ce028-53fd-4fa4-9372-6f8b5790c77d None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:57.703050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ce028-53fd-4fa4-9372-6f8b5790c77d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:57.703333 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ce028-53fd-4fa4-9372-6f8b5790c77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:57.719946 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-172ce028-53fd-4fa4-9372-6f8b5790c77d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:57.721271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-172ce028-53fd-4fa4-9372-6f8b5790c77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:57.742167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418798d6-357d-4ef2-a588-b88e89c0c638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:57.743120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418798d6-357d-4ef2-a588-b88e89c0c638 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:57.743584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418798d6-357d-4ef2-a588-b88e89c0c638 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:57.744034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418798d6-357d-4ef2-a588-b88e89c0c638 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:57.744918 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418798d6-357d-4ef2-a588-b88e89c0c638 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:57.746470 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418798d6-357d-4ef2-a588-b88e89c0c638 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:57.790417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 362/738] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:57.791093 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ce028-53fd-4fa4-9372-6f8b5790c77d None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:57.829983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:57.850145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 377/739] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:10:57 2022] POST /identity/v3/services => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:10:57.850923 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418798d6-357d-4ef2-a588-b88e89c0c638 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:57.910961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ce028-53fd-4fa4-9372-6f8b5790c77d None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:57.926031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:57.959014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f138b2d-4f12-4386-aa27-cda59afdbe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:57.960452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138b2d-4f12-4386-aa27-cda59afdbe17 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:57.960565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418798d6-357d-4ef2-a588-b88e89c0c638 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:57.961088 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138b2d-4f12-4386-aa27-cda59afdbe17 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:57.961598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138b2d-4f12-4386-aa27-cda59afdbe17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:57.974728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f138b2d-4f12-4386-aa27-cda59afdbe17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:57.976619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f138b2d-4f12-4386-aa27-cda59afdbe17 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-9f138b2d-4f12-4386-aa27-cda59afdbe17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:57.996775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:57.997788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:57.998699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:57.998699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:57.998699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:57.998699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:57.998699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 363/740] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:57.998976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f138b2d-4f12-4386-aa27-cda59afdbe17 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:58.005489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caf1e8-853f-4b3e-af28-b83be684cecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:58.006356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caf1e8-853f-4b3e-af28-b83be684cecb None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:58.006640 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caf1e8-853f-4b3e-af28-b83be684cecb None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:58.007620 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caf1e8-853f-4b3e-af28-b83be684cecb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:58.015734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caf1e8-853f-4b3e-af28-b83be684cecb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:58.017429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caf1e8-853f-4b3e-af28-b83be684cecb None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-69caf1e8-853f-4b3e-af28-b83be684cecb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:58.032771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:58.033967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:58.035206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:58.035206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:58.035206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:58.035206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:58.035206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:58.035206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:58.035206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:58.035206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:58.035206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 16:10:58.035206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:58.037469 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 378/741] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:10:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:58.038859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03254b-0ce3-43bc-8bae-1efbf5c39d05 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:58.039302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03254b-0ce3-43bc-8bae-1efbf5c39d05 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:58.039760 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03254b-0ce3-43bc-8bae-1efbf5c39d05 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:58.041178 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 379/742] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:10:58.041753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03254b-0ce3-43bc-8bae-1efbf5c39d05 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:58.092328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:58.112054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f138b2d-4f12-4386-aa27-cda59afdbe17 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:58.148013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79416007-ae14-449b-a72d-923a6af53940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:58.148812 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416007-ae14-449b-a72d-923a6af53940 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:58.149098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416007-ae14-449b-a72d-923a6af53940 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:58.149405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416007-ae14-449b-a72d-923a6af53940 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:58.149669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03254b-0ce3-43bc-8bae-1efbf5c39d05 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:58.160433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79416007-ae14-449b-a72d-923a6af53940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-79416007-ae14-449b-a72d-923a6af53940 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:10:58.168106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:58.169052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:58.169983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:58.169983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:58.169983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:58.169983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:58.169983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:10:58.169983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:10:58.169983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:10:58.169983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:10:58.169983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:10:58.169983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:10:58.169983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:10:58.169983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:58.169983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 364/743] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:10:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:58.170730 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79416007-ae14-449b-a72d-923a6af53940 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:58.187038 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:58.194061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b813528-b1c9-4c8e-a17a-d54e24f2d57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:58.194897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b813528-b1c9-4c8e-a17a-d54e24f2d57a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:58.195184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b813528-b1c9-4c8e-a17a-d54e24f2d57a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:58.195459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b813528-b1c9-4c8e-a17a-d54e24f2d57a None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:58.196190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b813528-b1c9-4c8e-a17a-d54e24f2d57a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:58.198504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b813528-b1c9-4c8e-a17a-d54e24f2d57a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:58.198504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b813528-b1c9-4c8e-a17a-d54e24f2d57a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:58.215554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 380/744] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:58.215554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270425-6930-4573-983a-077e2f2abfa4 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:58.215554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270425-6930-4573-983a-077e2f2abfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:58.215554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270425-6930-4573-983a-077e2f2abfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:58.230330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a3270425-6930-4573-983a-077e2f2abfa4 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:10:58.231518 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a3270425-6930-4573-983a-077e2f2abfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:10:58.278429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79416007-ae14-449b-a72d-923a6af53940 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:58.312678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e948c-f1c5-4db5-ac2e-3a511e96cf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:58.315068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 381/745] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:10:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 16:10:58.315185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e948c-f1c5-4db5-ac2e-3a511e96cf01 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:58.315185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e948c-f1c5-4db5-ac2e-3a511e96cf01 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:58.315185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e948c-f1c5-4db5-ac2e-3a511e96cf01 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:58.315417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3270425-6930-4573-983a-077e2f2abfa4 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:58.315514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e948c-f1c5-4db5-ac2e-3a511e96cf01 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:58.315514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e948c-f1c5-4db5-ac2e-3a511e96cf01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:58.316844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e948c-f1c5-4db5-ac2e-3a511e96cf01 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:58.327969 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:58.337271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 365/746] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Jul 12 16:10:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:58.341893 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e948c-f1c5-4db5-ac2e-3a511e96cf01 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:58.426625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3270425-6930-4573-983a-077e2f2abfa4 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:58.447214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:58.459833 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e948c-f1c5-4db5-ac2e-3a511e96cf01 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:58.466177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade705ba-bdd2-4cb9-8b1d-c76b56efb572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:58.466845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade705ba-bdd2-4cb9-8b1d-c76b56efb572 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:58.467126 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade705ba-bdd2-4cb9-8b1d-c76b56efb572 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:58.467400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade705ba-bdd2-4cb9-8b1d-c76b56efb572 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:58.468147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade705ba-bdd2-4cb9-8b1d-c76b56efb572 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:58.468450 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade705ba-bdd2-4cb9-8b1d-c76b56efb572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:58.469844 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade705ba-bdd2-4cb9-8b1d-c76b56efb572 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:58.479097 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 382/747] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:10:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:58.479850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade705ba-bdd2-4cb9-8b1d-c76b56efb572 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:58.504139 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4de71d-641f-4919-ae0a-2471700071df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:58.504918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4de71d-641f-4919-ae0a-2471700071df None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:58.505227 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4de71d-641f-4919-ae0a-2471700071df None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:58.505508 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4de71d-641f-4919-ae0a-2471700071df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:58.512251 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4de71d-641f-4919-ae0a-2471700071df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:58.513715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4de71d-641f-4919-ae0a-2471700071df None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-1c4de71d-641f-4919-ae0a-2471700071df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:58.527842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:58.528764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:58.529714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:58.529714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:58.529714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:58.529714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:58.529714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:58.529714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:58.529714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:58.529714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:58.529714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 366/748] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:58.530198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4de71d-641f-4919-ae0a-2471700071df None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:58.590959 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade705ba-bdd2-4cb9-8b1d-c76b56efb572 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:58.593322 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:58.626951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2c6ad-5a30-4151-b139-64ee9d54e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:58.627769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2c6ad-5a30-4151-b139-64ee9d54e052 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:58.628077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2c6ad-5a30-4151-b139-64ee9d54e052 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:58.628352 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2c6ad-5a30-4151-b139-64ee9d54e052 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:58.629076 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2c6ad-5a30-4151-b139-64ee9d54e052 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:58.630468 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2c6ad-5a30-4151-b139-64ee9d54e052 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:58.638417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4de71d-641f-4919-ae0a-2471700071df None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:58.672411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624ead-ed9f-47ad-86cc-e2bb32aced41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:58.673054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624ead-ed9f-47ad-86cc-e2bb32aced41 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:58.673392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624ead-ed9f-47ad-86cc-e2bb32aced41 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:58.673660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624ead-ed9f-47ad-86cc-e2bb32aced41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:58.709772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 383/749] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:10:58 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:10:58.710797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2c6ad-5a30-4151-b139-64ee9d54e052 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:58.745880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a624ead-ed9f-47ad-86cc-e2bb32aced41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:58.747359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a624ead-ed9f-47ad-86cc-e2bb32aced41 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:58.787769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:58.845613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:58.876008 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2c6ad-5a30-4151-b139-64ee9d54e052 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:58.910580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 367/750] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:10:58 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 16:10:58.911713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624ead-ed9f-47ad-86cc-e2bb32aced41 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:58.926627 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38162c9-432a-49c3-b97f-964ceeb09594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:58.927797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38162c9-432a-49c3-b97f-964ceeb09594 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:58.928368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38162c9-432a-49c3-b97f-964ceeb09594 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:58.928846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38162c9-432a-49c3-b97f-964ceeb09594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:58.941092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38162c9-432a-49c3-b97f-964ceeb09594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:58.942913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38162c9-432a-49c3-b97f-964ceeb09594 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-d38162c9-432a-49c3-b97f-964ceeb09594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:58.962401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:58.963326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:58.964310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:58.964310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:58.964310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:58.964310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:58.966323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 384/751] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:58.967324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38162c9-432a-49c3-b97f-964ceeb09594 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:59.049496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624ead-ed9f-47ad-86cc-e2bb32aced41 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:59.070010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:59.080372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38162c9-432a-49c3-b97f-964ceeb09594 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:59.097357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0be1a3-d640-4449-bf2e-f08e1093d35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:59.098036 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0be1a3-d640-4449-bf2e-f08e1093d35f None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:59.098327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0be1a3-d640-4449-bf2e-f08e1093d35f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:59.098610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0be1a3-d640-4449-bf2e-f08e1093d35f None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:59.099586 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0be1a3-d640-4449-bf2e-f08e1093d35f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:59.099901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0be1a3-d640-4449-bf2e-f08e1093d35f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:59.101682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0be1a3-d640-4449-bf2e-f08e1093d35f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:59.119906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 368/752] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:59.121170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0be1a3-d640-4449-bf2e-f08e1093d35f None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:59.121680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fc497-45b0-4c92-be11-7337d91891fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:59.122596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fc497-45b0-4c92-be11-7337d91891fa None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:59.122916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fc497-45b0-4c92-be11-7337d91891fa None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:59.123160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fc497-45b0-4c92-be11-7337d91891fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:59.134979 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fc497-45b0-4c92-be11-7337d91891fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:59.136558 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fc497-45b0-4c92-be11-7337d91891fa None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:59.143141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-631fc497-45b0-4c92-be11-7337d91891fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:10:59.157377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:59.158302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:59.159265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:10:59.159265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:10:59.159265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:10:59.159265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:59.163623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 385/753] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:59.164166 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fc497-45b0-4c92-be11-7337d91891fa None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:59.231171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0be1a3-d640-4449-bf2e-f08e1093d35f None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:59.276944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cfb40-ad94-4337-b9e9-b0b652bb6208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:59.277505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fc497-45b0-4c92-be11-7337d91891fa None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:59.277689 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cfb40-ad94-4337-b9e9-b0b652bb6208 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:59.277928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cfb40-ad94-4337-b9e9-b0b652bb6208 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:59.278205 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cfb40-ad94-4337-b9e9-b0b652bb6208 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:59.279190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cfb40-ad94-4337-b9e9-b0b652bb6208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:59.279502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cfb40-ad94-4337-b9e9-b0b652bb6208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:59.281776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cfb40-ad94-4337-b9e9-b0b652bb6208 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:59.299039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 369/754] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:59.301267 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cfb40-ad94-4337-b9e9-b0b652bb6208 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:59.316289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387834f-5d11-452b-b4d5-c0afcabee4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:59.317148 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387834f-5d11-452b-b4d5-c0afcabee4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:59.317515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387834f-5d11-452b-b4d5-c0afcabee4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:59.317869 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387834f-5d11-452b-b4d5-c0afcabee4b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:59.318800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387834f-5d11-452b-b4d5-c0afcabee4b0 None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=cdf13cc74cf94d9a87613fe1e102ac99) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:59.319274 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387834f-5d11-452b-b4d5-c0afcabee4b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:59.320889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387834f-5d11-452b-b4d5-c0afcabee4b0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:59.327158 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 386/755] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:10:59 2022] GET /identity/v3/role_assignments?user.id=cdf13cc74cf94d9a87613fe1e102ac99&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:59.328042 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387834f-5d11-452b-b4d5-c0afcabee4b0 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:59.338806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:59.410374 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:59.443114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cfb40-ad94-4337-b9e9-b0b652bb6208 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:59.453510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387834f-5d11-452b-b4d5-c0afcabee4b0 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:59.484416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818ade0-c236-4f7c-b8fc-f940384cabe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:59.485028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818ade0-c236-4f7c-b8fc-f940384cabe5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:59.485341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818ade0-c236-4f7c-b8fc-f940384cabe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:59.485624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818ade0-c236-4f7c-b8fc-f940384cabe5 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:59.486713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818ade0-c236-4f7c-b8fc-f940384cabe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:59.486713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818ade0-c236-4f7c-b8fc-f940384cabe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:59.488632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818ade0-c236-4f7c-b8fc-f940384cabe5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:59.500818 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 370/756] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:59.509151 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818ade0-c236-4f7c-b8fc-f940384cabe5 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:59.519961 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33568d2-e3d0-41ec-b4f4-62cc2e3fc94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:59.520793 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33568d2-e3d0-41ec-b4f4-62cc2e3fc94c None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:59.521082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33568d2-e3d0-41ec-b4f4-62cc2e3fc94c None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:59.521390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33568d2-e3d0-41ec-b4f4-62cc2e3fc94c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:59.538271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33568d2-e3d0-41ec-b4f4-62cc2e3fc94c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:59.540840 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33568d2-e3d0-41ec-b4f4-62cc2e3fc94c None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-a33568d2-e3d0-41ec-b4f4-62cc2e3fc94c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:10:59.569138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:59.570152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:59.571203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:59.571203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:59.571203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:10:59.571203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:10:59.571203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:10:59.571203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:10:59.571203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:10:59.571203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:10:59.571203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:10:59.571203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:10:59.571751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 387/757] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 16:10:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:10:59.576684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33568d2-e3d0-41ec-b4f4-62cc2e3fc94c None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:59.699092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818ade0-c236-4f7c-b8fc-f940384cabe5 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:59.717537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:59.767938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad2a68-02be-4d09-92d6-12d57844de7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:59.768690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad2a68-02be-4d09-92d6-12d57844de7b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:59.768979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad2a68-02be-4d09-92d6-12d57844de7b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:59.769283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad2a68-02be-4d09-92d6-12d57844de7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:59.780081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad2a68-02be-4d09-92d6-12d57844de7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:59.781564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad2a68-02be-4d09-92d6-12d57844de7b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:59.783958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33568d2-e3d0-41ec-b4f4-62cc2e3fc94c None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:10:59.788117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-90ad2a68-02be-4d09-92d6-12d57844de7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:10:59.805954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:10:59.806864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:10:59.807739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:10:59.807739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:10:59.807739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:10:59.807739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:10:59.807739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:10:59.807739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:10:59.807739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:10:59.807739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:10:59.810563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 371/758] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:10:59.818226 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad2a68-02be-4d09-92d6-12d57844de7b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:10:59.854813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60317fc5-cdff-44f6-af94-385332a7f323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:10:59.855592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317fc5-cdff-44f6-af94-385332a7f323 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:10:59.855949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317fc5-cdff-44f6-af94-385332a7f323 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:10:59.856380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317fc5-cdff-44f6-af94-385332a7f323 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:10:59.857929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60317fc5-cdff-44f6-af94-385332a7f323 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:10:59.858515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60317fc5-cdff-44f6-af94-385332a7f323 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:10:59.860670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60317fc5-cdff-44f6-af94-385332a7f323 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:10:59.897202 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 388/759] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 16:10:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:10:59.904329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60317fc5-cdff-44f6-af94-385332a7f323 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:00.000128 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad2a68-02be-4d09-92d6-12d57844de7b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:00.046911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60317fc5-cdff-44f6-af94-385332a7f323 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:00.048954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58684ed4-4e45-4f58-b80f-f2d5978263aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:00.050886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58684ed4-4e45-4f58-b80f-f2d5978263aa None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:00.051302 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58684ed4-4e45-4f58-b80f-f2d5978263aa None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:00.051685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58684ed4-4e45-4f58-b80f-f2d5978263aa None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:00.052620 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58684ed4-4e45-4f58-b80f-f2d5978263aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:00.053053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58684ed4-4e45-4f58-b80f-f2d5978263aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:00.054684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58684ed4-4e45-4f58-b80f-f2d5978263aa None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:00.072635 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 372/760] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:00.073703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:00.075782 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7462-a1d2-4a89-b957-0742f6757b21 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:00.076340 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7462-a1d2-4a89-b957-0742f6757b21 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:00.076859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7462-a1d2-4a89-b957-0742f6757b21 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:00.078461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 373/761] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:00.079198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a7462-a1d2-4a89-b957-0742f6757b21 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:00.095657 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde377d9-9e33-4038-99fc-5ca89c6a8573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:00.097281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde377d9-9e33-4038-99fc-5ca89c6a8573 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:00.097676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde377d9-9e33-4038-99fc-5ca89c6a8573 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:00.098055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde377d9-9e33-4038-99fc-5ca89c6a8573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:00.111006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde377d9-9e33-4038-99fc-5ca89c6a8573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:00.113928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde377d9-9e33-4038-99fc-5ca89c6a8573 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-dde377d9-9e33-4038-99fc-5ca89c6a8573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:00.135142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:00.136246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:00.137540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:00.137540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:00.137540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:00.137540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:00.142318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 389/762] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:00.142318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501f722-d363-42f4-a8cd-ef9833eae4e2 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:00.142318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501f722-d363-42f4-a8cd-ef9833eae4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:00.142318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501f722-d363-42f4-a8cd-ef9833eae4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:00.150101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:00.160286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-b501f722-d363-42f4-a8cd-ef9833eae4e2 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:00.161586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b501f722-d363-42f4-a8cd-ef9833eae4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:00.195627 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a7462-a1d2-4a89-b957-0742f6757b21 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:00.231277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f558f26-6b16-49ae-8571-01bba61e8fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:00.232224 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f558f26-6b16-49ae-8571-01bba61e8fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:00.232737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f558f26-6b16-49ae-8571-01bba61e8fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:00.233506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f558f26-6b16-49ae-8571-01bba61e8fa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:00.234554 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f558f26-6b16-49ae-8571-01bba61e8fa8 None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=143798e5887b49338f0000de5b55be68) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:00.235065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f558f26-6b16-49ae-8571-01bba61e8fa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:00.236866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f558f26-6b16-49ae-8571-01bba61e8fa8 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:00.242955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 374/764] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:11:00 2022] GET /identity/v3/role_assignments?user.id=143798e5887b49338f0000de5b55be68&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:00.243094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 390/764] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:00.244082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501f722-d363-42f4-a8cd-ef9833eae4e2 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:00.265651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f558f26-6b16-49ae-8571-01bba61e8fa8 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:00.379914 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f558f26-6b16-49ae-8571-01bba61e8fa8 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:00.408476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:00.421867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3345a3-6e9d-418f-9ea4-fdc47f19df47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:00.423707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3345a3-6e9d-418f-9ea4-fdc47f19df47 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:00.423707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3345a3-6e9d-418f-9ea4-fdc47f19df47 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:00.423707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3345a3-6e9d-418f-9ea4-fdc47f19df47 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:00.424709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3345a3-6e9d-418f-9ea4-fdc47f19df47 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:00.426390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3345a3-6e9d-418f-9ea4-fdc47f19df47 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-7c3345a3-6e9d-418f-9ea4-fdc47f19df47 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:00.442559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:00.443507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 16:11:00.444341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:00.447281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 375/765] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Jul 12 16:11:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:00.462474 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3345a3-6e9d-418f-9ea4-fdc47f19df47 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:00.514895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501f722-d363-42f4-a8cd-ef9833eae4e2 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:00.530323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:00.579044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f40ef3-9aff-40af-920b-2524dfb89634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:00.580578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f40ef3-9aff-40af-920b-2524dfb89634 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:00.581338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f40ef3-9aff-40af-920b-2524dfb89634 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:00.582657 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f40ef3-9aff-40af-920b-2524dfb89634 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:00.583599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f40ef3-9aff-40af-920b-2524dfb89634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:00.588630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f40ef3-9aff-40af-920b-2524dfb89634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:00.590406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f40ef3-9aff-40af-920b-2524dfb89634 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:00.609809 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 391/766] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:00.617459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f40ef3-9aff-40af-920b-2524dfb89634 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:00.648219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3345a3-6e9d-418f-9ea4-fdc47f19df47 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:00.713913 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f4290-8616-4a83-9dee-fc89e0413027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:00.715153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f4290-8616-4a83-9dee-fc89e0413027 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:00.715840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f4290-8616-4a83-9dee-fc89e0413027 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:00.716313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f4290-8616-4a83-9dee-fc89e0413027 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:00.717254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f4290-8616-4a83-9dee-fc89e0413027 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:00.717760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f4290-8616-4a83-9dee-fc89e0413027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:00.719675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f4290-8616-4a83-9dee-fc89e0413027 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:00.730745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 376/767] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Jul 12 16:11:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:00.736399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f4290-8616-4a83-9dee-fc89e0413027 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:00.738643 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f40ef3-9aff-40af-920b-2524dfb89634 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:00.779493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40071e9e-8033-4721-a4fc-79bf015f3cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:00.780299 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40071e9e-8033-4721-a4fc-79bf015f3cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:00.780585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40071e9e-8033-4721-a4fc-79bf015f3cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:00.780865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40071e9e-8033-4721-a4fc-79bf015f3cd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:00.788637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40071e9e-8033-4721-a4fc-79bf015f3cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:00.790127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40071e9e-8033-4721-a4fc-79bf015f3cd5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-40071e9e-8033-4721-a4fc-79bf015f3cd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:11:00.806392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:00.807513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:00.808638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:11:00.808638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:11:00.808638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:11:00.808638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:11:00.808638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:11:00.808638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:11:00.808638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:00.808638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:00.808638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 392/768] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:00.811790 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:00.822131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40071e9e-8033-4721-a4fc-79bf015f3cd5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:00.850971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:00.920823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f4290-8616-4a83-9dee-fc89e0413027 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:00.936536 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40071e9e-8033-4721-a4fc-79bf015f3cd5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:00.963217 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a25fc-1084-448b-aad3-70445e6cbb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:00.964218 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a25fc-1084-448b-aad3-70445e6cbb91 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:00.964829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a25fc-1084-448b-aad3-70445e6cbb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:00.966003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a25fc-1084-448b-aad3-70445e6cbb91 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:00.967060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a25fc-1084-448b-aad3-70445e6cbb91 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:00.968853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a25fc-1084-448b-aad3-70445e6cbb91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:00.970469 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a25fc-1084-448b-aad3-70445e6cbb91 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:00.980006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 377/769] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Jul 12 16:11:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:00.985199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a25fc-1084-448b-aad3-70445e6cbb91 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:01.008550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5f79-93f1-46d5-bc1d-618922237892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:01.009530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5f79-93f1-46d5-bc1d-618922237892 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:01.011412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5f79-93f1-46d5-bc1d-618922237892 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:01.011874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5f79-93f1-46d5-bc1d-618922237892 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:01.012856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe5f79-93f1-46d5-bc1d-618922237892 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:01.014165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe5f79-93f1-46d5-bc1d-618922237892 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:01.015807 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe5f79-93f1-46d5-bc1d-618922237892 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:01.039211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 393/770] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:11:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:01.054128 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5f79-93f1-46d5-bc1d-618922237892 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:01.128871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a25fc-1084-448b-aad3-70445e6cbb91 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:01.145197 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:01.168813 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268ae8f-11f4-4367-a56e-ed165f5c5658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:01.173367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268ae8f-11f4-4367-a56e-ed165f5c5658 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:01.173367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268ae8f-11f4-4367-a56e-ed165f5c5658 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:01.173367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268ae8f-11f4-4367-a56e-ed165f5c5658 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:01.173367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268ae8f-11f4-4367-a56e-ed165f5c5658 None admin] RBAC: Adding query filter params (interface=public, service_id=cdeeb212afac4133b77805a7cb8571c0, region_id=RegionOne) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:01.173367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268ae8f-11f4-4367-a56e-ed165f5c5658 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:01.173367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268ae8f-11f4-4367-a56e-ed165f5c5658 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:01.191776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 378/771] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 16:11:00 2022] GET /identity/v3/endpoints?service_id=cdeeb212afac4133b77805a7cb8571c0&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:01.196641 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268ae8f-11f4-4367-a56e-ed165f5c5658 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:01.254801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:01.272775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5f79-93f1-46d5-bc1d-618922237892 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:01.310504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a449f8-1ce7-41f0-b99a-bb389ddf23ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:01.311600 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a449f8-1ce7-41f0-b99a-bb389ddf23ae None admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:01.311955 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a449f8-1ce7-41f0-b99a-bb389ddf23ae None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:01.312301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a449f8-1ce7-41f0-b99a-bb389ddf23ae None admin] PATH_INFO: `/v3/projects/2101dde305df44bc90d33b01976e8265/users/f36355ce7ff841f3bd9e228fbad64a83/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:01.314849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a449f8-1ce7-41f0-b99a-bb389ddf23ae None admin] RBAC: Authorizing `identity:create_grant(project_id=2101dde305df44bc90d33b01976e8265, user_id=f36355ce7ff841f3bd9e228fbad64a83, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:01.316525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a449f8-1ce7-41f0-b99a-bb389ddf23ae None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:01.332708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268ae8f-11f4-4367-a56e-ed165f5c5658 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:01.369901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe8391-e9fd-4311-8d60-d24f9fce3b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:01.370660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe8391-e9fd-4311-8d60-d24f9fce3b85 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:01.370942 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe8391-e9fd-4311-8d60-d24f9fce3b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:01.371364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe8391-e9fd-4311-8d60-d24f9fce3b85 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:01.372094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe8391-e9fd-4311-8d60-d24f9fce3b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:01.373486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe8391-e9fd-4311-8d60-d24f9fce3b85 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:01.382615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 379/772] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 16:11:01 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:01.382615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b605d9-d51d-43cf-aef4-5ac396d07f56 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:01.382615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b605d9-d51d-43cf-aef4-5ac396d07f56 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:01.382615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b605d9-d51d-43cf-aef4-5ac396d07f56 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:01.382615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 380/773] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:01.394036 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83734148-b938-46f8-beda-2e37b361a889 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:01.394325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83734148-b938-46f8-beda-2e37b361a889 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:01.394617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83734148-b938-46f8-beda-2e37b361a889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:01.401405 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 394/774] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:11:01 2022] PUT /identity/v3/projects/2101dde305df44bc90d33b01976e8265/users/f36355ce7ff841f3bd9e228fbad64a83/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:11:01.432781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-83734148-b938-46f8-beda-2e37b361a889 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:01.433987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-83734148-b938-46f8-beda-2e37b361a889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:01.513731 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:01.559818 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 381/775] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:01.591023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a449f8-1ce7-41f0-b99a-bb389ddf23ae None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:01.723546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a449f8-1ce7-41f0-b99a-bb389ddf23ae None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:01.774661 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6817e0-18c7-482a-92e5-ae7c652044e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:01.775516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6817e0-18c7-482a-92e5-ae7c652044e8 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:01.775803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6817e0-18c7-482a-92e5-ae7c652044e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:01.776078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6817e0-18c7-482a-92e5-ae7c652044e8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:01.776744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6817e0-18c7-482a-92e5-ae7c652044e8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:01.778144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6817e0-18c7-482a-92e5-ae7c652044e8 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-df6817e0-18c7-482a-92e5-ae7c652044e8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:01.792776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:01.793842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:01.795104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 395/776] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:01 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:01.801479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83734148-b938-46f8-beda-2e37b361a889 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:01.933805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2b01f-d3d1-4a71-8c7e-fc936dc6c0c8 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:01.934165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2b01f-d3d1-4a71-8c7e-fc936dc6c0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:01.934364 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2b01f-d3d1-4a71-8c7e-fc936dc6c0c8 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:01.935975 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 396/777] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:11:01.942733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50140a-803f-4b2d-b593-39e4f21e3760 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:01.943301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50140a-803f-4b2d-b593-39e4f21e3760 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:01.943301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50140a-803f-4b2d-b593-39e4f21e3760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:01.963983 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-4a50140a-803f-4b2d-b593-39e4f21e3760 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:01.965675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4a50140a-803f-4b2d-b593-39e4f21e3760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:01.971201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83734148-b938-46f8-beda-2e37b361a889 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:01.981530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:02.041173 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a491ae3-22e5-4ea1-98ea-d05fdcb37e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:02.041861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a491ae3-22e5-4ea1-98ea-d05fdcb37e3b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:02.042150 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a491ae3-22e5-4ea1-98ea-d05fdcb37e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:02.042428 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a491ae3-22e5-4ea1-98ea-d05fdcb37e3b None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:02.043155 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a491ae3-22e5-4ea1-98ea-d05fdcb37e3b None admin] RBAC: Adding query filter params (name=network) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:02.043466 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a491ae3-22e5-4ea1-98ea-d05fdcb37e3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:02.044831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a491ae3-22e5-4ea1-98ea-d05fdcb37e3b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:02.055277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 382/778] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 16:11:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:02.063392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a491ae3-22e5-4ea1-98ea-d05fdcb37e3b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:02.086686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 397/779] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:02.112722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:02.122672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50140a-803f-4b2d-b593-39e4f21e3760 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:02.231045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a491ae3-22e5-4ea1-98ea-d05fdcb37e3b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:02.271990 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9a4bf-b3ac-4449-9579-c8a2e8a41b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:02.272756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9a4bf-b3ac-4449-9579-c8a2e8a41b40 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:02.273047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9a4bf-b3ac-4449-9579-c8a2e8a41b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:02.273388 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9a4bf-b3ac-4449-9579-c8a2e8a41b40 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:02.274419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9a4bf-b3ac-4449-9579-c8a2e8a41b40 None admin] RBAC: Adding query filter params (type=network) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:02.274737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9a4bf-b3ac-4449-9579-c8a2e8a41b40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:02.276200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9a4bf-b3ac-4449-9579-c8a2e8a41b40 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:02.282713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 383/780] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 16:11:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:02.288074 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9a4bf-b3ac-4449-9579-c8a2e8a41b40 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:02.305131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50140a-803f-4b2d-b593-39e4f21e3760 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:02.386820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3e5ae-9e84-47a0-b372-0f1b838a3b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:02.387629 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3e5ae-9e84-47a0-b372-0f1b838a3b78 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:02.387907 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3e5ae-9e84-47a0-b372-0f1b838a3b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:02.388204 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3e5ae-9e84-47a0-b372-0f1b838a3b78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:02.412344 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:02.413276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:02.419177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9a4bf-b3ac-4449-9579-c8a2e8a41b40 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:02.426492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3e5ae-9e84-47a0-b372-0f1b838a3b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-92c3e5ae-9e84-47a0-b372-0f1b838a3b78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:02.436854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:02.438186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:02.439552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:02.439552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:02.439552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:02.439552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:02.439552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:02.439552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:02.439552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:02.439552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:02.439552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:02.439552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:02.439552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:11:02.439552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:02.449212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 398/781] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:11:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:02.451929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3e5ae-9e84-47a0-b372-0f1b838a3b78 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:02.496693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a1af0-bcb1-4e6a-b563-048b3f4a488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:02.498920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a1af0-bcb1-4e6a-b563-048b3f4a488b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:02.499401 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a1af0-bcb1-4e6a-b563-048b3f4a488b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:02.500876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a1af0-bcb1-4e6a-b563-048b3f4a488b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:02.501889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a1af0-bcb1-4e6a-b563-048b3f4a488b None admin] RBAC: Adding query filter params (interface=public, service_id=8b045db385b447eebb08a1b7ee473381, region_id=RegionOne) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:02.503363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a1af0-bcb1-4e6a-b563-048b3f4a488b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:02.506075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a1af0-bcb1-4e6a-b563-048b3f4a488b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:02.519895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 384/782] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 16:11:02 2022] GET /identity/v3/endpoints?service_id=8b045db385b447eebb08a1b7ee473381&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:02.525144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a1af0-bcb1-4e6a-b563-048b3f4a488b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:02.624326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3e5ae-9e84-47a0-b372-0f1b838a3b78 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:02.668198 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00cf85-fb8a-4e9b-91f9-b012435873f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:02.668882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00cf85-fb8a-4e9b-91f9-b012435873f7 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:02.669194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00cf85-fb8a-4e9b-91f9-b012435873f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:02.669475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00cf85-fb8a-4e9b-91f9-b012435873f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:02.670238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00cf85-fb8a-4e9b-91f9-b012435873f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:02.670546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00cf85-fb8a-4e9b-91f9-b012435873f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:02.672446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00cf85-fb8a-4e9b-91f9-b012435873f7 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:02.687050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 399/783] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:11:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:02.687050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d490e3-7f83-450f-bd84-1718cd1cd2bc None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:02.687050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d490e3-7f83-450f-bd84-1718cd1cd2bc None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:02.687050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d490e3-7f83-450f-bd84-1718cd1cd2bc None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:02.687050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 400/784] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:02.690117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a1af0-bcb1-4e6a-b563-048b3f4a488b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:02.694062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d20fa-b82c-46cb-96ae-b89a645e03fe None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:02.694357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d20fa-b82c-46cb-96ae-b89a645e03fe None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:02.694638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d20fa-b82c-46cb-96ae-b89a645e03fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:02.712869 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-cf4d20fa-b82c-46cb-96ae-b89a645e03fe None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:02.714515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-cf4d20fa-b82c-46cb-96ae-b89a645e03fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:02.732030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3dd7d-0f26-453f-a999-3963b921ddfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:02.732935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3dd7d-0f26-453f-a999-3963b921ddfd None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:02.733346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3dd7d-0f26-453f-a999-3963b921ddfd None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:02.733696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3dd7d-0f26-453f-a999-3963b921ddfd None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:02.734568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3dd7d-0f26-453f-a999-3963b921ddfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:02.736077 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3dd7d-0f26-453f-a999-3963b921ddfd None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:02.742236 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 385/785] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 16:11:02 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:02.743226 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3dd7d-0f26-453f-a999-3963b921ddfd None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:02.776003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:02.781741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:02.805146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 401/786] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:02.830746 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d20fa-b82c-46cb-96ae-b89a645e03fe None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:02.891017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3dd7d-0f26-453f-a999-3963b921ddfd None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:02.962517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06ee8b-1963-4e1b-8b43-f79943436d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:02.963743 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06ee8b-1963-4e1b-8b43-f79943436d9a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:02.964237 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06ee8b-1963-4e1b-8b43-f79943436d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:02.964718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06ee8b-1963-4e1b-8b43-f79943436d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:02.984782 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d20fa-b82c-46cb-96ae-b89a645e03fe None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:02.986513 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06ee8b-1963-4e1b-8b43-f79943436d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:02.988759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06ee8b-1963-4e1b-8b43-f79943436d9a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-ff06ee8b-1963-4e1b-8b43-f79943436d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:03.018636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:03.019624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:03.020540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:03.020540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:03.020540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:03.020540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:03.027190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18928c3-0a0c-48da-9904-44fafa59c9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:03.027190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18928c3-0a0c-48da-9904-44fafa59c9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:03.027190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18928c3-0a0c-48da-9904-44fafa59c9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:03.027190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18928c3-0a0c-48da-9904-44fafa59c9d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:03.027734 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 386/787] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:03.029108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06ee8b-1963-4e1b-8b43-f79943436d9a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:03.037043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18928c3-0a0c-48da-9904-44fafa59c9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-c18928c3-0a0c-48da-9904-44fafa59c9d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:03.045446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:03.046672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:03.047794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:03.047794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:03.047794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:03.047794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:03.047794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:03.047794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:03.047794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:03.047794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:03.047794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:03.047794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:03.047794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:11:03.047794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:03.047794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 402/788] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:11:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:03.054238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18928c3-0a0c-48da-9904-44fafa59c9d4 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:03.119176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:03.147660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:03.169490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06ee8b-1963-4e1b-8b43-f79943436d9a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:03.212160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18928c3-0a0c-48da-9904-44fafa59c9d4 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:03.230470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb84745-3b26-4107-b67a-40c6a23b1f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:03.231519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb84745-3b26-4107-b67a-40c6a23b1f98 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:03.232472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb84745-3b26-4107-b67a-40c6a23b1f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:03.232955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb84745-3b26-4107-b67a-40c6a23b1f98 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:03.233919 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb84745-3b26-4107-b67a-40c6a23b1f98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:03.234433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb84745-3b26-4107-b67a-40c6a23b1f98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:03.236015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb84745-3b26-4107-b67a-40c6a23b1f98 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:03.273259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 387/789] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:03.285641 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb84745-3b26-4107-b67a-40c6a23b1f98 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:03.302366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5e7d4-ac8a-472f-be3b-1552ec46705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:03.303392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5e7d4-ac8a-472f-be3b-1552ec46705f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:03.303884 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5e7d4-ac8a-472f-be3b-1552ec46705f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:03.304411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5e7d4-ac8a-472f-be3b-1552ec46705f None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:03.305397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5e7d4-ac8a-472f-be3b-1552ec46705f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:03.307493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5e7d4-ac8a-472f-be3b-1552ec46705f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:03.309145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5e7d4-ac8a-472f-be3b-1552ec46705f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:03.326121 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 403/790] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:11:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:03.332752 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5e7d4-ac8a-472f-be3b-1552ec46705f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:03.412315 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb84745-3b26-4107-b67a-40c6a23b1f98 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:03.461919 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671cab9-31f1-4007-b2e7-c3e31658a86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:03.462926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671cab9-31f1-4007-b2e7-c3e31658a86b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:03.463221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671cab9-31f1-4007-b2e7-c3e31658a86b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:03.463507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671cab9-31f1-4007-b2e7-c3e31658a86b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:03.480837 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671cab9-31f1-4007-b2e7-c3e31658a86b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:03.483435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671cab9-31f1-4007-b2e7-c3e31658a86b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:03.492689 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-5671cab9-31f1-4007-b2e7-c3e31658a86b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:11:03.521418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:03.522446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:03.523393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:03.523393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:03.523393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:11:03.523393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:11:03.523393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:11:03.523393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:11:03.523393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:11:03.523393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:11:03.523393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 16:11:03.523393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:03.527673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 388/791] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 16:11:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:03.533484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671cab9-31f1-4007-b2e7-c3e31658a86b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:03.550534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5e7d4-ac8a-472f-be3b-1552ec46705f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:03.580775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:03.605527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b486505-f84e-45ec-8089-0b9c2a03b881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:03.606695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b486505-f84e-45ec-8089-0b9c2a03b881 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:03.607285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b486505-f84e-45ec-8089-0b9c2a03b881 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:03.607775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b486505-f84e-45ec-8089-0b9c2a03b881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:03.621540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b486505-f84e-45ec-8089-0b9c2a03b881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:03.623457 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b486505-f84e-45ec-8089-0b9c2a03b881 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-1b486505-f84e-45ec-8089-0b9c2a03b881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:03.642052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:03.643012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:03.643939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:03.643939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:03.643939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:03.643939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:03.646266 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 404/792] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:03.651901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b486505-f84e-45ec-8089-0b9c2a03b881 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:03.736266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671cab9-31f1-4007-b2e7-c3e31658a86b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:03.773259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddf9ec-508a-44c3-8a84-e4c17a388a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:03.774302 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddf9ec-508a-44c3-8a84-e4c17a388a7f None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:03.774822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddf9ec-508a-44c3-8a84-e4c17a388a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:03.775307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddf9ec-508a-44c3-8a84-e4c17a388a7f None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:03.776425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddf9ec-508a-44c3-8a84-e4c17a388a7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:03.776942 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddf9ec-508a-44c3-8a84-e4c17a388a7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:03.777947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b486505-f84e-45ec-8089-0b9c2a03b881 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:03.778875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddf9ec-508a-44c3-8a84-e4c17a388a7f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:03.797600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 389/793] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Jul 12 16:11:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:03.799270 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ea48a-17c0-4545-a9e8-e7f856d9968b None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:03.800292 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ea48a-17c0-4545-a9e8-e7f856d9968b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:03.800850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ea48a-17c0-4545-a9e8-e7f856d9968b None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:03.802330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 390/794] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:03.803954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9ad0d-74c5-4fe1-be87-18115b33a1b7 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:03.804245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9ad0d-74c5-4fe1-be87-18115b33a1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:03.804520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9ad0d-74c5-4fe1-be87-18115b33a1b7 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:03.805990 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 391/795] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:03.806692 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9ad0d-74c5-4fe1-be87-18115b33a1b7 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:03.826012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6e020-5078-421b-a594-9f8a7328465e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:03.826686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6e020-5078-421b-a594-9f8a7328465e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:03.826974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6e020-5078-421b-a594-9f8a7328465e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:03.827261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6e020-5078-421b-a594-9f8a7328465e None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:03.827990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6e020-5078-421b-a594-9f8a7328465e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:03.828300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6e020-5078-421b-a594-9f8a7328465e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:03.829709 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6e020-5078-421b-a594-9f8a7328465e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:03.841883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 405/796] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:03.843397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc67d0d-6a06-4b24-b9f7-5674e403fd9b None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:03.843913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc67d0d-6a06-4b24-b9f7-5674e403fd9b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:03.844410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc67d0d-6a06-4b24-b9f7-5674e403fd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:03.861542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-bbc67d0d-6a06-4b24-b9f7-5674e403fd9b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:03.863323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bbc67d0d-6a06-4b24-b9f7-5674e403fd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:03.876013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:03.884099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:03.919706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9ad0d-74c5-4fe1-be87-18115b33a1b7 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:03.929590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 406/797] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:03.930741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68352fc9-6a48-4e78-918d-cf3de5983281 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:03.931032 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68352fc9-6a48-4e78-918d-cf3de5983281 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:03.931358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68352fc9-6a48-4e78-918d-cf3de5983281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:03.955960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-68352fc9-6a48-4e78-918d-cf3de5983281 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:03.957211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-68352fc9-6a48-4e78-918d-cf3de5983281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:03.965433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a689dd-fbd1-4e0a-9cd1-598a41049f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:03.966235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a689dd-fbd1-4e0a-9cd1-598a41049f10 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:03.966914 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a689dd-fbd1-4e0a-9cd1-598a41049f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:03.967202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a689dd-fbd1-4e0a-9cd1-598a41049f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:03.980505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a689dd-fbd1-4e0a-9cd1-598a41049f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:03.982428 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a689dd-fbd1-4e0a-9cd1-598a41049f10 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-c4a689dd-fbd1-4e0a-9cd1-598a41049f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:04.005962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:04.006911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:04.007817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:04.007817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:04.007817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:04.007817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:04.009266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 392/798] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:04.010075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a689dd-fbd1-4e0a-9cd1-598a41049f10 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:04.031890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 407/799] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:04.033345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68352fc9-6a48-4e78-918d-cf3de5983281 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:04.113307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a689dd-fbd1-4e0a-9cd1-598a41049f10 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:04.123832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:04.135231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:04.147346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bdd5d-2854-45e0-861d-53f9631668cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:04.148141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bdd5d-2854-45e0-861d-53f9631668cf None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:04.148425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bdd5d-2854-45e0-861d-53f9631668cf None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:04.148710 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bdd5d-2854-45e0-861d-53f9631668cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:04.150844 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68352fc9-6a48-4e78-918d-cf3de5983281 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:04.156008 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bdd5d-2854-45e0-861d-53f9631668cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:04.157802 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bdd5d-2854-45e0-861d-53f9631668cf None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-cd4bdd5d-2854-45e0-861d-53f9631668cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:11:04.173468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:04.174485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:04.176402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:04.176402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:04.176402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:11:04.176402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:11:04.176402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:11:04.176402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:11:04.176402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:11:04.176402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:11:04.176402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 16:11:04.176402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:04.176402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 393/800] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:11:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:04.176402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bdd5d-2854-45e0-861d-53f9631668cf None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:04.194943 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee663917-985d-4b6d-a31c-bd3b58ccfeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:04.196118 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee663917-985d-4b6d-a31c-bd3b58ccfeeb None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:04.196118 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee663917-985d-4b6d-a31c-bd3b58ccfeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:04.196324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee663917-985d-4b6d-a31c-bd3b58ccfeeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:04.209253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee663917-985d-4b6d-a31c-bd3b58ccfeeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-ee663917-985d-4b6d-a31c-bd3b58ccfeeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:04.216922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:04.217967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:04.218820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:04.218820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:04.218820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:04.218820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:04.218820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:04.218820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:04.218820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:04.218820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:04.218820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:04.218820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:04.218820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:11:04.218820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:04.218820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 408/801] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:04.219553 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee663917-985d-4b6d-a31c-bd3b58ccfeeb None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:04.289346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bdd5d-2854-45e0-861d-53f9631668cf None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:04.324963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13694211-6ff7-4a3f-85ea-3bc6df97db3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:04.325682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13694211-6ff7-4a3f-85ea-3bc6df97db3d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:04.325970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13694211-6ff7-4a3f-85ea-3bc6df97db3d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:04.326259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13694211-6ff7-4a3f-85ea-3bc6df97db3d None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:04.326992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13694211-6ff7-4a3f-85ea-3bc6df97db3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:04.327305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13694211-6ff7-4a3f-85ea-3bc6df97db3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:04.328671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13694211-6ff7-4a3f-85ea-3bc6df97db3d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:04.329285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee663917-985d-4b6d-a31c-bd3b58ccfeeb None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:04.345430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 394/802] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:04.345430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13694211-6ff7-4a3f-85ea-3bc6df97db3d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:04.371813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780b282-1305-4de8-ad22-8d4a1c55c440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:04.372669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780b282-1305-4de8-ad22-8d4a1c55c440 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:04.373071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780b282-1305-4de8-ad22-8d4a1c55c440 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:04.373380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780b282-1305-4de8-ad22-8d4a1c55c440 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:04.374033 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780b282-1305-4de8-ad22-8d4a1c55c440 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:04.375635 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:04.376415 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780b282-1305-4de8-ad22-8d4a1c55c440 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-d780b282-1305-4de8-ad22-8d4a1c55c440 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:04.389010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:04.390566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:04.391447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 409/803] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Jul 12 16:11:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:04.392318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780b282-1305-4de8-ad22-8d4a1c55c440 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:04.404855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:04.456418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13694211-6ff7-4a3f-85ea-3bc6df97db3d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:04.493082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fa317-07be-42fe-b324-b8bd78573ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:04.493822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fa317-07be-42fe-b324-b8bd78573ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:04.494113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fa317-07be-42fe-b324-b8bd78573ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:04.494393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fa317-07be-42fe-b324-b8bd78573ee4 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:04.495230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fa317-07be-42fe-b324-b8bd78573ee4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:04.495543 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fa317-07be-42fe-b324-b8bd78573ee4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:04.496956 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fa317-07be-42fe-b324-b8bd78573ee4 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:04.512664 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780b282-1305-4de8-ad22-8d4a1c55c440 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:04.514081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 395/804] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Jul 12 16:11:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:04.514873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fa317-07be-42fe-b324-b8bd78573ee4 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:04.560805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d8ee0-1fc2-4711-a1cd-d8b2d0aecbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:04.561511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d8ee0-1fc2-4711-a1cd-d8b2d0aecbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:04.561800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d8ee0-1fc2-4711-a1cd-d8b2d0aecbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:04.562078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d8ee0-1fc2-4711-a1cd-d8b2d0aecbb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:04.562834 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d8ee0-1fc2-4711-a1cd-d8b2d0aecbb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:04.563149 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d8ee0-1fc2-4711-a1cd-d8b2d0aecbb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:04.564792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d8ee0-1fc2-4711-a1cd-d8b2d0aecbb4 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:04.577552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 410/805] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:11:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:04.577552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d8ee0-1fc2-4711-a1cd-d8b2d0aecbb4 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:04.609591 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:04.624807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fa317-07be-42fe-b324-b8bd78573ee4 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:04.650934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:04.657595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6be57-70cc-486b-be07-340c5f57c29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:04.664904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6be57-70cc-486b-be07-340c5f57c29d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:04.664904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6be57-70cc-486b-be07-340c5f57c29d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:04.664904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6be57-70cc-486b-be07-340c5f57c29d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:04.666605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6be57-70cc-486b-be07-340c5f57c29d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:04.668035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6be57-70cc-486b-be07-340c5f57c29d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:04.680772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d8ee0-1fc2-4711-a1cd-d8b2d0aecbb4 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-b3d6be57-70cc-486b-be07-340c5f57c29d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:11:04.682067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:04.682962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:04.683886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:11:04.683886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:11:04.683886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:11:04.683886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:11:04.683886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:11:04.683886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:11:04.683886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:04.683886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:04.683886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 396/806] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:04.684383 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6be57-70cc-486b-be07-340c5f57c29d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:04.719848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290b0a9-3b55-4986-ada0-3588d4128a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:04.720516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290b0a9-3b55-4986-ada0-3588d4128a1a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:04.720801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290b0a9-3b55-4986-ada0-3588d4128a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:04.721081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290b0a9-3b55-4986-ada0-3588d4128a1a None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:04.722368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290b0a9-3b55-4986-ada0-3588d4128a1a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:04.722677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290b0a9-3b55-4986-ada0-3588d4128a1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:04.724043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290b0a9-3b55-4986-ada0-3588d4128a1a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:04.728897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 411/807] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Jul 12 16:11:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:04.729795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290b0a9-3b55-4986-ada0-3588d4128a1a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:04.810999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6be57-70cc-486b-be07-340c5f57c29d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:04.829974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290b0a9-3b55-4986-ada0-3588d4128a1a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:04.847668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544b292-045f-48c9-b820-09d69b6f036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:04.848455 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544b292-045f-48c9-b820-09d69b6f036d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:04.848738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544b292-045f-48c9-b820-09d69b6f036d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:04.849014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544b292-045f-48c9-b820-09d69b6f036d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:04.860241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544b292-045f-48c9-b820-09d69b6f036d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:04.861958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544b292-045f-48c9-b820-09d69b6f036d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:04.864194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a8aeb-2ae0-4d50-8be4-d8c0cfd9f0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:04.864991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8aeb-2ae0-4d50-8be4-d8c0cfd9f0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:04.865307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8aeb-2ae0-4d50-8be4-d8c0cfd9f0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:04.865588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8aeb-2ae0-4d50-8be4-d8c0cfd9f0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:04.868279 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:04.871117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:04.876694 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a8aeb-2ae0-4d50-8be4-d8c0cfd9f0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:04.878651 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a8aeb-2ae0-4d50-8be4-d8c0cfd9f0a5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-d544b292-045f-48c9-b820-09d69b6f036d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:04.881367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:04.882439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:04.888425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:04.888425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:04.888425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:04.888425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:04.888425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 397/808] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:04.888425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544b292-045f-48c9-b820-09d69b6f036d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-468a8aeb-2ae0-4d50-8be4-d8c0cfd9f0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:04.905682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:04.906662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:04.907596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:04.907596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:04.907596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:04.907596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:04.907596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 412/809] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:04.907888 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a8aeb-2ae0-4d50-8be4-d8c0cfd9f0a5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:04.994557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544b292-045f-48c9-b820-09d69b6f036d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:05.013777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a8aeb-2ae0-4d50-8be4-d8c0cfd9f0a5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:05.030759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37cd24-ea19-4d3e-b73b-1fd3c4fa87d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:05.031142 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37cd24-ea19-4d3e-b73b-1fd3c4fa87d8 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:05.031562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37cd24-ea19-4d3e-b73b-1fd3c4fa87d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:05.031851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37cd24-ea19-4d3e-b73b-1fd3c4fa87d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:05.032936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37cd24-ea19-4d3e-b73b-1fd3c4fa87d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:05.033294 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37cd24-ea19-4d3e-b73b-1fd3c4fa87d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:05.034746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37cd24-ea19-4d3e-b73b-1fd3c4fa87d8 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:05.047327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 398/810] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:05.048243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37cd24-ea19-4d3e-b73b-1fd3c4fa87d8 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:05.054609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fe0f5-e5a8-45cf-affc-b7829210d023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:05.055287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fe0f5-e5a8-45cf-affc-b7829210d023 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:05.055577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fe0f5-e5a8-45cf-affc-b7829210d023 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:05.055859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fe0f5-e5a8-45cf-affc-b7829210d023 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:05.056578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fe0f5-e5a8-45cf-affc-b7829210d023 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:05.056891 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fe0f5-e5a8-45cf-affc-b7829210d023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:05.058337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fe0f5-e5a8-45cf-affc-b7829210d023 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:05.068542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 413/811] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Jul 12 16:11:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:05.068542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fe0f5-e5a8-45cf-affc-b7829210d023 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:05.118524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:05.122647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:05.160075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37cd24-ea19-4d3e-b73b-1fd3c4fa87d8 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:05.169775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fe0f5-e5a8-45cf-affc-b7829210d023 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:05.194413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6e62b-2e32-439a-9098-47cc54245f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:05.195083 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6e62b-2e32-439a-9098-47cc54245f90 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:05.195374 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6e62b-2e32-439a-9098-47cc54245f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:05.195652 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6e62b-2e32-439a-9098-47cc54245f90 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:05.196374 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6e62b-2e32-439a-9098-47cc54245f90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:05.196686 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6e62b-2e32-439a-9098-47cc54245f90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:05.198068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6e62b-2e32-439a-9098-47cc54245f90 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:05.204092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8afcc-0fd9-40d2-802e-63855d1152f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:05.204748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8afcc-0fd9-40d2-802e-63855d1152f0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:05.205033 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8afcc-0fd9-40d2-802e-63855d1152f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:05.205347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8afcc-0fd9-40d2-802e-63855d1152f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:05.206715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8afcc-0fd9-40d2-802e-63855d1152f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:05.207021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8afcc-0fd9-40d2-802e-63855d1152f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:05.208376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8afcc-0fd9-40d2-802e-63855d1152f0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:05.209805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 399/812] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:05.210918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6e62b-2e32-439a-9098-47cc54245f90 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:05.220644 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 414/813] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:05.221463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8afcc-0fd9-40d2-802e-63855d1152f0 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:05.312512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6e62b-2e32-439a-9098-47cc54245f90 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:05.318339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8afcc-0fd9-40d2-802e-63855d1152f0 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:05.331814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:05.332859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:05.347525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045dce2-12bb-4078-99ea-89cfcfdbc6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:05.348412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045dce2-12bb-4078-99ea-89cfcfdbc6bf None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:05.348698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045dce2-12bb-4078-99ea-89cfcfdbc6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:05.348975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045dce2-12bb-4078-99ea-89cfcfdbc6bf None admin] PATH_INFO: `/v3/projects/2101dde305df44bc90d33b01976e8265/users/cdf13cc74cf94d9a87613fe1e102ac99/roles/b3ce4434b13d4e46a67de5728f7ee232` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:05.352584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa80075-6582-453c-a540-3c00ee2a640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:05.353261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa80075-6582-453c-a540-3c00ee2a640b None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:05.353548 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa80075-6582-453c-a540-3c00ee2a640b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:05.353819 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa80075-6582-453c-a540-3c00ee2a640b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:05.354552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa80075-6582-453c-a540-3c00ee2a640b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:05.355984 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa80075-6582-453c-a540-3c00ee2a640b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:05.363506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045dce2-12bb-4078-99ea-89cfcfdbc6bf None admin] RBAC: Authorizing `identity:create_grant(project_id=2101dde305df44bc90d33b01976e8265, user_id=cdf13cc74cf94d9a87613fe1e102ac99, role_id=b3ce4434b13d4e46a67de5728f7ee232)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:05.364964 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045dce2-12bb-4078-99ea-89cfcfdbc6bf None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:05.457547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 415/814] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 16:11:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:11:05.458863 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3fa5b-b55e-4dbb-8e9f-86d75d653a20 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:05.459151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3fa5b-b55e-4dbb-8e9f-86d75d653a20 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:05.459429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3fa5b-b55e-4dbb-8e9f-86d75d653a20 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:05.460852 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 416/815] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:05.461445 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3fa5b-b55e-4dbb-8e9f-86d75d653a20 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:05.477716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 400/816] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:11:05 2022] PUT /identity/v3/projects/2101dde305df44bc90d33b01976e8265/users/cdf13cc74cf94d9a87613fe1e102ac99/roles/b3ce4434b13d4e46a67de5728f7ee232 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:11:05.478611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045dce2-12bb-4078-99ea-89cfcfdbc6bf None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:05.607137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3fa5b-b55e-4dbb-8e9f-86d75d653a20 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:05.649071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045dce2-12bb-4078-99ea-89cfcfdbc6bf None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:05.652588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b76f07-1576-4bed-8b21-061921141874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:05.653434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b76f07-1576-4bed-8b21-061921141874 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:05.654388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b76f07-1576-4bed-8b21-061921141874 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:05.654388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b76f07-1576-4bed-8b21-061921141874 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:05.664330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b76f07-1576-4bed-8b21-061921141874 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:05.665859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b76f07-1576-4bed-8b21-061921141874 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-d8b76f07-1576-4bed-8b21-061921141874 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:11:05.681067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:05.682101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:05.683000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:11:05.683000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:11:05.683000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:11:05.683000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:11:05.683000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:11:05.683000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:11:05.683000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:05.683000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:05.683000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 417/817] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:05.683959 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a9345-1d29-48a0-b01a-90a665388263 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:05.684116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a9345-1d29-48a0-b01a-90a665388263 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:05.684393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a9345-1d29-48a0-b01a-90a665388263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:05.697669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5c7b2-4c63-4623-b5f0-269a4231b896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:05.698483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5c7b2-4c63-4623-b5f0-269a4231b896 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:05.698766 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5c7b2-4c63-4623-b5f0-269a4231b896 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:05.699042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5c7b2-4c63-4623-b5f0-269a4231b896 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:05.703152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-962a9345-1d29-48a0-b01a-90a665388263 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:05.704338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-962a9345-1d29-48a0-b01a-90a665388263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:05.707148 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5c7b2-4c63-4623-b5f0-269a4231b896 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:05.708742 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5c7b2-4c63-4623-b5f0-269a4231b896 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:05.723273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-29a5c7b2-4c63-4623-b5f0-269a4231b896 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:11:05.724255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:05.725438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:05.726425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:05.726425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:05.726425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:11:05.726425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:11:05.726425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:11:05.726425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:11:05.726425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:11:05.726425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:11:05.726425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:11:05.726425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:05.726425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 401/818] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 16:11:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:05.727016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5c7b2-4c63-4623-b5f0-269a4231b896 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:05.757175 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:05.806525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 418/819] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:05.809945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a9345-1d29-48a0-b01a-90a665388263 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:05.845962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5c7b2-4c63-4623-b5f0-269a4231b896 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:05.894514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8df66-12fe-4113-90e7-13bab37f077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:05.895748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8df66-12fe-4113-90e7-13bab37f077d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:05.896577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8df66-12fe-4113-90e7-13bab37f077d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:05.896855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8df66-12fe-4113-90e7-13bab37f077d None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:05.897952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8df66-12fe-4113-90e7-13bab37f077d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:05.898262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8df66-12fe-4113-90e7-13bab37f077d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:05.901047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8df66-12fe-4113-90e7-13bab37f077d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:05.917363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 402/820] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:11:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:05.918551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8df66-12fe-4113-90e7-13bab37f077d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:05.941068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a9345-1d29-48a0-b01a-90a665388263 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:05.979820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dacb1-b4c2-42c5-acca-bba2af9d68d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:05.980483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dacb1-b4c2-42c5-acca-bba2af9d68d9 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:05.980773 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dacb1-b4c2-42c5-acca-bba2af9d68d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:05.981053 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dacb1-b4c2-42c5-acca-bba2af9d68d9 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:05.982089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dacb1-b4c2-42c5-acca-bba2af9d68d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:05.982496 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dacb1-b4c2-42c5-acca-bba2af9d68d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:05.983953 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dacb1-b4c2-42c5-acca-bba2af9d68d9 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:06.005137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 419/821] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 16:11:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:06.006051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dacb1-b4c2-42c5-acca-bba2af9d68d9 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:06.021652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:06.035704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:06.045608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8df66-12fe-4113-90e7-13bab37f077d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:06.084461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d286f74-b831-4ec4-b7be-5d07110b37fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:06.085543 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d286f74-b831-4ec4-b7be-5d07110b37fa None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:06.085983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d286f74-b831-4ec4-b7be-5d07110b37fa None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:06.086620 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d286f74-b831-4ec4-b7be-5d07110b37fa None admin] PATH_INFO: `/v3/services/network` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:06.087416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d286f74-b831-4ec4-b7be-5d07110b37fa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:06.088918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d286f74-b831-4ec4-b7be-5d07110b37fa None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-0d286f74-b831-4ec4-b7be-5d07110b37fa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:06.101362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:06.102601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 16:11:06.103498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:06.109422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 403/822] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:05 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:06.110430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d286f74-b831-4ec4-b7be-5d07110b37fa None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:06.129750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dacb1-b4c2-42c5-acca-bba2af9d68d9 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:06.175845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db70be1-f3a2-488b-9d29-d14c68669ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:06.176741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db70be1-f3a2-488b-9d29-d14c68669ab0 None admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:06.177023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db70be1-f3a2-488b-9d29-d14c68669ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:06.177346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db70be1-f3a2-488b-9d29-d14c68669ab0 None admin] PATH_INFO: `/v3/projects/2101dde305df44bc90d33b01976e8265/users/143798e5887b49338f0000de5b55be68/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:06.180216 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db70be1-f3a2-488b-9d29-d14c68669ab0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2101dde305df44bc90d33b01976e8265, user_id=143798e5887b49338f0000de5b55be68, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:06.181690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db70be1-f3a2-488b-9d29-d14c68669ab0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:06.218764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d286f74-b831-4ec4-b7be-5d07110b37fa None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:06.254705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266f589-37e5-4c36-a4c6-d079b9a3a244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:06.255277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266f589-37e5-4c36-a4c6-d079b9a3a244 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:06.255559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266f589-37e5-4c36-a4c6-d079b9a3a244 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:06.255830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266f589-37e5-4c36-a4c6-d079b9a3a244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:06.265007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 420/823] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:11:06 2022] PUT /identity/v3/projects/2101dde305df44bc90d33b01976e8265/users/143798e5887b49338f0000de5b55be68/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:11:06.269233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db70be1-f3a2-488b-9d29-d14c68669ab0 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:06.308605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:06.389257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266f589-37e5-4c36-a4c6-d079b9a3a244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:06.390835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266f589-37e5-4c36-a4c6-d079b9a3a244 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:06.417554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:06.469446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db70be1-f3a2-488b-9d29-d14c68669ab0 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:06.519238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd654f-a32f-45ad-b966-ec1c4340b638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:06.520373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd654f-a32f-45ad-b966-ec1c4340b638 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:06.520760 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd654f-a32f-45ad-b966-ec1c4340b638 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:06.521478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd654f-a32f-45ad-b966-ec1c4340b638 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:06.522298 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd654f-a32f-45ad-b966-ec1c4340b638 None admin] RBAC: Adding query filter params (name=network) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:06.522976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd654f-a32f-45ad-b966-ec1c4340b638 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:06.525196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd654f-a32f-45ad-b966-ec1c4340b638 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:06.528357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 404/824] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:11:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:11:06.531057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 421/825] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 16:11:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:06.533622 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266f589-37e5-4c36-a4c6-d079b9a3a244 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:06.538085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd654f-a32f-45ad-b966-ec1c4340b638 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:06.604824 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:06.681398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd654f-a32f-45ad-b966-ec1c4340b638 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:06.719255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266f589-37e5-4c36-a4c6-d079b9a3a244 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:06.721104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978f0e4-3c5d-412b-8abc-e5918b34d82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:06.722596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978f0e4-3c5d-412b-8abc-e5918b34d82b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:06.723083 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978f0e4-3c5d-412b-8abc-e5918b34d82b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:06.723581 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978f0e4-3c5d-412b-8abc-e5918b34d82b None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:06.724499 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978f0e4-3c5d-412b-8abc-e5918b34d82b None admin] RBAC: Adding query filter params (type=network) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:06.725018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978f0e4-3c5d-412b-8abc-e5918b34d82b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:06.727495 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978f0e4-3c5d-412b-8abc-e5918b34d82b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:06.729953 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:06.734831 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 422/826] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 16:11:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:06.740323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978f0e4-3c5d-412b-8abc-e5918b34d82b None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:06.814186 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ae523-5b87-437b-973a-e5f48f0b1e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:06.815010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ae523-5b87-437b-973a-e5f48f0b1e13 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:06.815324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ae523-5b87-437b-973a-e5f48f0b1e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:06.815599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ae523-5b87-437b-973a-e5f48f0b1e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:06.842032 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ae523-5b87-437b-973a-e5f48f0b1e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:06.843495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ae523-5b87-437b-973a-e5f48f0b1e13 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:06.856670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978f0e4-3c5d-412b-8abc-e5918b34d82b None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-ec8ae523-5b87-437b-973a-e5f48f0b1e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:06.877439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:06.879091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:06.880206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:06.880206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:06.880206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:06.880206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:06.885540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 405/827] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:06.891621 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ae523-5b87-437b-973a-e5f48f0b1e13 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:06.901576 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20132b-5560-44bb-9a87-6f67cfeebe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:06.902569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20132b-5560-44bb-9a87-6f67cfeebe91 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:06.903060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20132b-5560-44bb-9a87-6f67cfeebe91 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:06.903538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20132b-5560-44bb-9a87-6f67cfeebe91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:06.904614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20132b-5560-44bb-9a87-6f67cfeebe91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:06.906269 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20132b-5560-44bb-9a87-6f67cfeebe91 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:06.994414 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 423/828] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 16:11:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:11:07.022152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ae523-5b87-437b-973a-e5f48f0b1e13 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:07.030205 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:07.069723 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584f31f-5478-4090-9964-9363b723820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:07.070372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584f31f-5478-4090-9964-9363b723820d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:07.070660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584f31f-5478-4090-9964-9363b723820d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:07.070938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584f31f-5478-4090-9964-9363b723820d None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:07.071666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584f31f-5478-4090-9964-9363b723820d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:07.071974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584f31f-5478-4090-9964-9363b723820d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:07.073425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584f31f-5478-4090-9964-9363b723820d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:07.086253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 406/829] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:07.092288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20132b-5560-44bb-9a87-6f67cfeebe91 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:07.170322 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:07.225461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20132b-5560-44bb-9a87-6f67cfeebe91 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:07.270208 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f909-d63b-4754-8dd0-a7f8c1b83865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:07.271029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f909-d63b-4754-8dd0-a7f8c1b83865 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:07.271315 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f909-d63b-4754-8dd0-a7f8c1b83865 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:07.271589 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f909-d63b-4754-8dd0-a7f8c1b83865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:07.279297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9f909-d63b-4754-8dd0-a7f8c1b83865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:07.280762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9f909-d63b-4754-8dd0-a7f8c1b83865 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-a0a9f909-d63b-4754-8dd0-a7f8c1b83865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:11:07.296071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:07.297057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:07.298067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:11:07.298067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:11:07.298067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:11:07.298067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:11:07.298067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:11:07.298067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:11:07.298067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:07.298067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:07.298067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 424/830] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:07.304034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584f31f-5478-4090-9964-9363b723820d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:07.410591 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584f31f-5478-4090-9964-9363b723820d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:07.446716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d30990-545b-49fc-a511-c1871fd20ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:07.447379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30990-545b-49fc-a511-c1871fd20ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:07.447710 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30990-545b-49fc-a511-c1871fd20ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:07.447994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30990-545b-49fc-a511-c1871fd20ae0 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:07.448786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30990-545b-49fc-a511-c1871fd20ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:07.449095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30990-545b-49fc-a511-c1871fd20ae0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:07.450961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30990-545b-49fc-a511-c1871fd20ae0 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:07.465487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 407/831] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:11:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:07.471489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f909-d63b-4754-8dd0-a7f8c1b83865 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:07.586517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f909-d63b-4754-8dd0-a7f8c1b83865 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:07.606246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:07.629489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82dafa-3494-4f5c-b367-442c57683729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:07.630157 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82dafa-3494-4f5c-b367-442c57683729 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:07.630442 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82dafa-3494-4f5c-b367-442c57683729 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:07.630719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82dafa-3494-4f5c-b367-442c57683729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:07.631628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82dafa-3494-4f5c-b367-442c57683729 None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=f36355ce7ff841f3bd9e228fbad64a83) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:07.631948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82dafa-3494-4f5c-b367-442c57683729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:07.633498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82dafa-3494-4f5c-b367-442c57683729 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:07.639878 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 425/832] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:11:07 2022] GET /identity/v3/role_assignments?user.id=f36355ce7ff841f3bd9e228fbad64a83&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:07.759519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c972514-b685-4d2b-9334-4b9c242cc93c None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:07.759823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c972514-b685-4d2b-9334-4b9c242cc93c None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:07.759988 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c972514-b685-4d2b-9334-4b9c242cc93c None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:07.761735 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 408/833] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:07.771152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25562048-6353-4d56-9042-c1ada4d4d032 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:07.771465 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25562048-6353-4d56-9042-c1ada4d4d032 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:07.771726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25562048-6353-4d56-9042-c1ada4d4d032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:07.792765 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-25562048-6353-4d56-9042-c1ada4d4d032 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:07.794055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-25562048-6353-4d56-9042-c1ada4d4d032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:07.867564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 426/834] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:07.889268 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c972514-b685-4d2b-9334-4b9c242cc93c None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:07.899709 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9edcd-1726-4331-8bcb-48a6ea049384 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:07.899990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9edcd-1726-4331-8bcb-48a6ea049384 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:07.900276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9edcd-1726-4331-8bcb-48a6ea049384 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:07.902001 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 427/835] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:11:07.907033 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb33804-f7f7-4cdb-8229-522230ae9e7e None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:07.907326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb33804-f7f7-4cdb-8229-522230ae9e7e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:07.907609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb33804-f7f7-4cdb-8229-522230ae9e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:07.918626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:07.926635 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-2cb33804-f7f7-4cdb-8229-522230ae9e7e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:07.930763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-2cb33804-f7f7-4cdb-8229-522230ae9e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:08.005106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c972514-b685-4d2b-9334-4b9c242cc93c None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:08.021483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 428/836] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:08.039436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb33804-f7f7-4cdb-8229-522230ae9e7e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:08.041754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba1b70-c3b4-496f-a218-13caf780ec5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:08.042562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1b70-c3b4-496f-a218-13caf780ec5e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:08.042846 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1b70-c3b4-496f-a218-13caf780ec5e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:08.043121 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1b70-c3b4-496f-a218-13caf780ec5e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:08.043831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba1b70-c3b4-496f-a218-13caf780ec5e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:08.045216 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba1b70-c3b4-496f-a218-13caf780ec5e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-45ba1b70-c3b4-496f-a218-13caf780ec5e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:08.058231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:08.059250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:08.060096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 409/837] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:11:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:08.066897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba1b70-c3b4-496f-a218-13caf780ec5e None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:08.099551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:08.163443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb33804-f7f7-4cdb-8229-522230ae9e7e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:08.182170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:08.202661 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e9e51-1a27-4dbc-abc9-3e67d2f08efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:08.203281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba1b70-c3b4-496f-a218-13caf780ec5e None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:08.204224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9e51-1a27-4dbc-abc9-3e67d2f08efc None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:08.204919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9e51-1a27-4dbc-abc9-3e67d2f08efc None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:08.205433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9e51-1a27-4dbc-abc9-3e67d2f08efc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:08.218883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e9e51-1a27-4dbc-abc9-3e67d2f08efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-4e6e9e51-1a27-4dbc-abc9-3e67d2f08efc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:08.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:08.229133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:08.230167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:08.230167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:08.230167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:08.230167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:08.230167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:08.230167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:08.230167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:08.230167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:08.230167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:08.230167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:08.230167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:11:08.230167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:08.237540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 429/838] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:11:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:08.238998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e9e51-1a27-4dbc-abc9-3e67d2f08efc None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:08.243797 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2c98a-5211-47f6-aa57-ccc382e2e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:08.244490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2c98a-5211-47f6-aa57-ccc382e2e9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:08.244782 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2c98a-5211-47f6-aa57-ccc382e2e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:08.245064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2c98a-5211-47f6-aa57-ccc382e2e9c7 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:08.245803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2c98a-5211-47f6-aa57-ccc382e2e9c7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:08.246114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2c98a-5211-47f6-aa57-ccc382e2e9c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:08.247548 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2c98a-5211-47f6-aa57-ccc382e2e9c7 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:08.257196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 410/839] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:11:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:08.259163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2c98a-5211-47f6-aa57-ccc382e2e9c7 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:08.368691 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:08.374106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e9e51-1a27-4dbc-abc9-3e67d2f08efc None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:08.382230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2c98a-5211-47f6-aa57-ccc382e2e9c7 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:08.411276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0f3cd-04a9-4ccd-923a-cf0103ddb0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:08.412191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0f3cd-04a9-4ccd-923a-cf0103ddb0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:08.412624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0f3cd-04a9-4ccd-923a-cf0103ddb0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:08.413087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0f3cd-04a9-4ccd-923a-cf0103ddb0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:08.414045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0f3cd-04a9-4ccd-923a-cf0103ddb0e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:08.414556 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0f3cd-04a9-4ccd-923a-cf0103ddb0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:08.416107 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0f3cd-04a9-4ccd-923a-cf0103ddb0e1 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:08.429148 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf5831-c237-47d0-aa06-6db7dc0800b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:08.429148 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf5831-c237-47d0-aa06-6db7dc0800b3 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:08.429148 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf5831-c237-47d0-aa06-6db7dc0800b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:08.429148 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf5831-c237-47d0-aa06-6db7dc0800b3 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:08.429877 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf5831-c237-47d0-aa06-6db7dc0800b3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:08.429877 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf5831-c237-47d0-aa06-6db7dc0800b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:08.429877 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf5831-c237-47d0-aa06-6db7dc0800b3 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:08.430651 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 430/840] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:11:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:08.432300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0f3cd-04a9-4ccd-923a-cf0103ddb0e1 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:08.437180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 411/841] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:11:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:08.555872 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0f3cd-04a9-4ccd-923a-cf0103ddb0e1 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:08.593551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55db14-166e-4841-bb96-b1d462702ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:08.594762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55db14-166e-4841-bb96-b1d462702ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:08.595270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55db14-166e-4841-bb96-b1d462702ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:08.595724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55db14-166e-4841-bb96-b1d462702ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:08.608228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55db14-166e-4841-bb96-b1d462702ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:08.610049 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55db14-166e-4841-bb96-b1d462702ed4 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-0f55db14-166e-4841-bb96-b1d462702ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:08.630817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:08.631730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:08.632723 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:08.632723 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:08.632723 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:08.632723 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:08.634418 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 431/842] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:08.640149 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf5831-c237-47d0-aa06-6db7dc0800b3 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:08.658478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:08.746053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf5831-c237-47d0-aa06-6db7dc0800b3 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:08.755058 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16716d2f-73ce-4a87-a92c-bf707a437bc9 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:08.755353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16716d2f-73ce-4a87-a92c-bf707a437bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:08.755638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16716d2f-73ce-4a87-a92c-bf707a437bc9 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:08.760767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 432/843] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:08.762342 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b10d4-16f6-4d2e-924f-8dbd8feb079e None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:08.762528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b10d4-16f6-4d2e-924f-8dbd8feb079e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:08.762785 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b10d4-16f6-4d2e-924f-8dbd8feb079e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:08.780670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-428b10d4-16f6-4d2e-924f-8dbd8feb079e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:08.781926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-428b10d4-16f6-4d2e-924f-8dbd8feb079e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:08.785143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d761f-79a5-4329-a335-abd3ee87772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:08.785835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d761f-79a5-4329-a335-abd3ee87772a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:08.786123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d761f-79a5-4329-a335-abd3ee87772a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:08.786400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d761f-79a5-4329-a335-abd3ee87772a None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:08.787125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d761f-79a5-4329-a335-abd3ee87772a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:08.787432 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d761f-79a5-4329-a335-abd3ee87772a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:08.788859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d761f-79a5-4329-a335-abd3ee87772a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:08.793302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:08.802783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 412/844] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:08.808299 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d761f-79a5-4329-a335-abd3ee87772a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:08.868074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 433/845] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:08.888199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:08.893286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b10d4-16f6-4d2e-924f-8dbd8feb079e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:08.916357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d761f-79a5-4329-a335-abd3ee87772a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:08.952630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40e898-5143-4a3a-92be-f97102fc0a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:08.953532 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40e898-5143-4a3a-92be-f97102fc0a70 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:08.953819 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40e898-5143-4a3a-92be-f97102fc0a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:08.954099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40e898-5143-4a3a-92be-f97102fc0a70 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:08.962799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40e898-5143-4a3a-92be-f97102fc0a70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:08.964494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40e898-5143-4a3a-92be-f97102fc0a70 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-de40e898-5143-4a3a-92be-f97102fc0a70 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:11:08.979691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:08.980668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:08.982075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:08.982075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:08.982075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:11:08.982075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:11:08.982075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:11:08.982075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:11:08.982075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:11:08.982075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:11:08.982075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 16:11:08.982075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:08.982075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 413/846] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 16:11:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:08.986634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40e898-5143-4a3a-92be-f97102fc0a70 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:09.024264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b10d4-16f6-4d2e-924f-8dbd8feb079e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:09.070288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c7cac-fefe-49cc-abca-75020c278b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:09.071476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c7cac-fefe-49cc-abca-75020c278b41 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:09.072074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c7cac-fefe-49cc-abca-75020c278b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:09.072537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c7cac-fefe-49cc-abca-75020c278b41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:09.085973 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c7cac-fefe-49cc-abca-75020c278b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:09.091145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40e898-5143-4a3a-92be-f97102fc0a70 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-b06c7cac-fefe-49cc-abca-75020c278b41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:09.096037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:09.097005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:09.097924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:09.097924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:09.097924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:09.097924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:09.097924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:09.097924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:09.097924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:09.097924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:09.097924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:09.097924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:09.097924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:11:09.097924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:09.105155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 434/847] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:11:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:09.107639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c7cac-fefe-49cc-abca-75020c278b41 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:09.129469 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:09.134707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b408def-00df-42ec-ac7f-582936340bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:09.135620 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408def-00df-42ec-ac7f-582936340bed None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:09.135801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408def-00df-42ec-ac7f-582936340bed None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:09.136195 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408def-00df-42ec-ac7f-582936340bed None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:09.137176 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b408def-00df-42ec-ac7f-582936340bed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:09.137582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b408def-00df-42ec-ac7f-582936340bed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:09.139247 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b408def-00df-42ec-ac7f-582936340bed None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:09.141102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:09.162766 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 414/848] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Jul 12 16:11:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:09.163753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b408def-00df-42ec-ac7f-582936340bed None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:09.230687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c7cac-fefe-49cc-abca-75020c278b41 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:09.268947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fcc7f-c8f3-4c1a-83d4-bb6ae25d22d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:09.270241 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fcc7f-c8f3-4c1a-83d4-bb6ae25d22d0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:09.271239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fcc7f-c8f3-4c1a-83d4-bb6ae25d22d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:09.271706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fcc7f-c8f3-4c1a-83d4-bb6ae25d22d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:09.272932 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fcc7f-c8f3-4c1a-83d4-bb6ae25d22d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:09.273457 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fcc7f-c8f3-4c1a-83d4-bb6ae25d22d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:09.275586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fcc7f-c8f3-4c1a-83d4-bb6ae25d22d0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:09.291254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 435/849] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:11:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:09.292909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fcc7f-c8f3-4c1a-83d4-bb6ae25d22d0 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:09.296236 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b408def-00df-42ec-ac7f-582936340bed None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:09.340962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbee44f-9860-4224-8287-dc7f1e468ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:09.342097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee44f-9860-4224-8287-dc7f1e468ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:09.342588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee44f-9860-4224-8287-dc7f1e468ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:09.343069 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee44f-9860-4224-8287-dc7f1e468ea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:09.365468 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:09.396725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fcc7f-c8f3-4c1a-83d4-bb6ae25d22d0 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:09.406517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:09.418066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbee44f-9860-4224-8287-dc7f1e468ea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:09.419852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbee44f-9860-4224-8287-dc7f1e468ea5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:09.432962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6606d81-15b6-4d5d-af44-48fbbd8a07e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:09.433872 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6606d81-15b6-4d5d-af44-48fbbd8a07e5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:09.434146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6606d81-15b6-4d5d-af44-48fbbd8a07e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:09.434420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6606d81-15b6-4d5d-af44-48fbbd8a07e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:09.444970 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6606d81-15b6-4d5d-af44-48fbbd8a07e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:09.446490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6606d81-15b6-4d5d-af44-48fbbd8a07e5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-b6606d81-15b6-4d5d-af44-48fbbd8a07e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:09.472102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:09.473060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:09.474029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:09.474029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:09.474029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:09.474029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:09.478517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 436/850] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:09.479409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6606d81-15b6-4d5d-af44-48fbbd8a07e5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:09.543450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 415/851] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:11:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:11:09.545423 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbee44f-9860-4224-8287-dc7f1e468ea5 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:09.580835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6606d81-15b6-4d5d-af44-48fbbd8a07e5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:09.613512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:09.618107 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9a5ee-25ad-4cbc-968b-184b92e17768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:09.618896 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9a5ee-25ad-4cbc-968b-184b92e17768 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:09.619175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9a5ee-25ad-4cbc-968b-184b92e17768 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:09.619509 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9a5ee-25ad-4cbc-968b-184b92e17768 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:09.620263 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9a5ee-25ad-4cbc-968b-184b92e17768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:09.620570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9a5ee-25ad-4cbc-968b-184b92e17768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:09.622762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9a5ee-25ad-4cbc-968b-184b92e17768 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:09.641205 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 437/852] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:09.643519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9a5ee-25ad-4cbc-968b-184b92e17768 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:09.660355 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:09.669929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbee44f-9860-4224-8287-dc7f1e468ea5 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:09.707474 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a064b1-1e54-4150-a175-cf533df209cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:09.708515 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a064b1-1e54-4150-a175-cf533df209cd None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:09.708774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a064b1-1e54-4150-a175-cf533df209cd None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:09.709143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a064b1-1e54-4150-a175-cf533df209cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:09.719895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a064b1-1e54-4150-a175-cf533df209cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:09.721417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a064b1-1e54-4150-a175-cf533df209cd None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-14a064b1-1e54-4150-a175-cf533df209cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:09.740127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:09.741073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:09.742303 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:09.742303 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:09.742303 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:09.742303 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:09.745993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 416/853] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:09.747277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a064b1-1e54-4150-a175-cf533df209cd None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:09.758082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9a5ee-25ad-4cbc-968b-184b92e17768 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:09.794293 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6bbb2-ab32-498c-8563-7db8123484ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:09.795443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6bbb2-ab32-498c-8563-7db8123484ba None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:09.795959 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6bbb2-ab32-498c-8563-7db8123484ba None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:09.796460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6bbb2-ab32-498c-8563-7db8123484ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:09.804580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6bbb2-ab32-498c-8563-7db8123484ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:09.806061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6bbb2-ab32-498c-8563-7db8123484ba None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-a5c6bbb2-ab32-498c-8563-7db8123484ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:11:09.820476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:09.821650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:09.822595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:09.822595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:09.822595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:11:09.822595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:11:09.822595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:11:09.822595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:11:09.822595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:11:09.822595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:11:09.822595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 16:11:09.822595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:09.825430 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 438/854] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:11:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:09.826916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184e653-3db3-4d19-ae67-516aadeacf96 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:09.827214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184e653-3db3-4d19-ae67-516aadeacf96 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:09.827498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184e653-3db3-4d19-ae67-516aadeacf96 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:09.828917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 439/855] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:09.833806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184e653-3db3-4d19-ae67-516aadeacf96 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:09.853318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a064b1-1e54-4150-a175-cf533df209cd None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:09.877695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:09.887104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d7295-db6e-49f3-be95-0ec987c5335a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:09.887744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d7295-db6e-49f3-be95-0ec987c5335a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:09.888033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d7295-db6e-49f3-be95-0ec987c5335a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:09.888312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d7295-db6e-49f3-be95-0ec987c5335a None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:09.889033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d7295-db6e-49f3-be95-0ec987c5335a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:09.889404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d7295-db6e-49f3-be95-0ec987c5335a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:09.890788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d7295-db6e-49f3-be95-0ec987c5335a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:09.906915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 417/856] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:09.906915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07cde-b4e7-4288-8be9-36543023b899 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:09.906915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07cde-b4e7-4288-8be9-36543023b899 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:09.906915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07cde-b4e7-4288-8be9-36543023b899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:09.912686 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:09.925931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-c5e07cde-b4e7-4288-8be9-36543023b899 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:09.927402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c5e07cde-b4e7-4288-8be9-36543023b899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:09.947693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184e653-3db3-4d19-ae67-516aadeacf96 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:09.985235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b8e4c-db4c-47e7-9547-d42a7c3abdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:09.985916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b8e4c-db4c-47e7-9547-d42a7c3abdfb None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:09.986202 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b8e4c-db4c-47e7-9547-d42a7c3abdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:09.986478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b8e4c-db4c-47e7-9547-d42a7c3abdfb None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:09.987791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b8e4c-db4c-47e7-9547-d42a7c3abdfb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:09.988081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b8e4c-db4c-47e7-9547-d42a7c3abdfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:09.989697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b8e4c-db4c-47e7-9547-d42a7c3abdfb None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:10.001174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 418/857] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:10.011874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 440/858] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Jul 12 16:11:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:10.012035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e07cde-b4e7-4288-8be9-36543023b899 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:10.015026 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b8e4c-db4c-47e7-9547-d42a7c3abdfb None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:10.116417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e07cde-b4e7-4288-8be9-36543023b899 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:10.118339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:10.124202 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b8e4c-db4c-47e7-9547-d42a7c3abdfb None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:10.155938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29eae6-3676-4b43-bbc7-ae0d320cda68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:10.156900 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29eae6-3676-4b43-bbc7-ae0d320cda68 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:10.157522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29eae6-3676-4b43-bbc7-ae0d320cda68 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:10.157945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29eae6-3676-4b43-bbc7-ae0d320cda68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:10.160102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:10.161880 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaf9bc-1c88-43d8-96a8-b68f42d3673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:10.162539 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaf9bc-1c88-43d8-96a8-b68f42d3673b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:10.162878 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaf9bc-1c88-43d8-96a8-b68f42d3673b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:10.163108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaf9bc-1c88-43d8-96a8-b68f42d3673b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:10.165512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29eae6-3676-4b43-bbc7-ae0d320cda68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:10.168059 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29eae6-3676-4b43-bbc7-ae0d320cda68 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-2f29eae6-3676-4b43-bbc7-ae0d320cda68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:11:10.184484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:10.185450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:10.186376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:11:10.186376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:11:10.186376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:11:10.186376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:11:10.186376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:11:10.186376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:11:10.186376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:10.186376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:10.186816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 419/859] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:10.187416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29eae6-3676-4b43-bbc7-ae0d320cda68 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:10.240853 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaf9bc-1c88-43d8-96a8-b68f42d3673b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:10.242364 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaf9bc-1c88-43d8-96a8-b68f42d3673b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:10.299205 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29eae6-3676-4b43-bbc7-ae0d320cda68 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:10.336286 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b09aa0-94ce-43c4-b9e0-7f7515d2ab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:10.337107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b09aa0-94ce-43c4-b9e0-7f7515d2ab63 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:10.337414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b09aa0-94ce-43c4-b9e0-7f7515d2ab63 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:10.337696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b09aa0-94ce-43c4-b9e0-7f7515d2ab63 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:10.338349 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b09aa0-94ce-43c4-b9e0-7f7515d2ab63 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:10.339720 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b09aa0-94ce-43c4-b9e0-7f7515d2ab63 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:10.341303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:10.352476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 441/860] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:11:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:11:10.352476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaf9bc-1c88-43d8-96a8-b68f42d3673b None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-62b09aa0-94ce-43c4-b9e0-7f7515d2ab63 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:10.352706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:10.354192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:10.355254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 420/861] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Jul 12 16:11:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:10.356204 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b09aa0-94ce-43c4-b9e0-7f7515d2ab63 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:10.417299 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:10.469397 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b09aa0-94ce-43c4-b9e0-7f7515d2ab63 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:10.469819 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaf9bc-1c88-43d8-96a8-b68f42d3673b None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:10.506040 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705e612-72f0-48d0-8cea-f449edddeb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:10.506427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47487cf0-eb91-4052-926e-58ea93c82700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:10.506704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e612-72f0-48d0-8cea-f449edddeb88 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:10.506989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e612-72f0-48d0-8cea-f449edddeb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:10.507220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487cf0-eb91-4052-926e-58ea93c82700 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:10.507320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e612-72f0-48d0-8cea-f449edddeb88 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:10.507519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487cf0-eb91-4052-926e-58ea93c82700 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:10.507781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487cf0-eb91-4052-926e-58ea93c82700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:10.508038 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705e612-72f0-48d0-8cea-f449edddeb88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:10.508349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705e612-72f0-48d0-8cea-f449edddeb88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:10.509883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705e612-72f0-48d0-8cea-f449edddeb88 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:10.520949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47487cf0-eb91-4052-926e-58ea93c82700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:10.526983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47487cf0-eb91-4052-926e-58ea93c82700 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:10.527104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 442/862] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:11:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:10.527104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705e612-72f0-48d0-8cea-f449edddeb88 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-47487cf0-eb91-4052-926e-58ea93c82700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:10.545035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:10.546498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:10.547597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:10.547597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:10.547597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:10.547597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:10.551102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 421/863] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:10.551940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47487cf0-eb91-4052-926e-58ea93c82700 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:10.591682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:10.634534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705e612-72f0-48d0-8cea-f449edddeb88 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:10.650648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47487cf0-eb91-4052-926e-58ea93c82700 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:10.662605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:10.668200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d39c6c-5ff2-45f5-8e64-d14c08c0e523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:10.668806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d39c6c-5ff2-45f5-8e64-d14c08c0e523 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:10.669092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d39c6c-5ff2-45f5-8e64-d14c08c0e523 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:10.669427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d39c6c-5ff2-45f5-8e64-d14c08c0e523 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:10.670135 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d39c6c-5ff2-45f5-8e64-d14c08c0e523 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:10.670446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d39c6c-5ff2-45f5-8e64-d14c08c0e523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:10.671833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d39c6c-5ff2-45f5-8e64-d14c08c0e523 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:10.676434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 443/864] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 16:11:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:10.677317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d39c6c-5ff2-45f5-8e64-d14c08c0e523 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:10.685165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9094b1-0ae5-4cb2-a453-09031ec940a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:10.686006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9094b1-0ae5-4cb2-a453-09031ec940a2 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:10.686578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9094b1-0ae5-4cb2-a453-09031ec940a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:10.686864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9094b1-0ae5-4cb2-a453-09031ec940a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:10.687703 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9094b1-0ae5-4cb2-a453-09031ec940a2 None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=cdf13cc74cf94d9a87613fe1e102ac99) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:10.688022 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9094b1-0ae5-4cb2-a453-09031ec940a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:10.689740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9094b1-0ae5-4cb2-a453-09031ec940a2 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:10.696098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 422/865] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:11:10 2022] GET /identity/v3/role_assignments?user.id=cdf13cc74cf94d9a87613fe1e102ac99&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:10.697626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf96298-b8c9-4aef-9fdb-9ef466e64f94 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:10.697766 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf96298-b8c9-4aef-9fdb-9ef466e64f94 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:10.698039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf96298-b8c9-4aef-9fdb-9ef466e64f94 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:10.699393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 423/866] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:10.700042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf96298-b8c9-4aef-9fdb-9ef466e64f94 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:10.801616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d39c6c-5ff2-45f5-8e64-d14c08c0e523 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:10.815777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf96298-b8c9-4aef-9fdb-9ef466e64f94 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:10.824906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:10.840722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac479bef-a1e7-42bc-91d0-7c9a7693f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:10.841422 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac479bef-a1e7-42bc-91d0-7c9a7693f027 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:10.841710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac479bef-a1e7-42bc-91d0-7c9a7693f027 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:10.841991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac479bef-a1e7-42bc-91d0-7c9a7693f027 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:10.842726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac479bef-a1e7-42bc-91d0-7c9a7693f027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:10.843035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac479bef-a1e7-42bc-91d0-7c9a7693f027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:10.844454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac479bef-a1e7-42bc-91d0-7c9a7693f027 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:10.857105 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e89285-9a8a-45ab-a000-83d22c287179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:10.857876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 444/867] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:10.858264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e89285-9a8a-45ab-a000-83d22c287179 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:10.858682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e89285-9a8a-45ab-a000-83d22c287179 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:10.859090 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e89285-9a8a-45ab-a000-83d22c287179 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:10.859244 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b493af-9383-4fec-bd42-7f668a9d0df6 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:10.859537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b493af-9383-4fec-bd42-7f668a9d0df6 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:10.859817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b493af-9383-4fec-bd42-7f668a9d0df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:10.860370 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e89285-9a8a-45ab-a000-83d22c287179 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:10.860809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e89285-9a8a-45ab-a000-83d22c287179 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:10.862413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e89285-9a8a-45ab-a000-83d22c287179 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:10.867827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 424/868] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 16:11:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:10.868491 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e89285-9a8a-45ab-a000-83d22c287179 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:10.878854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-b3b493af-9383-4fec-bd42-7f668a9d0df6 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:10.880094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b3b493af-9383-4fec-bd42-7f668a9d0df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:10.928166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:10.974184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 445/869] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:11.006226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b493af-9383-4fec-bd42-7f668a9d0df6 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:11.016282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e89285-9a8a-45ab-a000-83d22c287179 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:11.060863 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e73c7b-b413-479b-b086-8b0d3a4da416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:11.061722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e73c7b-b413-479b-b086-8b0d3a4da416 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:11.062004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e73c7b-b413-479b-b086-8b0d3a4da416 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:11.062275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e73c7b-b413-479b-b086-8b0d3a4da416 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:11.070585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e73c7b-b413-479b-b086-8b0d3a4da416 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:11.072041 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e73c7b-b413-479b-b086-8b0d3a4da416 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-39e73c7b-b413-479b-b086-8b0d3a4da416 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:11:11.091044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:11.092014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:11.092908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:11:11.092908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:11:11.092908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:11:11.092908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:11:11.092908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:11:11.092908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:11:11.092908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:11.092908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:11.092908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 425/870] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:11.100018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e73c7b-b413-479b-b086-8b0d3a4da416 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:11.123419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b493af-9383-4fec-bd42-7f668a9d0df6 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:11.134609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:11.162673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3aa9d-0c39-4ac0-be99-916429dd30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:11.163498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3aa9d-0c39-4ac0-be99-916429dd30f8 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:11.163914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3aa9d-0c39-4ac0-be99-916429dd30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:11.164254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3aa9d-0c39-4ac0-be99-916429dd30f8 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:11.165160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3aa9d-0c39-4ac0-be99-916429dd30f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:11.166612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3aa9d-0c39-4ac0-be99-916429dd30f8 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:11.213027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:11.216897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e73c7b-b413-479b-b086-8b0d3a4da416 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:11.241677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 446/871] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:11:11 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:11:11.266300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9178f-5104-4d93-9e1b-f6f0ddc241a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:11.267098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9178f-5104-4d93-9e1b-f6f0ddc241a1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:11.267448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9178f-5104-4d93-9e1b-f6f0ddc241a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:11.267872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9178f-5104-4d93-9e1b-f6f0ddc241a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:11.269437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9178f-5104-4d93-9e1b-f6f0ddc241a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:11.269820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9178f-5104-4d93-9e1b-f6f0ddc241a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:11.271480 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9178f-5104-4d93-9e1b-f6f0ddc241a1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:11.286679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 426/872] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:11:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:11.292919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3aa9d-0c39-4ac0-be99-916429dd30f8 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:11.408112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3aa9d-0c39-4ac0-be99-916429dd30f8 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:11.443971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f82b44-e2a7-4791-8590-69fc681ca98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:11.444644 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f82b44-e2a7-4791-8590-69fc681ca98b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:11.444929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f82b44-e2a7-4791-8590-69fc681ca98b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:11.445239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f82b44-e2a7-4791-8590-69fc681ca98b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:11.446088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f82b44-e2a7-4791-8590-69fc681ca98b None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=143798e5887b49338f0000de5b55be68) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:11.446404 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f82b44-e2a7-4791-8590-69fc681ca98b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:11.447964 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f82b44-e2a7-4791-8590-69fc681ca98b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:11.459300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 447/873] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:11:11 2022] GET /identity/v3/role_assignments?user.id=143798e5887b49338f0000de5b55be68&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:12.930966 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d36b7-0e9b-4547-a5f1-3ed12197b083 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:12.931490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d36b7-0e9b-4547-a5f1-3ed12197b083 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:12.931601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d36b7-0e9b-4547-a5f1-3ed12197b083 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:12.933144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 427/874] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:12.938728 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33664688-7f11-46dc-9e21-f0c348d1e085 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:12.939224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33664688-7f11-46dc-9e21-f0c348d1e085 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:12.939307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33664688-7f11-46dc-9e21-f0c348d1e085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:12.957326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-33664688-7f11-46dc-9e21-f0c348d1e085 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:12.958514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-33664688-7f11-46dc-9e21-f0c348d1e085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:12.987474 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:13.010919 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee07bd3-c329-426c-a3bc-5aa169e70dc7 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:13.011249 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee07bd3-c329-426c-a3bc-5aa169e70dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:13.011483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee07bd3-c329-426c-a3bc-5aa169e70dc7 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:13.013085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 428/875] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:13.018336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b4545-e8d7-439b-a485-ae472ca80e07 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:13.018624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b4545-e8d7-439b-a485-ae472ca80e07 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:13.018905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b4545-e8d7-439b-a485-ae472ca80e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:13.037887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-1c4b4545-e8d7-439b-a485-ae472ca80e07 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:13.039109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1c4b4545-e8d7-439b-a485-ae472ca80e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:13.039295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 448/876] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:13.064634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33664688-7f11-46dc-9e21-f0c348d1e085 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:13.181514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33664688-7f11-46dc-9e21-f0c348d1e085 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:13.224680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c805f-e547-487d-9b1b-3a0ddab99157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:13.225903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c805f-e547-487d-9b1b-3a0ddab99157 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:13.226397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c805f-e547-487d-9b1b-3a0ddab99157 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:13.226906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c805f-e547-487d-9b1b-3a0ddab99157 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:13.239325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c805f-e547-487d-9b1b-3a0ddab99157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-c06c805f-e547-487d-9b1b-3a0ddab99157 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:13.247987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:13.248928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:13.250102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:13.250102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:13.250102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:13.250102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:13.250102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:13.250102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:13.250102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:13.250102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:13.250102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:13.250102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:13.250102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 16:11:13.250102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:13.257278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 449/877] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Jul 12 16:11:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:13.258372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c805f-e547-487d-9b1b-3a0ddab99157 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:13.273135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 429/878] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:13 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:13.289648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b4545-e8d7-439b-a485-ae472ca80e07 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:13.292486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:13.376473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c805f-e547-487d-9b1b-3a0ddab99157 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:13.391636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:13.409240 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b4545-e8d7-439b-a485-ae472ca80e07 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:13.412882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd651483-a52a-494d-bb57-fcdf11dbea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:13.413599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd651483-a52a-494d-bb57-fcdf11dbea78 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:13.413885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd651483-a52a-494d-bb57-fcdf11dbea78 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:13.414163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd651483-a52a-494d-bb57-fcdf11dbea78 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:13.414916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd651483-a52a-494d-bb57-fcdf11dbea78 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:13.415227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd651483-a52a-494d-bb57-fcdf11dbea78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:13.416613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd651483-a52a-494d-bb57-fcdf11dbea78 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:13.430013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 450/879] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 16:11:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:13.430013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31ebef-6abc-406c-abf4-66b700e45972 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:13.430013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31ebef-6abc-406c-abf4-66b700e45972 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:13.430013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31ebef-6abc-406c-abf4-66b700e45972 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:13.430013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 451/880] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:13.433311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31ebef-6abc-406c-abf4-66b700e45972 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:13.453879 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79c0c8-a92c-4187-bb51-307cd5c911a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:13.454618 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79c0c8-a92c-4187-bb51-307cd5c911a3 None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:13.454905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79c0c8-a92c-4187-bb51-307cd5c911a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:13.455182 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79c0c8-a92c-4187-bb51-307cd5c911a3 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:13.456579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79c0c8-a92c-4187-bb51-307cd5c911a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:13.458071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79c0c8-a92c-4187-bb51-307cd5c911a3 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:13.526889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:13.542562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31ebef-6abc-406c-abf4-66b700e45972 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:13.565494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 430/881] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:11:13 2022] POST /identity/v3/services => generated 269 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:11:13.566764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5f59-6de8-407e-829d-30aced44b6ac None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:13.567069 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5f59-6de8-407e-829d-30aced44b6ac None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:13.567332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5f59-6de8-407e-829d-30aced44b6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:13.582702 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17513a57-23ca-4979-991d-b960e9b9533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:13.583580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17513a57-23ca-4979-991d-b960e9b9533d None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:13.583868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17513a57-23ca-4979-991d-b960e9b9533d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:13.584196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17513a57-23ca-4979-991d-b960e9b9533d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:13.591463 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-531d5f59-6de8-407e-829d-30aced44b6ac None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:13.593620 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-531d5f59-6de8-407e-829d-30aced44b6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:13.597008 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17513a57-23ca-4979-991d-b960e9b9533d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:13.598621 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17513a57-23ca-4979-991d-b960e9b9533d None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-17513a57-23ca-4979-991d-b960e9b9533d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:13.618479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:13.619516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:13.620538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:13.620538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:13.620538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:13.620538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:13.620779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 452/882] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:13.623404 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9bc9c-314b-47a5-a3c4-b8c59b3cd477 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:13.623921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9bc9c-314b-47a5-a3c4-b8c59b3cd477 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:13.624421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9bc9c-314b-47a5-a3c4-b8c59b3cd477 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:13.627529 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 453/883] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:13.628974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9bc9c-314b-47a5-a3c4-b8c59b3cd477 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:13.689225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 431/884] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:13.689225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df6ffc-3e46-4e95-84a7-6efa0eb1c4d6 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:13.689225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df6ffc-3e46-4e95-84a7-6efa0eb1c4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:13.689225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df6ffc-3e46-4e95-84a7-6efa0eb1c4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:13.706609 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-20df6ffc-3e46-4e95-84a7-6efa0eb1c4d6 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:13.707844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-20df6ffc-3e46-4e95-84a7-6efa0eb1c4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:13.750858 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9bc9c-314b-47a5-a3c4-b8c59b3cd477 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:13.780159 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 432/885] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:13.781075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df6ffc-3e46-4e95-84a7-6efa0eb1c4d6 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:13.784859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:13.791345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c18951-82f6-46f9-9a23-6b154ff44cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:13.792262 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18951-82f6-46f9-9a23-6b154ff44cbd None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:13.792718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18951-82f6-46f9-9a23-6b154ff44cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:13.797170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18951-82f6-46f9-9a23-6b154ff44cbd None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:13.797170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c18951-82f6-46f9-9a23-6b154ff44cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:13.797170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c18951-82f6-46f9-9a23-6b154ff44cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:13.797170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c18951-82f6-46f9-9a23-6b154ff44cbd None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:13.797508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:13.808386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 454/886] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:13.809614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c18951-82f6-46f9-9a23-6b154ff44cbd None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:13.887712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df6ffc-3e46-4e95-84a7-6efa0eb1c4d6 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:13.922331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c18951-82f6-46f9-9a23-6b154ff44cbd None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:13.923716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d077197-10f7-43aa-b539-59625d682368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:13.924560 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d077197-10f7-43aa-b539-59625d682368 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:13.924844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d077197-10f7-43aa-b539-59625d682368 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:13.925139 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d077197-10f7-43aa-b539-59625d682368 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:13.925809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d077197-10f7-43aa-b539-59625d682368 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:13.927156 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d077197-10f7-43aa-b539-59625d682368 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-2d077197-10f7-43aa-b539-59625d682368 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:13.939395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:13.941829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:13.942896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 433/887] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:11:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:13.944008 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d077197-10f7-43aa-b539-59625d682368 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:13.965530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd301d52-b63e-4773-bc48-8b73264c3984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:13.966616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301d52-b63e-4773-bc48-8b73264c3984 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:13.966937 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301d52-b63e-4773-bc48-8b73264c3984 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:13.967329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301d52-b63e-4773-bc48-8b73264c3984 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:13.968306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd301d52-b63e-4773-bc48-8b73264c3984 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:13.970203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd301d52-b63e-4773-bc48-8b73264c3984 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-fd301d52-b63e-4773-bc48-8b73264c3984 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:13.983803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:13.984800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:13.985684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 455/888] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 16:11:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:13.986502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd301d52-b63e-4773-bc48-8b73264c3984 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:14.015830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:14.053849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d077197-10f7-43aa-b539-59625d682368 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:14.054584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:14.092317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619d23b-a07c-43da-98cf-52b015dd9029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:14.093624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619d23b-a07c-43da-98cf-52b015dd9029 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:14.094178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619d23b-a07c-43da-98cf-52b015dd9029 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:14.094634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619d23b-a07c-43da-98cf-52b015dd9029 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:14.099950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd301d52-b63e-4773-bc48-8b73264c3984 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:14.103012 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619d23b-a07c-43da-98cf-52b015dd9029 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:14.104608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619d23b-a07c-43da-98cf-52b015dd9029 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-8619d23b-a07c-43da-98cf-52b015dd9029 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:11:14.121049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:14.122073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:14.128747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:14.128747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:14.128747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:11:14.128747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:11:14.128747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:11:14.128747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:11:14.128747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:11:14.128747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:11:14.128747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 16:11:14.128747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:14.128747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 434/889] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 16:11:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:14.128747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619d23b-a07c-43da-98cf-52b015dd9029 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:14.143150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aeb63-4e72-4e24-8088-ec59f85b97fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:14.144399 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aeb63-4e72-4e24-8088-ec59f85b97fb None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:14.144684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aeb63-4e72-4e24-8088-ec59f85b97fb None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:14.144961 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aeb63-4e72-4e24-8088-ec59f85b97fb None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:14.145718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50aeb63-4e72-4e24-8088-ec59f85b97fb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:14.146032 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50aeb63-4e72-4e24-8088-ec59f85b97fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:14.147407 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50aeb63-4e72-4e24-8088-ec59f85b97fb None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:14.152207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 456/890] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:11:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:14.152982 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aeb63-4e72-4e24-8088-ec59f85b97fb None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:14.238131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619d23b-a07c-43da-98cf-52b015dd9029 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:14.254688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aeb63-4e72-4e24-8088-ec59f85b97fb None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:14.265816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:14.273771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee974201-ed42-4b14-827e-00a1d11698a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:14.274541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee974201-ed42-4b14-827e-00a1d11698a3 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:14.274840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee974201-ed42-4b14-827e-00a1d11698a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:14.280731 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee974201-ed42-4b14-827e-00a1d11698a3 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:14.280731 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee974201-ed42-4b14-827e-00a1d11698a3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:14.280731 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee974201-ed42-4b14-827e-00a1d11698a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:14.281025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:14.281147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee974201-ed42-4b14-827e-00a1d11698a3 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:14.283198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 435/891] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 16:11:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:14.284025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee974201-ed42-4b14-827e-00a1d11698a3 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:14.293531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d87e4-a9ec-4eb0-86c5-167e8eafa4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:14.294269 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d87e4-a9ec-4eb0-86c5-167e8eafa4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:14.294550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d87e4-a9ec-4eb0-86c5-167e8eafa4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:14.294830 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d87e4-a9ec-4eb0-86c5-167e8eafa4e6 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:14.295724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d87e4-a9ec-4eb0-86c5-167e8eafa4e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:14.296037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d87e4-a9ec-4eb0-86c5-167e8eafa4e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:14.297488 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d87e4-a9ec-4eb0-86c5-167e8eafa4e6 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:14.318023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 457/892] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Jul 12 16:11:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:14.318678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d87e4-a9ec-4eb0-86c5-167e8eafa4e6 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:14.394963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee974201-ed42-4b14-827e-00a1d11698a3 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:14.423424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d87e4-a9ec-4eb0-86c5-167e8eafa4e6 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:14.432396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9f2b1-f05a-4e88-97c9-b968a94b7e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:14.433209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9f2b1-f05a-4e88-97c9-b968a94b7e84 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:14.433499 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9f2b1-f05a-4e88-97c9-b968a94b7e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:14.433777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9f2b1-f05a-4e88-97c9-b968a94b7e84 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:14.434588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9f2b1-f05a-4e88-97c9-b968a94b7e84 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:14.434900 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9f2b1-f05a-4e88-97c9-b968a94b7e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:14.436310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9f2b1-f05a-4e88-97c9-b968a94b7e84 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:14.447026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 436/893] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:11:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:14.447026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9f2b1-f05a-4e88-97c9-b968a94b7e84 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:14.470830 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afdc9be-8119-437c-8ade-bfa916481ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:14.471874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdc9be-8119-437c-8ade-bfa916481ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:14.472424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdc9be-8119-437c-8ade-bfa916481ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:14.472712 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdc9be-8119-437c-8ade-bfa916481ed4 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:14.473795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afdc9be-8119-437c-8ade-bfa916481ed4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:14.474415 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afdc9be-8119-437c-8ade-bfa916481ed4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:14.476073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afdc9be-8119-437c-8ade-bfa916481ed4 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:14.481727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 458/894] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 16:11:14 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:14.482356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afdc9be-8119-437c-8ade-bfa916481ed4 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:14.513669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:14.546631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:14.578113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9f2b1-f05a-4e88-97c9-b968a94b7e84 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:14.623347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afdc9be-8119-437c-8ade-bfa916481ed4 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:14.628195 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91869f5-748a-479b-98ba-2bf0f5a3b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:14.629288 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91869f5-748a-479b-98ba-2bf0f5a3b6ba None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:14.629795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91869f5-748a-479b-98ba-2bf0f5a3b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:14.630274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91869f5-748a-479b-98ba-2bf0f5a3b6ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:14.669048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16c91d-dd89-4f7b-a5b2-b36d68c6f419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:14.669772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c91d-dd89-4f7b-a5b2-b36d68c6f419 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:14.670053 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c91d-dd89-4f7b-a5b2-b36d68c6f419 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:14.670320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c91d-dd89-4f7b-a5b2-b36d68c6f419 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:14.671122 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16c91d-dd89-4f7b-a5b2-b36d68c6f419 None admin] RBAC: Adding query filter params (interface=public, service_id=41181358c14843ca9d9755a7ebc7b3b7, region_id=RegionOne) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:14.671437 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16c91d-dd89-4f7b-a5b2-b36d68c6f419 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:14.672810 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16c91d-dd89-4f7b-a5b2-b36d68c6f419 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:14.688243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 459/895] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 16:11:14 2022] GET /identity/v3/endpoints?service_id=41181358c14843ca9d9755a7ebc7b3b7&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:14.689427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16c91d-dd89-4f7b-a5b2-b36d68c6f419 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:14.709232 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91869f5-748a-479b-98ba-2bf0f5a3b6ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:14.711050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91869f5-748a-479b-98ba-2bf0f5a3b6ba None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:14.773251 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:14.811865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16c91d-dd89-4f7b-a5b2-b36d68c6f419 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:14.821850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:14.824537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 437/896] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:11:14 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:11:14.825584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91869f5-748a-479b-98ba-2bf0f5a3b6ba None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:14.849087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5f534-6ee2-4099-af5c-ecb2f1c5992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:14.850152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5f534-6ee2-4099-af5c-ecb2f1c5992d None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:14.850661 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5f534-6ee2-4099-af5c-ecb2f1c5992d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:14.851120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5f534-6ee2-4099-af5c-ecb2f1c5992d None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:14.851994 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5f534-6ee2-4099-af5c-ecb2f1c5992d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:14.853587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5f534-6ee2-4099-af5c-ecb2f1c5992d None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:14.860314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 460/897] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 16:11:14 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:11:14.942312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91869f5-748a-479b-98ba-2bf0f5a3b6ba None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:14.981748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7566a18-75d2-47ef-a1db-57391bf4a48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:14.982875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7566a18-75d2-47ef-a1db-57391bf4a48a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:14.983345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7566a18-75d2-47ef-a1db-57391bf4a48a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:14.983805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7566a18-75d2-47ef-a1db-57391bf4a48a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:14.995663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7566a18-75d2-47ef-a1db-57391bf4a48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:14.997467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7566a18-75d2-47ef-a1db-57391bf4a48a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-b7566a18-75d2-47ef-a1db-57391bf4a48a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:15.016887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:15.017984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:15.019477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:15.019477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:15.019477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:15.019477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:15.021611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 438/898] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:15.030356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5f534-6ee2-4099-af5c-ecb2f1c5992d None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:15.144632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5f534-6ee2-4099-af5c-ecb2f1c5992d None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:15.180891 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110eef05-bf0f-44e1-8b62-7f857b6db997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:15.181889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eef05-bf0f-44e1-8b62-7f857b6db997 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:15.182389 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eef05-bf0f-44e1-8b62-7f857b6db997 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:15.182851 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eef05-bf0f-44e1-8b62-7f857b6db997 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:15.183761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110eef05-bf0f-44e1-8b62-7f857b6db997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:15.184266 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110eef05-bf0f-44e1-8b62-7f857b6db997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:15.185853 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110eef05-bf0f-44e1-8b62-7f857b6db997 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:15.200144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 461/899] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:15.205319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7566a18-75d2-47ef-a1db-57391bf4a48a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:15.216397 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:15.311890 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7566a18-75d2-47ef-a1db-57391bf4a48a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:15.347740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1bac-7714-4b5a-badb-1027e9e09770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:15.348574 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1bac-7714-4b5a-badb-1027e9e09770 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:15.348904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1bac-7714-4b5a-badb-1027e9e09770 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:15.349213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1bac-7714-4b5a-badb-1027e9e09770 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:15.355971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c1bac-7714-4b5a-badb-1027e9e09770 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:15.357447 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c1bac-7714-4b5a-badb-1027e9e09770 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-e20c1bac-7714-4b5a-badb-1027e9e09770 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:11:15.371707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:15.374116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:15.375975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:11:15.375975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:11:15.375975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:11:15.375975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:11:15.375975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:11:15.375975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:11:15.375975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:15.375975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:15.375975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 439/900] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:15.379451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110eef05-bf0f-44e1-8b62-7f857b6db997 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:15.419733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:15.496209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110eef05-bf0f-44e1-8b62-7f857b6db997 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:15.532657 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf6281-5dca-4793-98e8-7b9d1a297e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:15.533353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf6281-5dca-4793-98e8-7b9d1a297e47 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:15.534276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf6281-5dca-4793-98e8-7b9d1a297e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:15.534605 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf6281-5dca-4793-98e8-7b9d1a297e47 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:15.535402 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf6281-5dca-4793-98e8-7b9d1a297e47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:15.535715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf6281-5dca-4793-98e8-7b9d1a297e47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:15.537172 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf6281-5dca-4793-98e8-7b9d1a297e47 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:15.550261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 462/901] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:11:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:15.558262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1bac-7714-4b5a-badb-1027e9e09770 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:15.626156 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:15.651940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f78d97-470a-470c-8a6b-e02bb094f1a4 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:15.652625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f78d97-470a-470c-8a6b-e02bb094f1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:15.653158 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f78d97-470a-470c-8a6b-e02bb094f1a4 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:15.654992 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 463/902] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:11:15.660789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4940bd7-ac71-4220-a827-57d1824f8939 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:15.661374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4940bd7-ac71-4220-a827-57d1824f8939 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:15.661856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4940bd7-ac71-4220-a827-57d1824f8939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:15.661994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1bac-7714-4b5a-badb-1027e9e09770 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:15.682050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-b4940bd7-ac71-4220-a827-57d1824f8939 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:15.683673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b4940bd7-ac71-4220-a827-57d1824f8939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:15.704307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a99310-7a77-4c25-97de-e0d1cee997cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:15.704976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a99310-7a77-4c25-97de-e0d1cee997cf None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:15.705321 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a99310-7a77-4c25-97de-e0d1cee997cf None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:15.706367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a99310-7a77-4c25-97de-e0d1cee997cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:15.707220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a99310-7a77-4c25-97de-e0d1cee997cf None admin] RBAC: Adding query filter params (role.id=d0229fddd2ba4c12ac455b83d2316347, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=cdf13cc74cf94d9a87613fe1e102ac99) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:15.707534 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a99310-7a77-4c25-97de-e0d1cee997cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:15.709413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a99310-7a77-4c25-97de-e0d1cee997cf None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:15.720063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 440/903] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:11:15 2022] GET /identity/v3/role_assignments?user.id=cdf13cc74cf94d9a87613fe1e102ac99&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=d0229fddd2ba4c12ac455b83d2316347 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:15.776302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 464/904] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:15.800433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a99310-7a77-4c25-97de-e0d1cee997cf None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:15.910661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a99310-7a77-4c25-97de-e0d1cee997cf None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:15.942078 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:15.947435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480b0c6-9dcb-4b7e-9aee-98592705eadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:15.948952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480b0c6-9dcb-4b7e-9aee-98592705eadd None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:15.949480 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480b0c6-9dcb-4b7e-9aee-98592705eadd None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:15.949959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480b0c6-9dcb-4b7e-9aee-98592705eadd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:15.950806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480b0c6-9dcb-4b7e-9aee-98592705eadd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:15.952379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480b0c6-9dcb-4b7e-9aee-98592705eadd None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-f480b0c6-9dcb-4b7e-9aee-98592705eadd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:15.965018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:15.966028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 16:11:15.966898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:15.969772 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 441/905] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Jul 12 16:11:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:15.977609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4940bd7-ac71-4220-a827-57d1824f8939 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:16.001098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:16.081578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4940bd7-ac71-4220-a827-57d1824f8939 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:16.122134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3266e76-bf38-41ff-874f-c15e28f238c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:16.123140 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3266e76-bf38-41ff-874f-c15e28f238c1 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:16.123616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3266e76-bf38-41ff-874f-c15e28f238c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:16.124065 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3266e76-bf38-41ff-874f-c15e28f238c1 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:16.124949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3266e76-bf38-41ff-874f-c15e28f238c1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:16.125452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3266e76-bf38-41ff-874f-c15e28f238c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:16.126989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3266e76-bf38-41ff-874f-c15e28f238c1 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:16.132549 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 465/906] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 16:11:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:16.138466 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480b0c6-9dcb-4b7e-9aee-98592705eadd None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:16.247324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480b0c6-9dcb-4b7e-9aee-98592705eadd None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:16.282539 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f0a2f-c92d-4b5b-99bd-de4a08b32aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:16.283502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f0a2f-c92d-4b5b-99bd-de4a08b32aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:16.284520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f0a2f-c92d-4b5b-99bd-de4a08b32aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:16.284969 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f0a2f-c92d-4b5b-99bd-de4a08b32aa7 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:16.285879 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f0a2f-c92d-4b5b-99bd-de4a08b32aa7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:16.286361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f0a2f-c92d-4b5b-99bd-de4a08b32aa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:16.287897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f0a2f-c92d-4b5b-99bd-de4a08b32aa7 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:16.293880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 442/907] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 16:11:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:16.300483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3266e76-bf38-41ff-874f-c15e28f238c1 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:16.387778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:16.403432 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3266e76-bf38-41ff-874f-c15e28f238c1 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:16.440459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c796b-a05a-462a-b4fb-dc7263388fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:16.441664 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c796b-a05a-462a-b4fb-dc7263388fbf None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:16.442132 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c796b-a05a-462a-b4fb-dc7263388fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:16.442580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c796b-a05a-462a-b4fb-dc7263388fbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:16.443544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c796b-a05a-462a-b4fb-dc7263388fbf None admin] RBAC: Adding query filter params (interface=public, service_id=f868926b62c847cc9b09915ceb3ca600, region_id=RegionOne) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:16.444030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c796b-a05a-462a-b4fb-dc7263388fbf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:16.445621 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c796b-a05a-462a-b4fb-dc7263388fbf None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:16.452172 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 466/908] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 16:11:16 2022] GET /identity/v3/endpoints?service_id=f868926b62c847cc9b09915ceb3ca600&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:16.458403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f0a2f-c92d-4b5b-99bd-de4a08b32aa7 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:16.522563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:16.564203 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f0a2f-c92d-4b5b-99bd-de4a08b32aa7 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:16.599713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326ff68-7db3-49d0-bef8-0b0cd6e351b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:16.600381 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326ff68-7db3-49d0-bef8-0b0cd6e351b1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:16.600664 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326ff68-7db3-49d0-bef8-0b0cd6e351b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:16.600981 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326ff68-7db3-49d0-bef8-0b0cd6e351b1 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:16.601700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326ff68-7db3-49d0-bef8-0b0cd6e351b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:16.603104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326ff68-7db3-49d0-bef8-0b0cd6e351b1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:16.609561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 443/909] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 16:11:16 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:11:16.633928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de143343-deec-4e01-8b28-14db1e373b9b None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:16.634250 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de143343-deec-4e01-8b28-14db1e373b9b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:16.634494 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de143343-deec-4e01-8b28-14db1e373b9b None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:16.637452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 467/910] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:16.642229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc574b-d46b-403a-8f3a-febcfc519529 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:16.642517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc574b-d46b-403a-8f3a-febcfc519529 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:16.642804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc574b-d46b-403a-8f3a-febcfc519529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:16.660923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-43fc574b-d46b-403a-8f3a-febcfc519529 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:16.662338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-43fc574b-d46b-403a-8f3a-febcfc519529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:16.743272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 444/911] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:16.766162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de143343-deec-4e01-8b28-14db1e373b9b None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:16.878128 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de143343-deec-4e01-8b28-14db1e373b9b None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:16.916304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9e980-8190-47a3-8051-718366b225d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:16.917351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9e980-8190-47a3-8051-718366b225d4 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:16.917823 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9e980-8190-47a3-8051-718366b225d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:16.918290 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9e980-8190-47a3-8051-718366b225d4 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:16.919231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9e980-8190-47a3-8051-718366b225d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:16.920788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9e980-8190-47a3-8051-718366b225d4 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:17.005264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 468/912] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:11:16 2022] POST /identity/v3/services => generated 241 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:11:17.074670 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903e6bd-58d4-441a-8d95-578c29328f7f None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:17.075202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903e6bd-58d4-441a-8d95-578c29328f7f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:17.075342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903e6bd-58d4-441a-8d95-578c29328f7f None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:17.076925 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 445/913] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:17.083369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65544c-1cbd-4ef5-94a1-59490e3e9852 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:17.084205 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65544c-1cbd-4ef5-94a1-59490e3e9852 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:17.084659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65544c-1cbd-4ef5-94a1-59490e3e9852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:17.103617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-4c65544c-1cbd-4ef5-94a1-59490e3e9852 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:17.105256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4c65544c-1cbd-4ef5-94a1-59490e3e9852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:17.109397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:17.188769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 469/914] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:17.212320 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903e6bd-58d4-441a-8d95-578c29328f7f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:17.271384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:17.320430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903e6bd-58d4-441a-8d95-578c29328f7f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:17.357415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29273481-e077-4661-af15-653588359254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:17.358544 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29273481-e077-4661-af15-653588359254 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:17.359005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29273481-e077-4661-af15-653588359254 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:17.359456 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29273481-e077-4661-af15-653588359254 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:17.360275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29273481-e077-4661-af15-653588359254 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:17.361842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29273481-e077-4661-af15-653588359254 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-29273481-e077-4661-af15-653588359254 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:17.374070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:17.375100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 16:11:17.375950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:17.378744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 446/915] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:11:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:17.385212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65544c-1cbd-4ef5-94a1-59490e3e9852 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:17.500755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65544c-1cbd-4ef5-94a1-59490e3e9852 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:17.540710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a008cd-4a57-4d85-b454-da1301d20003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:17.541591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a008cd-4a57-4d85-b454-da1301d20003 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:17.541884 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a008cd-4a57-4d85-b454-da1301d20003 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:17.542161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a008cd-4a57-4d85-b454-da1301d20003 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:17.542875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a008cd-4a57-4d85-b454-da1301d20003 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:17.543185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a008cd-4a57-4d85-b454-da1301d20003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:17.544898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a008cd-4a57-4d85-b454-da1301d20003 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:17.546786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:17.550824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 470/916] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:11:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:17.556725 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29273481-e077-4661-af15-653588359254 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:17.669305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29273481-e077-4661-af15-653588359254 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:17.687720 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:17.707700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089296da-cedd-4920-84dc-d0f4332e97b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:17.708462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089296da-cedd-4920-84dc-d0f4332e97b2 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:17.708756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089296da-cedd-4920-84dc-d0f4332e97b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:17.709039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089296da-cedd-4920-84dc-d0f4332e97b2 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:17.709787 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089296da-cedd-4920-84dc-d0f4332e97b2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:17.710100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089296da-cedd-4920-84dc-d0f4332e97b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:17.711461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089296da-cedd-4920-84dc-d0f4332e97b2 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:17.716781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 447/917] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 16:11:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:17.722295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a008cd-4a57-4d85-b454-da1301d20003 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:17.827378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d150dd-71c2-43c3-a952-9a0366336b8d None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:17.827746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d150dd-71c2-43c3-a952-9a0366336b8d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:17.827951 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d150dd-71c2-43c3-a952-9a0366336b8d None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:17.828071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a008cd-4a57-4d85-b454-da1301d20003 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:17.829613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 448/918] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:17.835452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d07f57-4963-4d3d-9d70-f02e8fe566d2 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:17.835733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d07f57-4963-4d3d-9d70-f02e8fe566d2 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:17.836017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d07f57-4963-4d3d-9d70-f02e8fe566d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:17.856429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-46d07f57-4963-4d3d-9d70-f02e8fe566d2 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:17.857794 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-46d07f57-4963-4d3d-9d70-f02e8fe566d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:17.868267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1137e44-4b92-4b9c-990e-671a67956f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:17.869150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1137e44-4b92-4b9c-990e-671a67956f51 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:17.869500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1137e44-4b92-4b9c-990e-671a67956f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:17.869842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1137e44-4b92-4b9c-990e-671a67956f51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:17.870772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1137e44-4b92-4b9c-990e-671a67956f51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:17.872228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1137e44-4b92-4b9c-990e-671a67956f51 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:17.930490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 449/919] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:17.952759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d07f57-4963-4d3d-9d70-f02e8fe566d2 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:18.025520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 471/920] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 16:11:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:11:18.065346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d07f57-4963-4d3d-9d70-f02e8fe566d2 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:18.081088 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:18.110758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafca6b-c89a-45d6-82ed-be8ee0a43285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:18.111639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafca6b-c89a-45d6-82ed-be8ee0a43285 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:18.112017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafca6b-c89a-45d6-82ed-be8ee0a43285 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:18.112375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafca6b-c89a-45d6-82ed-be8ee0a43285 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:18.124587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafca6b-c89a-45d6-82ed-be8ee0a43285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-2dafca6b-c89a-45d6-82ed-be8ee0a43285 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:18.133329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:18.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:18.135747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:18.135747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:18.135747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:18.135747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:18.135747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:18.135747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:18.135747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:18.135747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:18.135747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:18.135747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:18.135747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 16:11:18.135747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:18.135747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 450/921] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Jul 12 16:11:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:18.141052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1137e44-4b92-4b9c-990e-671a67956f51 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:18.207866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:18.255180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1137e44-4b92-4b9c-990e-671a67956f51 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:18.291775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab40720-2bc8-4fe5-8670-81ef7d0541e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:18.292458 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab40720-2bc8-4fe5-8670-81ef7d0541e0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:18.292744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab40720-2bc8-4fe5-8670-81ef7d0541e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:18.293018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab40720-2bc8-4fe5-8670-81ef7d0541e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:18.293811 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab40720-2bc8-4fe5-8670-81ef7d0541e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:18.294114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab40720-2bc8-4fe5-8670-81ef7d0541e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:18.295488 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab40720-2bc8-4fe5-8670-81ef7d0541e0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:18.304291 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 472/922] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 16:11:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:18.309998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafca6b-c89a-45d6-82ed-be8ee0a43285 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:18.413248 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafca6b-c89a-45d6-82ed-be8ee0a43285 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:18.454453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f3909-f8d9-47f6-bcd5-a6553bcd5f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:18.456196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f3909-f8d9-47f6-bcd5-a6553bcd5f95 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:18.456704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f3909-f8d9-47f6-bcd5-a6553bcd5f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:18.457212 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f3909-f8d9-47f6-bcd5-a6553bcd5f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:18.469600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f3909-f8d9-47f6-bcd5-a6553bcd5f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:18.471146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f3909-f8d9-47f6-bcd5-a6553bcd5f95 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-462f3909-f8d9-47f6-bcd5-a6553bcd5f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:18.488939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:18.489901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:18.490876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:18.490876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:18.490876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:18.490876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:18.490876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 451/923] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:18.495967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab40720-2bc8-4fe5-8670-81ef7d0541e0 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:18.601995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab40720-2bc8-4fe5-8670-81ef7d0541e0 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:18.620134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:18.637577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a2af7-ffac-43da-ab84-9c95baf49c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:18.648935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a2af7-ffac-43da-ab84-9c95baf49c29 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:18.648935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a2af7-ffac-43da-ab84-9c95baf49c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:18.648935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a2af7-ffac-43da-ab84-9c95baf49c29 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:18.648935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a2af7-ffac-43da-ab84-9c95baf49c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:18.648935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a2af7-ffac-43da-ab84-9c95baf49c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:18.648935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a2af7-ffac-43da-ab84-9c95baf49c29 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:18.654778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 473/924] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:18.660599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f3909-f8d9-47f6-bcd5-a6553bcd5f95 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:18.684328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:18.767753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f3909-f8d9-47f6-bcd5-a6553bcd5f95 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:18.803540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fa9ea-73e8-4e1a-9fbb-495c407f943d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:18.804364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fa9ea-73e8-4e1a-9fbb-495c407f943d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:18.804648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fa9ea-73e8-4e1a-9fbb-495c407f943d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:18.804762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002544-c67e-45f0-b1a0-7f117bc271b4 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:18.804922 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fa9ea-73e8-4e1a-9fbb-495c407f943d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:18.805015 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002544-c67e-45f0-b1a0-7f117bc271b4 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:18.805282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002544-c67e-45f0-b1a0-7f117bc271b4 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:18.806887 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 474/925] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:11:18.811671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd9b2a-831f-417a-b6f2-12259ea4c728 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:18.811957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd9b2a-831f-417a-b6f2-12259ea4c728 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:18.812234 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd9b2a-831f-417a-b6f2-12259ea4c728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:18.813208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fa9ea-73e8-4e1a-9fbb-495c407f943d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:18.815796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fa9ea-73e8-4e1a-9fbb-495c407f943d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:18.829532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-dcfd9b2a-831f-417a-b6f2-12259ea4c728 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:18.830739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-dcfd9b2a-831f-417a-b6f2-12259ea4c728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-244fa9ea-73e8-4e1a-9fbb-495c407f943d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:11:18.832991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:18.833950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:18.834903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:18.834903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:18.834903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:11:18.834903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:11:18.834903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:11:18.834903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:11:18.834903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:11:18.834903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:11:18.834903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 16:11:18.834903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:18.835468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 452/926] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 16:11:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:18.841913 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fa9ea-73e8-4e1a-9fbb-495c407f943d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:18.919817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 475/927] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:18.946300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:18.946490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd9b2a-831f-417a-b6f2-12259ea4c728 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:18.969552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fa9ea-73e8-4e1a-9fbb-495c407f943d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:19.015437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05f877-e29e-4123-b6f1-3b5d08644012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:19.016739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05f877-e29e-4123-b6f1-3b5d08644012 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:19.017270 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05f877-e29e-4123-b6f1-3b5d08644012 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:19.018149 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05f877-e29e-4123-b6f1-3b5d08644012 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:19.019185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05f877-e29e-4123-b6f1-3b5d08644012 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:19.019684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05f877-e29e-4123-b6f1-3b5d08644012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:19.021822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05f877-e29e-4123-b6f1-3b5d08644012 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:19.046296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 453/928] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Jul 12 16:11:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:19.057240 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05f877-e29e-4123-b6f1-3b5d08644012 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:19.071567 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd9b2a-831f-417a-b6f2-12259ea4c728 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:19.081144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:19.107674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02c365-6b85-4652-83e7-e344e9abe89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:19.108619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02c365-6b85-4652-83e7-e344e9abe89a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:19.109022 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02c365-6b85-4652-83e7-e344e9abe89a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:19.109415 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02c365-6b85-4652-83e7-e344e9abe89a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:19.110161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02c365-6b85-4652-83e7-e344e9abe89a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:19.111621 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02c365-6b85-4652-83e7-e344e9abe89a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-3c02c365-6b85-4652-83e7-e344e9abe89a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:19.125070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:19.126280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:19.127167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 476/929] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Jul 12 16:11:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:19.132896 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02c365-6b85-4652-83e7-e344e9abe89a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:19.173565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05f877-e29e-4123-b6f1-3b5d08644012 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:19.212886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29dd90-6bd3-41f8-92a7-1bb2b93afbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:19.214110 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29dd90-6bd3-41f8-92a7-1bb2b93afbba None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:19.214606 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29dd90-6bd3-41f8-92a7-1bb2b93afbba None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:19.215125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29dd90-6bd3-41f8-92a7-1bb2b93afbba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:19.222619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:19.227123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29dd90-6bd3-41f8-92a7-1bb2b93afbba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:19.228852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29dd90-6bd3-41f8-92a7-1bb2b93afbba None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:19.233086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02c365-6b85-4652-83e7-e344e9abe89a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-ce29dd90-6bd3-41f8-92a7-1bb2b93afbba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:19.248411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:19.249462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:19.250605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:19.250605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:19.250605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:19.250605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:19.252528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 454/930] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:19.254010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46350a-ccd3-45e9-a4d3-38eb0a68848d None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:19.254295 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46350a-ccd3-45e9-a4d3-38eb0a68848d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:19.254572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46350a-ccd3-45e9-a4d3-38eb0a68848d None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:19.255965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 455/931] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:19.257930 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46350a-ccd3-45e9-a4d3-38eb0a68848d None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:19.272562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221bf1f-7fee-4e58-bcd6-3b6aead80cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:19.273269 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221bf1f-7fee-4e58-bcd6-3b6aead80cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:19.273542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221bf1f-7fee-4e58-bcd6-3b6aead80cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:19.273877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221bf1f-7fee-4e58-bcd6-3b6aead80cc5 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:19.274801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221bf1f-7fee-4e58-bcd6-3b6aead80cc5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:19.274801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221bf1f-7fee-4e58-bcd6-3b6aead80cc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:19.276162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221bf1f-7fee-4e58-bcd6-3b6aead80cc5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:19.281632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 477/932] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 16:11:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:19.287712 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c02b-1902-4ef9-b9f0-8ba233d369e8 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:19.288238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c02b-1902-4ef9-b9f0-8ba233d369e8 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:19.288346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c02b-1902-4ef9-b9f0-8ba233d369e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:19.306291 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-9fc2c02b-1902-4ef9-b9f0-8ba233d369e8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:19.307464 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9fc2c02b-1902-4ef9-b9f0-8ba233d369e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:19.340100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:19.370271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46350a-ccd3-45e9-a4d3-38eb0a68848d None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:19.383700 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 478/933] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:19.384812 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2c02b-1902-4ef9-b9f0-8ba233d369e8 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:19.413036 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70a5c6-7654-43b2-b384-9428311f2c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:19.413738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70a5c6-7654-43b2-b384-9428311f2c5c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:19.414022 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70a5c6-7654-43b2-b384-9428311f2c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:19.414307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70a5c6-7654-43b2-b384-9428311f2c5c None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:19.415037 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70a5c6-7654-43b2-b384-9428311f2c5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:19.415346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70a5c6-7654-43b2-b384-9428311f2c5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:19.416704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70a5c6-7654-43b2-b384-9428311f2c5c None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:19.429851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 456/934] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:19.434083 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70a5c6-7654-43b2-b384-9428311f2c5c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:19.486167 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:19.514654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2c02b-1902-4ef9-b9f0-8ba233d369e8 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:19.536059 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70a5c6-7654-43b2-b384-9428311f2c5c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:19.551351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff066b-2074-4abc-9dbb-f1f7e40f4934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:19.552019 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff066b-2074-4abc-9dbb-f1f7e40f4934 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:19.552309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff066b-2074-4abc-9dbb-f1f7e40f4934 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:19.552585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff066b-2074-4abc-9dbb-f1f7e40f4934 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:19.553318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff066b-2074-4abc-9dbb-f1f7e40f4934 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:19.553626 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff066b-2074-4abc-9dbb-f1f7e40f4934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:19.554987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff066b-2074-4abc-9dbb-f1f7e40f4934 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:19.564438 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 479/935] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 16:11:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:19.564438 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff066b-2074-4abc-9dbb-f1f7e40f4934 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:19.576433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417fb90-0add-4082-a9a7-d0f87bcaefa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:19.577351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417fb90-0add-4082-a9a7-d0f87bcaefa4 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:19.577690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417fb90-0add-4082-a9a7-d0f87bcaefa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:19.578033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417fb90-0add-4082-a9a7-d0f87bcaefa4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:19.578694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417fb90-0add-4082-a9a7-d0f87bcaefa4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:19.580036 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417fb90-0add-4082-a9a7-d0f87bcaefa4 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-3417fb90-0add-4082-a9a7-d0f87bcaefa4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:19.592390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:19.593465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:19.594337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 457/936] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 16:11:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:19.595131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417fb90-0add-4082-a9a7-d0f87bcaefa4 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:19.600654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:19.671350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff066b-2074-4abc-9dbb-f1f7e40f4934 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:19.700025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417fb90-0add-4082-a9a7-d0f87bcaefa4 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:19.708475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4649565-94d0-4b1d-9765-bd0482c9e5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:19.709306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4649565-94d0-4b1d-9765-bd0482c9e5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:19.709592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4649565-94d0-4b1d-9765-bd0482c9e5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:19.709869 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4649565-94d0-4b1d-9765-bd0482c9e5e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:19.714831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:19.718669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4649565-94d0-4b1d-9765-bd0482c9e5e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:19.720134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4649565-94d0-4b1d-9765-bd0482c9e5e7 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-e4649565-94d0-4b1d-9765-bd0482c9e5e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:11:19.733990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:19.734947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:19.735838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:11:19.735838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:11:19.735838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:11:19.735838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:11:19.735838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:11:19.735838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:11:19.735838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:19.735838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:19.739401 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40207957-1928-4aae-bc23-1815b37c153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:19.740066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207957-1928-4aae-bc23-1815b37c153b None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:19.740531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 480/937] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:19.740632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207957-1928-4aae-bc23-1815b37c153b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:19.740809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40207957-1928-4aae-bc23-1815b37c153b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:19.741396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4649565-94d0-4b1d-9765-bd0482c9e5e7 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:19.741589 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40207957-1928-4aae-bc23-1815b37c153b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:19.742943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40207957-1928-4aae-bc23-1815b37c153b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:19.831274 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:19.840164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 458/938] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 16:11:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:11:19.841086 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40207957-1928-4aae-bc23-1815b37c153b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:19.845530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4649565-94d0-4b1d-9765-bd0482c9e5e7 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:19.896084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5a6ed-ce93-4ce0-895d-20f586a2d33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:19.897200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5a6ed-ce93-4ce0-895d-20f586a2d33e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:19.897813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5a6ed-ce93-4ce0-895d-20f586a2d33e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:19.898328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5a6ed-ce93-4ce0-895d-20f586a2d33e None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:19.899411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5a6ed-ce93-4ce0-895d-20f586a2d33e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:19.899824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5a6ed-ce93-4ce0-895d-20f586a2d33e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:19.901387 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5a6ed-ce93-4ce0-895d-20f586a2d33e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:19.907910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 481/939] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 16:11:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:19.914772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5a6ed-ce93-4ce0-895d-20f586a2d33e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:19.988304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40207957-1928-4aae-bc23-1815b37c153b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:20.027670 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14ab69-ff32-42fc-ab73-4b6a8d864799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:20.028478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14ab69-ff32-42fc-ab73-4b6a8d864799 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:20.028769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14ab69-ff32-42fc-ab73-4b6a8d864799 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:20.029043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14ab69-ff32-42fc-ab73-4b6a8d864799 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:20.029867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14ab69-ff32-42fc-ab73-4b6a8d864799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:20.030174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14ab69-ff32-42fc-ab73-4b6a8d864799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:20.031610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14ab69-ff32-42fc-ab73-4b6a8d864799 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:20.044995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 459/940] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:11:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:20.050850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14ab69-ff32-42fc-ab73-4b6a8d864799 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:20.058127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5a6ed-ce93-4ce0-895d-20f586a2d33e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:20.084126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:20.110274 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e42c09-4de1-49d1-8817-3b91060d0e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:20.111556 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e42c09-4de1-49d1-8817-3b91060d0e1c None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:20.112248 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e42c09-4de1-49d1-8817-3b91060d0e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:20.113340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e42c09-4de1-49d1-8817-3b91060d0e1c None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:20.115228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e42c09-4de1-49d1-8817-3b91060d0e1c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:20.116284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e42c09-4de1-49d1-8817-3b91060d0e1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:20.118850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e42c09-4de1-49d1-8817-3b91060d0e1c None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:20.126010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 482/941] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 16:11:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:20.132016 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e42c09-4de1-49d1-8817-3b91060d0e1c None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:20.154072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:20.159087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14ab69-ff32-42fc-ab73-4b6a8d864799 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:20.197483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963b2f1-e625-4f55-bb92-6e75b3a93d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:20.198384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963b2f1-e625-4f55-bb92-6e75b3a93d72 None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:20.198671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963b2f1-e625-4f55-bb92-6e75b3a93d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:20.198953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963b2f1-e625-4f55-bb92-6e75b3a93d72 None admin] PATH_INFO: `/v3/projects/2101dde305df44bc90d33b01976e8265/users/cdf13cc74cf94d9a87613fe1e102ac99/roles/d0229fddd2ba4c12ac455b83d2316347` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:20.201983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963b2f1-e625-4f55-bb92-6e75b3a93d72 None admin] RBAC: Authorizing `identity:create_grant(project_id=2101dde305df44bc90d33b01976e8265, user_id=cdf13cc74cf94d9a87613fe1e102ac99, role_id=d0229fddd2ba4c12ac455b83d2316347)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:20.202650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963b2f1-e625-4f55-bb92-6e75b3a93d72 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:20.257706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e42c09-4de1-49d1-8817-3b91060d0e1c None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:20.270636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 460/942] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:11:20 2022] PUT /identity/v3/projects/2101dde305df44bc90d33b01976e8265/users/cdf13cc74cf94d9a87613fe1e102ac99/roles/d0229fddd2ba4c12ac455b83d2316347 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:11:20.285177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f018-895d-4aad-b5b4-66616bd277cb None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:20.285177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f018-895d-4aad-b5b4-66616bd277cb None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:20.285177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f018-895d-4aad-b5b4-66616bd277cb None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:20.287902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 461/943] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:11:20.296964 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3592ca-f169-4e17-a203-384ddb84497b None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:20.297603 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3592ca-f169-4e17-a203-384ddb84497b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:20.298084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3592ca-f169-4e17-a203-384ddb84497b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:20.302542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5e33e-c6b8-43d6-a237-b2d69ef64b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:20.306788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5e33e-c6b8-43d6-a237-b2d69ef64b78 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:20.306788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5e33e-c6b8-43d6-a237-b2d69ef64b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:20.306788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5e33e-c6b8-43d6-a237-b2d69ef64b78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:20.306788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5e33e-c6b8-43d6-a237-b2d69ef64b78 None admin] RBAC: Adding query filter params (interface=public, service_id=11e95cf5a1604f88bc139598509eea92, region_id=RegionOne) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:20.306788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5e33e-c6b8-43d6-a237-b2d69ef64b78 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:20.306788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5e33e-c6b8-43d6-a237-b2d69ef64b78 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:20.312735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 483/944] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 16:11:20 2022] GET /identity/v3/endpoints?service_id=11e95cf5a1604f88bc139598509eea92&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:20.319338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5e33e-c6b8-43d6-a237-b2d69ef64b78 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:20.320346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-9a3592ca-f169-4e17-a203-384ddb84497b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:20.321847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9a3592ca-f169-4e17-a203-384ddb84497b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:20.410696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:20.422433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 462/945] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:20.438255 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5e33e-c6b8-43d6-a237-b2d69ef64b78 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:20.442801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3592ca-f169-4e17-a203-384ddb84497b None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:20.472721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:20.493577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1353db-3e14-4480-a8d2-fcba5d134397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:20.494301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1353db-3e14-4480-a8d2-fcba5d134397 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:20.494592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1353db-3e14-4480-a8d2-fcba5d134397 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:20.494868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1353db-3e14-4480-a8d2-fcba5d134397 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:20.495919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1353db-3e14-4480-a8d2-fcba5d134397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:20.497650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1353db-3e14-4480-a8d2-fcba5d134397 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:20.509796 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 484/946] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 16:11:20 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:11:20.569364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3592ca-f169-4e17-a203-384ddb84497b None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:20.609435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d03bee-34a3-49f8-bc1d-1e3777d183f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:20.610124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d03bee-34a3-49f8-bc1d-1e3777d183f6 None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:20.610413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d03bee-34a3-49f8-bc1d-1e3777d183f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:20.610687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d03bee-34a3-49f8-bc1d-1e3777d183f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:20.611428 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d03bee-34a3-49f8-bc1d-1e3777d183f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:20.613036 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d03bee-34a3-49f8-bc1d-1e3777d183f6 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:20.614543 dv-cinder-797608-56-smb devstack@keystone.service[80379]: WARNING keystone.server.flask.common [None req-c0d03bee-34a3-49f8-bc1d-1e3777d183f6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 16:11:20.662353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.sql.core [None req-c0d03bee-34a3-49f8-bc1d-1e3777d183f6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 16:11:20.662353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 16:11:20.662353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [parameters: {'id': '441fbb89c6804db194c289520220d833', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 16:11:20.662353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80379) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 16:11:20.669917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-c0d03bee-34a3-49f8-bc1d-1e3777d183f6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 441fbb89c6804db194c289520220d833.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 441fbb89c6804db194c289520220d833. Jul 12 16:11:20.669917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:20.669917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 16:11:20.669917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 16:11:20.669917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 16:11:20.669917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 16:11:20.669917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 16:11:20.669917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 16:11:20.669917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 16:11:20.669917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application conn.query(q) Jul 12 16:11:20.669917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 16:11:20.669917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 16:11:20.669917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application result.read() Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 12 16:11:20.670759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application next(self.gen) Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application yield resource Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application next(self.gen) Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise self.value Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application session.commit() Jul 12 16:11:20.671715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self.session.flush() Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application compat.raise_( Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 16:11:20.672617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 16:11:20.674418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application conn.query(q) Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application result.read() Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 16:11:20.675219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [parameters: {'id': '441fbb89c6804db194c289520220d833', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:20.676784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:20.678836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:20.682406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:20.682406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 12 16:11:20.682406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 12 16:11:20.682406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:20.682406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:20.682406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 12 16:11:20.682406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 12 16:11:20.682406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 441fbb89c6804db194c289520220d833. Jul 12 16:11:20.682406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:20.682406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 463/947] 10.222.0.26 () {60 vars in 1140 bytes} [Tue Jul 12 16:11:20 2022] POST /identity/v3/projects => generated 262 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:20.683716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1353db-3e14-4480-a8d2-fcba5d134397 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:20.793423 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1353db-3e14-4480-a8d2-fcba5d134397 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:20.829213 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3c102-0247-4d70-9d1a-96586b99c856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:20.830056 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3c102-0247-4d70-9d1a-96586b99c856 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:20.830360 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3c102-0247-4d70-9d1a-96586b99c856 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:20.831211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3c102-0247-4d70-9d1a-96586b99c856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:20.838125 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3c102-0247-4d70-9d1a-96586b99c856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:20.839580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3c102-0247-4d70-9d1a-96586b99c856 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-f3e3c102-0247-4d70-9d1a-96586b99c856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:11:20.853609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:20.854506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:20.855408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:11:20.855408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:11:20.855408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:11:20.855408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:11:20.855408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:11:20.855408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:11:20.855408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:20.855408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:20.855408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 485/948] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:20.860995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d03bee-34a3-49f8-bc1d-1e3777d183f6 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:20.946774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:20.970647 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d03bee-34a3-49f8-bc1d-1e3777d183f6 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:21.006301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1617b82-6980-4114-9e53-7e31b5b6d647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:21.007005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1617b82-6980-4114-9e53-7e31b5b6d647 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:21.007264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1617b82-6980-4114-9e53-7e31b5b6d647 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:21.007542 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1617b82-6980-4114-9e53-7e31b5b6d647 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:21.011830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1617b82-6980-4114-9e53-7e31b5b6d647 None admin] RBAC: Adding query filter params (name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:21.011830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1617b82-6980-4114-9e53-7e31b5b6d647 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:21.011830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1617b82-6980-4114-9e53-7e31b5b6d647 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:21.031903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 464/949] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 16:11:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:22.061843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c6c51-43b3-4936-af28-54d68eeac436 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:22.062394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c6c51-43b3-4936-af28-54d68eeac436 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:22.062394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c6c51-43b3-4936-af28-54d68eeac436 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:22.064289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 486/950] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:22.070224 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265a5cd-6b4d-4da3-b30f-df5cc5653018 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:22.070616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265a5cd-6b4d-4da3-b30f-df5cc5653018 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:22.070804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265a5cd-6b4d-4da3-b30f-df5cc5653018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:22.088146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a265a5cd-6b4d-4da3-b30f-df5cc5653018 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:22.089747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a265a5cd-6b4d-4da3-b30f-df5cc5653018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:22.165270 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 465/951] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:22.183733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c6c51-43b3-4936-af28-54d68eeac436 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:22.187565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:22.294677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c6c51-43b3-4936-af28-54d68eeac436 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:22.331653 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a76c20-bed0-4f4f-86be-214c28dfe690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:22.332696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a76c20-bed0-4f4f-86be-214c28dfe690 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:22.333149 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a76c20-bed0-4f4f-86be-214c28dfe690 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:22.333594 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a76c20-bed0-4f4f-86be-214c28dfe690 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:22.334396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a76c20-bed0-4f4f-86be-214c28dfe690 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:22.335915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a76c20-bed0-4f4f-86be-214c28dfe690 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-b5a76c20-bed0-4f4f-86be-214c28dfe690 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:22.348335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:22.349866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 16:11:22.350978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:22.353557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 487/952] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:22.361144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265a5cd-6b4d-4da3-b30f-df5cc5653018 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:22.371950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134791c-358c-4088-ba66-0b82ccf1136a None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:22.372238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134791c-358c-4088-ba66-0b82ccf1136a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:22.372517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134791c-358c-4088-ba66-0b82ccf1136a None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:22.374164 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 488/953] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:11:22.379534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0c4c0-b667-4d4b-b207-f0e210d31586 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:22.379823 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0c4c0-b667-4d4b-b207-f0e210d31586 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:22.380111 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0c4c0-b667-4d4b-b207-f0e210d31586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:22.397342 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a3e0c4c0-b667-4d4b-b207-f0e210d31586 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:22.398525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a3e0c4c0-b667-4d4b-b207-f0e210d31586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:22.432659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:22.468368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:22.482538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265a5cd-6b4d-4da3-b30f-df5cc5653018 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:22.485182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 489/954] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:22.500375 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0c4c0-b667-4d4b-b207-f0e210d31586 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:22.524327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d661e-5658-42ca-9ac3-b70308372ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:22.525913 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d661e-5658-42ca-9ac3-b70308372ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:22.526486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d661e-5658-42ca-9ac3-b70308372ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:22.527120 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d661e-5658-42ca-9ac3-b70308372ed7 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:22.528333 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d661e-5658-42ca-9ac3-b70308372ed7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:22.529622 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d661e-5658-42ca-9ac3-b70308372ed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:22.532064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d661e-5658-42ca-9ac3-b70308372ed7 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:22.543890 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 466/955] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 16:11:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:22.545468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d661e-5658-42ca-9ac3-b70308372ed7 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:22.643935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0c4c0-b667-4d4b-b207-f0e210d31586 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:22.679278 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d661e-5658-42ca-9ac3-b70308372ed7 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:22.717381 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:22.719232 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e443c-32c8-4ae3-94a7-1555bfc6ed97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:22.721156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e443c-32c8-4ae3-94a7-1555bfc6ed97 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:22.721689 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e443c-32c8-4ae3-94a7-1555bfc6ed97 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:22.722173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e443c-32c8-4ae3-94a7-1555bfc6ed97 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:22.728603 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50fc94-2c56-4e69-bcf5-0b43524f8d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:22.729321 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50fc94-2c56-4e69-bcf5-0b43524f8d16 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:22.729617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50fc94-2c56-4e69-bcf5-0b43524f8d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:22.729896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50fc94-2c56-4e69-bcf5-0b43524f8d16 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:22.730613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50fc94-2c56-4e69-bcf5-0b43524f8d16 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:22.730923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50fc94-2c56-4e69-bcf5-0b43524f8d16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:22.732291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50fc94-2c56-4e69-bcf5-0b43524f8d16 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:22.737455 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e443c-32c8-4ae3-94a7-1555bfc6ed97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:22.749437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 467/956] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 16:11:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:22.749437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec39b-ddfa-4e0a-b530-7059d94cf765 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:22.749437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec39b-ddfa-4e0a-b530-7059d94cf765 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:22.749437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec39b-ddfa-4e0a-b530-7059d94cf765 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:22.749437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 468/957] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:22.757178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e9bc-9853-4412-b1d6-25dcf4b7a188 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:22.757178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e9bc-9853-4412-b1d6-25dcf4b7a188 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:22.757178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e9bc-9853-4412-b1d6-25dcf4b7a188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-608e443c-32c8-4ae3-94a7-1555bfc6ed97 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:22.758323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:22.759271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:22.760233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:22.760233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:22.760233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:22.760233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:22.760233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:22.760233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:22.760233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:22.760233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:22.760233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:22.760233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:22.760233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 16:11:22.760233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:22.763099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 490/958] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Jul 12 16:11:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:22.770281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e443c-32c8-4ae3-94a7-1555bfc6ed97 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:22.787153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-2fe5e9bc-9853-4412-b1d6-25dcf4b7a188 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:22.788691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2fe5e9bc-9853-4412-b1d6-25dcf4b7a188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:22.881448 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:22.938718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 469/959] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:22.954233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e443c-32c8-4ae3-94a7-1555bfc6ed97 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:22.961348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5e9bc-9853-4412-b1d6-25dcf4b7a188 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:22.999619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab79e31-5cb7-44e8-8040-68367b4e1f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:23.000721 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab79e31-5cb7-44e8-8040-68367b4e1f70 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:23.001258 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab79e31-5cb7-44e8-8040-68367b4e1f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:23.001814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab79e31-5cb7-44e8-8040-68367b4e1f70 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:23.003531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab79e31-5cb7-44e8-8040-68367b4e1f70 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:23.003997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab79e31-5cb7-44e8-8040-68367b4e1f70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:23.006152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab79e31-5cb7-44e8-8040-68367b4e1f70 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:23.017246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 491/960] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 16:11:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:23.025485 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab79e31-5cb7-44e8-8040-68367b4e1f70 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:23.142414 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab79e31-5cb7-44e8-8040-68367b4e1f70 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:23.157294 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5e9bc-9853-4412-b1d6-25dcf4b7a188 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:23.165059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:23.182694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:23.184961 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2b211-fc71-4c40-afbf-7b55ac74eb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:23.185787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2b211-fc71-4c40-afbf-7b55ac74eb5f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:23.186072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2b211-fc71-4c40-afbf-7b55ac74eb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:23.186349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2b211-fc71-4c40-afbf-7b55ac74eb5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:23.196651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb461d-cc81-483b-b3ae-6dc407fcfb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:23.197677 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb461d-cc81-483b-b3ae-6dc407fcfb98 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:23.197858 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2b211-fc71-4c40-afbf-7b55ac74eb5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:23.198279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb461d-cc81-483b-b3ae-6dc407fcfb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:23.198720 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb461d-cc81-483b-b3ae-6dc407fcfb98 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:23.199317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2b211-fc71-4c40-afbf-7b55ac74eb5f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:23.199792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb461d-cc81-483b-b3ae-6dc407fcfb98 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:23.201391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb461d-cc81-483b-b3ae-6dc407fcfb98 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-b9eb461d-cc81-483b-b3ae-6dc407fcfb98 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:23.214540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:23.221716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:23.222599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 470/961] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 16:11:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:23.223432 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afda153-2845-4dfe-a328-49f95a009cdc None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:23.223432 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afda153-2845-4dfe-a328-49f95a009cdc None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:23.223432 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afda153-2845-4dfe-a328-49f95a009cdc None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:23.223432 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 471/962] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-59c2b211-fc71-4c40-afbf-7b55ac74eb5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:23.223690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:23.224507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:23.225449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:23.225449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:23.225449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:23.225449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:23.225449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 492/963] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:23.227430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f12d63-c923-4c1c-989e-4cda60a5c6bd None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:23.227721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f12d63-c923-4c1c-989e-4cda60a5c6bd None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:23.228006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f12d63-c923-4c1c-989e-4cda60a5c6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:23.230000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2b211-fc71-4c40-afbf-7b55ac74eb5f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:23.246917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a5f12d63-c923-4c1c-989e-4cda60a5c6bd None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:23.248104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a5f12d63-c923-4c1c-989e-4cda60a5c6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:23.317451 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 472/964] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:23.318588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f12d63-c923-4c1c-989e-4cda60a5c6bd None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:23.345818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2b211-fc71-4c40-afbf-7b55ac74eb5f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:23.380390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59363c35-357e-4a5a-a822-839a2daff63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:23.381056 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59363c35-357e-4a5a-a822-839a2daff63c None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:23.381369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59363c35-357e-4a5a-a822-839a2daff63c None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:23.381722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59363c35-357e-4a5a-a822-839a2daff63c None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:23.382349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59363c35-357e-4a5a-a822-839a2daff63c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:23.382654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59363c35-357e-4a5a-a822-839a2daff63c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:23.384025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59363c35-357e-4a5a-a822-839a2daff63c None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:23.388771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 493/965] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 16:11:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:23.389572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59363c35-357e-4a5a-a822-839a2daff63c None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:23.425705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:23.431979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f12d63-c923-4c1c-989e-4cda60a5c6bd None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:23.454727 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:23.472703 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220931bc-f3a6-4e80-bc4d-d6bf0b3ed44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:23.472891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220931bc-f3a6-4e80-bc4d-d6bf0b3ed44d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:23.473201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220931bc-f3a6-4e80-bc4d-d6bf0b3ed44d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:23.473483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220931bc-f3a6-4e80-bc4d-d6bf0b3ed44d None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:23.474211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220931bc-f3a6-4e80-bc4d-d6bf0b3ed44d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:23.474523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220931bc-f3a6-4e80-bc4d-d6bf0b3ed44d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:23.475887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220931bc-f3a6-4e80-bc4d-d6bf0b3ed44d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:23.488273 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 473/966] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:23.493514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220931bc-f3a6-4e80-bc4d-d6bf0b3ed44d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:23.506314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59363c35-357e-4a5a-a822-839a2daff63c None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:23.542820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54714120-803e-405c-a618-53964ff7a76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:23.543661 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54714120-803e-405c-a618-53964ff7a76a None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:23.543882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54714120-803e-405c-a618-53964ff7a76a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:23.544156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54714120-803e-405c-a618-53964ff7a76a None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:23.544984 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54714120-803e-405c-a618-53964ff7a76a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:23.546451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54714120-803e-405c-a618-53964ff7a76a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:23.548026 dv-cinder-797608-56-smb devstack@keystone.service[80380]: WARNING keystone.server.flask.common [None req-54714120-803e-405c-a618-53964ff7a76a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 16:11:23.582010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.sql.core [None req-54714120-803e-405c-a618-53964ff7a76a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 16:11:23.582010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 16:11:23.582010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [parameters: {'user_id': 'ae20cb5fbfaa458ca9c9ee5b60e0279a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 16:11:23.582010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80380) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 16:11:23.597803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220931bc-f3a6-4e80-bc4d-d6bf0b3ed44d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-54714120-803e-405c-a618-53964ff7a76a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application conn.query(q) Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application result.read() Jul 12 16:11:23.599563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 16:11:23.600507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application next(self.gen) Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application yield resource Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application next(self.gen) Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise self.value Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application session.commit() Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 16:11:23.601875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self.session.flush() Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application compat.raise_( Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 16:11:23.602797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 16:11:23.603821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application conn.query(q) Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application result.read() Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 16:11:23.604697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ae20cb5fbfaa458ca9c9ee5b60e0279a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:23.606868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 12 16:11:23.608568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 12 16:11:23.609748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 12 16:11:23.609748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 12 16:11:23.609748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 16:11:23.609748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 16:11:23.609748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 16:11:23.609748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:23.609748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 494/967] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Jul 12 16:11:23 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:23.609748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54714120-803e-405c-a618-53964ff7a76a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:23.647056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e30b83-ee43-48ca-bb82-bcd82bedd948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:23.647721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e30b83-ee43-48ca-bb82-bcd82bedd948 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:23.648006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e30b83-ee43-48ca-bb82-bcd82bedd948 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:23.648440 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e30b83-ee43-48ca-bb82-bcd82bedd948 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:23.649173 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e30b83-ee43-48ca-bb82-bcd82bedd948 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:23.649531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e30b83-ee43-48ca-bb82-bcd82bedd948 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:23.651068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e30b83-ee43-48ca-bb82-bcd82bedd948 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:23.660899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 474/968] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 16:11:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:23.660899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e30b83-ee43-48ca-bb82-bcd82bedd948 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:23.707295 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:23.713413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:23.718970 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54714120-803e-405c-a618-53964ff7a76a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:23.755301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8e626-176f-4a93-b614-ce6ef586067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:23.756176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8e626-176f-4a93-b614-ce6ef586067a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:23.756461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8e626-176f-4a93-b614-ce6ef586067a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:23.756742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8e626-176f-4a93-b614-ce6ef586067a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:23.764018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8e626-176f-4a93-b614-ce6ef586067a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:23.765685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8e626-176f-4a93-b614-ce6ef586067a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:23.770800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e30b83-ee43-48ca-bb82-bcd82bedd948 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-c6b8e626-176f-4a93-b614-ce6ef586067a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:11:23.782167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:23.783169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:23.784165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:23.784165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:23.784165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:11:23.784165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:11:23.784165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:11:23.784165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:11:23.784165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:11:23.784165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:11:23.784165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 16:11:23.784165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:23.784165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 495/969] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 16:11:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:23.784792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8e626-176f-4a93-b614-ce6ef586067a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:23.811836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a922e-e82b-4b6e-8042-29413d186895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:23.812635 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a922e-e82b-4b6e-8042-29413d186895 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:23.812928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a922e-e82b-4b6e-8042-29413d186895 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:23.813235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a922e-e82b-4b6e-8042-29413d186895 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:23.822504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a922e-e82b-4b6e-8042-29413d186895 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:23.823996 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a922e-e82b-4b6e-8042-29413d186895 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-082a922e-e82b-4b6e-8042-29413d186895 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:11:23.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:23.840979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:23.841977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:23.841977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:23.841977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:11:23.841977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:11:23.841977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:11:23.841977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:11:23.841977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:11:23.841977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:11:23.841977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 16:11:23.841977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:23.841977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 475/970] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:11:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:23.842597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a922e-e82b-4b6e-8042-29413d186895 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:23.894943 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8e626-176f-4a93-b614-ce6ef586067a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:23.929975 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb4384-bb8b-4df5-841f-3e0d1f1b173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:23.930680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb4384-bb8b-4df5-841f-3e0d1f1b173f None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:23.930970 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb4384-bb8b-4df5-841f-3e0d1f1b173f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:23.931246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb4384-bb8b-4df5-841f-3e0d1f1b173f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:23.931999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb4384-bb8b-4df5-841f-3e0d1f1b173f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:23.933403 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb4384-bb8b-4df5-841f-3e0d1f1b173f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:23.951324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a922e-e82b-4b6e-8042-29413d186895 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:23.952864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:23.987054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a982753-c25d-4c8b-b09b-1f3977354a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:23.987636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a982753-c25d-4c8b-b09b-1f3977354a99 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:23.987919 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a982753-c25d-4c8b-b09b-1f3977354a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:23.988192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a982753-c25d-4c8b-b09b-1f3977354a99 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:23.989034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a982753-c25d-4c8b-b09b-1f3977354a99 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:23.989365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a982753-c25d-4c8b-b09b-1f3977354a99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:23.990783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a982753-c25d-4c8b-b09b-1f3977354a99 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:24.011333 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 476/971] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Jul 12 16:11:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:24.012474 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a982753-c25d-4c8b-b09b-1f3977354a99 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:24.014873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 496/972] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 16:11:23 2022] POST /identity/v3/endpoints => generated 349 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:11:24.019509 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb4384-bb8b-4df5-841f-3e0d1f1b173f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:24.044532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:24.155393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb4384-bb8b-4df5-841f-3e0d1f1b173f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:24.166336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a982753-c25d-4c8b-b09b-1f3977354a99 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:24.195986 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8840727-7dd5-4282-af15-8ca33134abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:24.196641 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8840727-7dd5-4282-af15-8ca33134abbe None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:24.196925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8840727-7dd5-4282-af15-8ca33134abbe None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:24.197230 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8840727-7dd5-4282-af15-8ca33134abbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:24.207279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142a80b-3ffc-4ce8-803f-1f8b8cb6208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:24.207963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142a80b-3ffc-4ce8-803f-1f8b8cb6208f None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:24.208252 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142a80b-3ffc-4ce8-803f-1f8b8cb6208f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:24.208533 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142a80b-3ffc-4ce8-803f-1f8b8cb6208f None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:24.209377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142a80b-3ffc-4ce8-803f-1f8b8cb6208f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:24.209690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142a80b-3ffc-4ce8-803f-1f8b8cb6208f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:24.211118 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142a80b-3ffc-4ce8-803f-1f8b8cb6208f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:24.246986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 477/973] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 16:11:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:24.280215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8840727-7dd5-4282-af15-8ca33134abbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:24.281740 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8840727-7dd5-4282-af15-8ca33134abbe None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:24.293958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:24.400273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 497/974] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:11:24 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 16:11:24.406299 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142a80b-3ffc-4ce8-803f-1f8b8cb6208f None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:24.427422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:24.521298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142a80b-3ffc-4ce8-803f-1f8b8cb6208f None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:24.559238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca843ae-ad91-4112-920b-6fe7554d0f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:24.560044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca843ae-ad91-4112-920b-6fe7554d0f57 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:24.560328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca843ae-ad91-4112-920b-6fe7554d0f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:24.560600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca843ae-ad91-4112-920b-6fe7554d0f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:24.571434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca843ae-ad91-4112-920b-6fe7554d0f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:24.572875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca843ae-ad91-4112-920b-6fe7554d0f57 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-9ca843ae-ad91-4112-920b-6fe7554d0f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:24.590418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:24.591348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:24.592346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:24.592346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:24.592346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:24.592346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:24.592346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 478/975] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:24.599467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8840727-7dd5-4282-af15-8ca33134abbe None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:24.700203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8840727-7dd5-4282-af15-8ca33134abbe None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:24.710396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:24.735702 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f13ddd-72f3-4e93-bedc-8e04fcf9d0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:24.740260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f13ddd-72f3-4e93-bedc-8e04fcf9d0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:24.740260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f13ddd-72f3-4e93-bedc-8e04fcf9d0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:24.740260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f13ddd-72f3-4e93-bedc-8e04fcf9d0f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:24.740260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f13ddd-72f3-4e93-bedc-8e04fcf9d0f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:24.740260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f13ddd-72f3-4e93-bedc-8e04fcf9d0f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:24.740260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f13ddd-72f3-4e93-bedc-8e04fcf9d0f0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:24.755491 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 498/976] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:24.756677 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca843ae-ad91-4112-920b-6fe7554d0f57 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:24.828214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:24.860871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca843ae-ad91-4112-920b-6fe7554d0f57 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:24.896553 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9d263-82d3-4931-a7b1-4ee34631b36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:24.897375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d263-82d3-4931-a7b1-4ee34631b36d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:24.897670 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d263-82d3-4931-a7b1-4ee34631b36d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:24.897952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d263-82d3-4931-a7b1-4ee34631b36d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:24.904763 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9d263-82d3-4931-a7b1-4ee34631b36d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:24.906497 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9d263-82d3-4931-a7b1-4ee34631b36d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-2ab9d263-82d3-4931-a7b1-4ee34631b36d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:11:24.921262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:24.922160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:24.928311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:11:24.928311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:11:24.928311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:11:24.928311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:11:24.928311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:11:24.928311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:11:24.928311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:24.928311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:24.928311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 479/977] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:24.928804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0cbbf-ae86-45e3-a62c-f53bf9e17b7f None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:24.928804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0cbbf-ae86-45e3-a62c-f53bf9e17b7f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:24.928804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0cbbf-ae86-45e3-a62c-f53bf9e17b7f None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:24.928804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 499/978] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:11:24.929069 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9d263-82d3-4931-a7b1-4ee34631b36d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:24.930855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115b32-075c-46d2-b3cf-7310f7b7684c None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:24.931220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115b32-075c-46d2-b3cf-7310f7b7684c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:24.931574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115b32-075c-46d2-b3cf-7310f7b7684c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:24.949907 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-8e115b32-075c-46d2-b3cf-7310f7b7684c None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:24.951565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8e115b32-075c-46d2-b3cf-7310f7b7684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:25.018990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 500/979] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:25.036561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9d263-82d3-4931-a7b1-4ee34631b36d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:25.042054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e115b32-075c-46d2-b3cf-7310f7b7684c None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:25.066606 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:25.073087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ec0ea-64f3-4ea8-82f3-385f40356e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:25.073773 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ec0ea-64f3-4ea8-82f3-385f40356e23 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:25.074192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ec0ea-64f3-4ea8-82f3-385f40356e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:25.074452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ec0ea-64f3-4ea8-82f3-385f40356e23 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:25.081178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ec0ea-64f3-4ea8-82f3-385f40356e23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:25.081178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ec0ea-64f3-4ea8-82f3-385f40356e23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:25.081178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ec0ea-64f3-4ea8-82f3-385f40356e23 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:25.089307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 480/980] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:11:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:25.095146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ec0ea-64f3-4ea8-82f3-385f40356e23 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:25.147910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:25.152333 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e115b32-075c-46d2-b3cf-7310f7b7684c None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:25.190309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d9412-8f8b-474b-ab21-8c6dc2ba6282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:25.192091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d9412-8f8b-474b-ab21-8c6dc2ba6282 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:25.192385 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d9412-8f8b-474b-ab21-8c6dc2ba6282 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:25.192665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d9412-8f8b-474b-ab21-8c6dc2ba6282 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:25.193454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d9412-8f8b-474b-ab21-8c6dc2ba6282 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:25.195040 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d9412-8f8b-474b-ab21-8c6dc2ba6282 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:25.198695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ec0ea-64f3-4ea8-82f3-385f40356e23 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:25.232967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c237993-1b3c-4796-b9fa-356bc659645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:25.233651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c237993-1b3c-4796-b9fa-356bc659645b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:25.233932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c237993-1b3c-4796-b9fa-356bc659645b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:25.234201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c237993-1b3c-4796-b9fa-356bc659645b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:25.235025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c237993-1b3c-4796-b9fa-356bc659645b None admin] RBAC: Adding query filter params (role.id=d0229fddd2ba4c12ac455b83d2316347, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=cdf13cc74cf94d9a87613fe1e102ac99) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:25.235334 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c237993-1b3c-4796-b9fa-356bc659645b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:25.236758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c237993-1b3c-4796-b9fa-356bc659645b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:25.242680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 481/981] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:11:25 2022] GET /identity/v3/role_assignments?user.id=cdf13cc74cf94d9a87613fe1e102ac99&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=d0229fddd2ba4c12ac455b83d2316347 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:25.269922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 501/982] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:11:25 2022] POST /identity/v3/services => generated 242 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:11:26.132470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86844c87-bb9a-436c-b438-aed572b1e9f1 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:26.132797 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86844c87-bb9a-436c-b438-aed572b1e9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:26.133040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86844c87-bb9a-436c-b438-aed572b1e9f1 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:26.134599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 482/983] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:26.139633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d50fa7-7e16-4f9b-b714-1725586c74ae None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:26.139936 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d50fa7-7e16-4f9b-b714-1725586c74ae None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:26.140218 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d50fa7-7e16-4f9b-b714-1725586c74ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:26.156575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-d7d50fa7-7e16-4f9b-b714-1725586c74ae None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:26.157782 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d7d50fa7-7e16-4f9b-b714-1725586c74ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:26.232331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 502/984] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:26.254867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86844c87-bb9a-436c-b438-aed572b1e9f1 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:26.311812 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:26.358018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86844c87-bb9a-436c-b438-aed572b1e9f1 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:26.393561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bba79e-eda5-4246-a5ba-a6fa28ef4070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:26.394298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bba79e-eda5-4246-a5ba-a6fa28ef4070 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:26.394582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bba79e-eda5-4246-a5ba-a6fa28ef4070 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:26.394858 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bba79e-eda5-4246-a5ba-a6fa28ef4070 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:26.395522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bba79e-eda5-4246-a5ba-a6fa28ef4070 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:26.396898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bba79e-eda5-4246-a5ba-a6fa28ef4070 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-11bba79e-eda5-4246-a5ba-a6fa28ef4070 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:26.410089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:26.411178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:26.412023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:26.416634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 483/985] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 16:11:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:26.417968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d50fa7-7e16-4f9b-b714-1725586c74ae None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:26.504899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:26.522741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d50fa7-7e16-4f9b-b714-1725586c74ae None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:26.555771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96709588-04c6-4258-a0ff-927a1c5c325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:26.556429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96709588-04c6-4258-a0ff-927a1c5c325a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:26.556711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96709588-04c6-4258-a0ff-927a1c5c325a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:26.556985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96709588-04c6-4258-a0ff-927a1c5c325a None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:26.557723 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96709588-04c6-4258-a0ff-927a1c5c325a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:26.558030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96709588-04c6-4258-a0ff-927a1c5c325a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:26.559388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96709588-04c6-4258-a0ff-927a1c5c325a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:26.569448 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 503/986] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 16:11:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:26.570691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bba79e-eda5-4246-a5ba-a6fa28ef4070 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:26.668818 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bba79e-eda5-4246-a5ba-a6fa28ef4070 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:26.686017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:26.702786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46786c3e-52f4-4b4e-a8ca-4eb12d7fd75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:26.703450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46786c3e-52f4-4b4e-a8ca-4eb12d7fd75f None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:26.703733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46786c3e-52f4-4b4e-a8ca-4eb12d7fd75f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:26.704022 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46786c3e-52f4-4b4e-a8ca-4eb12d7fd75f None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:26.704711 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46786c3e-52f4-4b4e-a8ca-4eb12d7fd75f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:26.705018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46786c3e-52f4-4b4e-a8ca-4eb12d7fd75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:26.706452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46786c3e-52f4-4b4e-a8ca-4eb12d7fd75f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:26.712396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 484/987] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 16:11:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:26.717222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96709588-04c6-4258-a0ff-927a1c5c325a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:26.818021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96709588-04c6-4258-a0ff-927a1c5c325a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:26.851635 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee7a81-eb22-4e88-95e2-5aab979aa5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:26.852296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee7a81-eb22-4e88-95e2-5aab979aa5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:26.852580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee7a81-eb22-4e88-95e2-5aab979aa5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:26.852857 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee7a81-eb22-4e88-95e2-5aab979aa5d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:26.853689 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee7a81-eb22-4e88-95e2-5aab979aa5d6 None admin] RBAC: Adding query filter params (interface=admin, service_id=11e95cf5a1604f88bc139598509eea92, region_id=RegionOne) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:26.854003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee7a81-eb22-4e88-95e2-5aab979aa5d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:26.855380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee7a81-eb22-4e88-95e2-5aab979aa5d6 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:26.865154 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 504/988] 10.222.0.26 () {56 vars in 1249 bytes} [Tue Jul 12 16:11:26 2022] GET /identity/v3/endpoints?service_id=11e95cf5a1604f88bc139598509eea92&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:26.867288 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46786c3e-52f4-4b4e-a8ca-4eb12d7fd75f None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:26.971491 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46786c3e-52f4-4b4e-a8ca-4eb12d7fd75f None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:27.004327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27755a2-25ee-42c8-8499-e3cc6ed69eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:27.005050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27755a2-25ee-42c8-8499-e3cc6ed69eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:27.005361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27755a2-25ee-42c8-8499-e3cc6ed69eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:27.005638 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27755a2-25ee-42c8-8499-e3cc6ed69eb9 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:27.006362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27755a2-25ee-42c8-8499-e3cc6ed69eb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:27.007718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27755a2-25ee-42c8-8499-e3cc6ed69eb9 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:27.015065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 485/989] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 16:11:26 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:11:27.343897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f1695-a1eb-42e2-ab33-439e1a296edd None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:27.344438 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f1695-a1eb-42e2-ab33-439e1a296edd None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:27.344438 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f1695-a1eb-42e2-ab33-439e1a296edd None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:27.346654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 505/990] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:27.351549 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ee495-8965-404f-9013-410fb75ff56f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:27.351935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ee495-8965-404f-9013-410fb75ff56f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:27.352118 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ee495-8965-404f-9013-410fb75ff56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:27.360652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3face8-1bb5-4678-a055-28aedba8c01b None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:27.360937 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3face8-1bb5-4678-a055-28aedba8c01b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:27.361250 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3face8-1bb5-4678-a055-28aedba8c01b None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:27.363390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 506/991] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:11:27.368115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e2b64-8e97-4dda-8a08-06727bae235a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:27.368410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e2b64-8e97-4dda-8a08-06727bae235a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:27.368699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e2b64-8e97-4dda-8a08-06727bae235a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:27.369954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-8b8ee495-8965-404f-9013-410fb75ff56f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:27.371171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8b8ee495-8965-404f-9013-410fb75ff56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:27.384805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-9c0e2b64-8e97-4dda-8a08-06727bae235a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:27.386015 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9c0e2b64-8e97-4dda-8a08-06727bae235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:27.393832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:27.415200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:27.440188 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 486/992] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:27.463249 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ee495-8965-404f-9013-410fb75ff56f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:27.473588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 507/993] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:27.491968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e2b64-8e97-4dda-8a08-06727bae235a None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:27.576909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ee495-8965-404f-9013-410fb75ff56f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:27.599010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e2b64-8e97-4dda-8a08-06727bae235a None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:27.615201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300b850-5d18-4588-9209-d5170e1e77ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:27.616049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300b850-5d18-4588-9209-d5170e1e77ed None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:27.616339 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300b850-5d18-4588-9209-d5170e1e77ed None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:27.616621 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300b850-5d18-4588-9209-d5170e1e77ed None admin] PATH_INFO: `/v3/services/image` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:27.617316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300b850-5d18-4588-9209-d5170e1e77ed None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:27.618683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300b850-5d18-4588-9209-d5170e1e77ed None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-3300b850-5d18-4588-9209-d5170e1e77ed None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:27.630287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:27.631304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:27.632158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 487/994] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Jul 12 16:11:27 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:27.636052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78af34-5a80-4fba-906b-5d893ef30c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:27.636855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78af34-5a80-4fba-906b-5d893ef30c4e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:27.637160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78af34-5a80-4fba-906b-5d893ef30c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:27.637438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300b850-5d18-4588-9209-d5170e1e77ed None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:27.637537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78af34-5a80-4fba-906b-5d893ef30c4e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:27.638090 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78af34-5a80-4fba-906b-5d893ef30c4e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:27.639488 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78af34-5a80-4fba-906b-5d893ef30c4e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-0c78af34-5a80-4fba-906b-5d893ef30c4e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:27.652114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:27.653163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:27.654037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 508/995] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:27.659645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78af34-5a80-4fba-906b-5d893ef30c4e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:27.669778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:27.684555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:27.749512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300b850-5d18-4588-9209-d5170e1e77ed None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:27.766508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78af34-5a80-4fba-906b-5d893ef30c4e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:27.785225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0f14f-4753-48c3-9de8-3f22e0ef8a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:27.786019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0f14f-4753-48c3-9de8-3f22e0ef8a93 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:27.786302 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0f14f-4753-48c3-9de8-3f22e0ef8a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:27.786577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0f14f-4753-48c3-9de8-3f22e0ef8a93 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:27.787285 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0f14f-4753-48c3-9de8-3f22e0ef8a93 None admin] RBAC: Adding query filter params (name=image) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:27.787594 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0f14f-4753-48c3-9de8-3f22e0ef8a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:27.788952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0f14f-4753-48c3-9de8-3f22e0ef8a93 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:27.794270 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 488/996] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:27.799760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0f14f-4753-48c3-9de8-3f22e0ef8a93 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:27.807200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aba521-ae18-4668-aa32-3d8058428e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:27.807869 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aba521-ae18-4668-aa32-3d8058428e40 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:27.808238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aba521-ae18-4668-aa32-3d8058428e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:27.808452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aba521-ae18-4668-aa32-3d8058428e40 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:27.809150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aba521-ae18-4668-aa32-3d8058428e40 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:27.809468 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aba521-ae18-4668-aa32-3d8058428e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:27.810836 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aba521-ae18-4668-aa32-3d8058428e40 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:27.820453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 509/997] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 16:11:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:27.821446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aba521-ae18-4668-aa32-3d8058428e40 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:27.895175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:27.906195 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0f14f-4753-48c3-9de8-3f22e0ef8a93 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:27.910351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:27.928872 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aba521-ae18-4668-aa32-3d8058428e40 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:27.943755 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41781636-0912-42e1-bfd3-454a2042dc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:27.944809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41781636-0912-42e1-bfd3-454a2042dc8c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:27.945332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41781636-0912-42e1-bfd3-454a2042dc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:27.945865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41781636-0912-42e1-bfd3-454a2042dc8c None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:27.946770 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41781636-0912-42e1-bfd3-454a2042dc8c None admin] RBAC: Adding query filter params (type=image) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:27.947304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41781636-0912-42e1-bfd3-454a2042dc8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:27.948955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41781636-0912-42e1-bfd3-454a2042dc8c None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:27.953881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 489/998] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:27.970551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd39b92-a5ba-4d55-be50-33afbf543853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:27.971822 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd39b92-a5ba-4d55-be50-33afbf543853 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:27.972109 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd39b92-a5ba-4d55-be50-33afbf543853 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:27.972392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd39b92-a5ba-4d55-be50-33afbf543853 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:27.973154 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd39b92-a5ba-4d55-be50-33afbf543853 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:27.973463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd39b92-a5ba-4d55-be50-33afbf543853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:27.974894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd39b92-a5ba-4d55-be50-33afbf543853 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:27.985163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 510/999] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 16:11:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:27.987148 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41781636-0912-42e1-bfd3-454a2042dc8c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:28.095736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41781636-0912-42e1-bfd3-454a2042dc8c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:28.134423 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bd198-4b0d-47bb-8129-7ed6f3115ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:28.135097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bd198-4b0d-47bb-8129-7ed6f3115ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:28.135384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bd198-4b0d-47bb-8129-7ed6f3115ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:28.135660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bd198-4b0d-47bb-8129-7ed6f3115ae2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:28.136471 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bd198-4b0d-47bb-8129-7ed6f3115ae2 None admin] RBAC: Adding query filter params (interface=public, service_id=6eb01d1ddd234e598f3ae8aa583b5840, region_id=RegionOne) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:28.136786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bd198-4b0d-47bb-8129-7ed6f3115ae2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:28.138190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bd198-4b0d-47bb-8129-7ed6f3115ae2 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:28.144260 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 490/1000] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 16:11:27 2022] GET /identity/v3/endpoints?service_id=6eb01d1ddd234e598f3ae8aa583b5840&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:28.150029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd39b92-a5ba-4d55-be50-33afbf543853 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:28.249974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd39b92-a5ba-4d55-be50-33afbf543853 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:28.283792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40112689-eabd-4984-a990-2ce6290df34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:28.284456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40112689-eabd-4984-a990-2ce6290df34e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:28.284735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40112689-eabd-4984-a990-2ce6290df34e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:28.285013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40112689-eabd-4984-a990-2ce6290df34e None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:28.285725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40112689-eabd-4984-a990-2ce6290df34e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:28.287135 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40112689-eabd-4984-a990-2ce6290df34e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:28.288147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:28.296069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 511/1001] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 16:11:28 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:11:29.056852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268e64e-ac2b-4b10-a93e-ddd23bcb85d0 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:29.057416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268e64e-ac2b-4b10-a93e-ddd23bcb85d0 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:29.057416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268e64e-ac2b-4b10-a93e-ddd23bcb85d0 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:29.058946 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 491/1002] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:29.065275 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110244e9-cc21-4db4-81d4-4cb4686812ca None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:29.065858 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110244e9-cc21-4db4-81d4-4cb4686812ca None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:29.065858 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110244e9-cc21-4db4-81d4-4cb4686812ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:29.082580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-110244e9-cc21-4db4-81d4-4cb4686812ca None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:29.083757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-110244e9-cc21-4db4-81d4-4cb4686812ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:29.149872 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 512/1003] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:29.172240 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268e64e-ac2b-4b10-a93e-ddd23bcb85d0 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:29.203067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:29.272961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268e64e-ac2b-4b10-a93e-ddd23bcb85d0 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:29.305507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c2757-ac5d-4f17-9995-08446a958c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:29.306303 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c2757-ac5d-4f17-9995-08446a958c57 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:29.306586 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c2757-ac5d-4f17-9995-08446a958c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:29.306909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c2757-ac5d-4f17-9995-08446a958c57 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:29.307517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c2757-ac5d-4f17-9995-08446a958c57 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:29.308905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c2757-ac5d-4f17-9995-08446a958c57 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-4c1c2757-ac5d-4f17-9995-08446a958c57 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:29.320935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:29.321999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 16:11:29.322886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:29.324401 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 492/1004] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 16:11:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:29.328107 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110244e9-cc21-4db4-81d4-4cb4686812ca None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:29.428595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110244e9-cc21-4db4-81d4-4cb4686812ca None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:29.462195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:29.470508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711d64d-f704-43a1-b2e0-af722231e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:29.471826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711d64d-f704-43a1-b2e0-af722231e9db None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:29.476814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711d64d-f704-43a1-b2e0-af722231e9db None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:29.476814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711d64d-f704-43a1-b2e0-af722231e9db None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:29.476814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711d64d-f704-43a1-b2e0-af722231e9db None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:29.476814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711d64d-f704-43a1-b2e0-af722231e9db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:29.476814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711d64d-f704-43a1-b2e0-af722231e9db None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:29.483349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 513/1005] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 16:11:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:29.485746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c2757-ac5d-4f17-9995-08446a958c57 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:29.584391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:29.589969 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c2757-ac5d-4f17-9995-08446a958c57 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:29.622652 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0516d-4e07-47b5-b91e-151c9859f487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:29.623317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0516d-4e07-47b5-b91e-151c9859f487 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:29.623602 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0516d-4e07-47b5-b91e-151c9859f487 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:29.623885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0516d-4e07-47b5-b91e-151c9859f487 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:29.624592 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0516d-4e07-47b5-b91e-151c9859f487 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:29.624900 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0516d-4e07-47b5-b91e-151c9859f487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:29.626287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0516d-4e07-47b5-b91e-151c9859f487 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:29.636318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 493/1006] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 16:11:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:29.637432 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711d64d-f704-43a1-b2e0-af722231e9db None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:29.736331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711d64d-f704-43a1-b2e0-af722231e9db None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:29.770512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c9051-7ce5-4629-acb7-79e556c5c03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:29.771173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c9051-7ce5-4629-acb7-79e556c5c03b None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:29.771459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c9051-7ce5-4629-acb7-79e556c5c03b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:29.771737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c9051-7ce5-4629-acb7-79e556c5c03b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:29.772482 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c9051-7ce5-4629-acb7-79e556c5c03b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:29.773870 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c9051-7ce5-4629-acb7-79e556c5c03b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:29.853229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 514/1007] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 16:11:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:11:30.009771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632206-3d2d-4e7d-ae0d-3ce75fd23f5c None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:30.010063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632206-3d2d-4e7d-ae0d-3ce75fd23f5c None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:30.010346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632206-3d2d-4e7d-ae0d-3ce75fd23f5c None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:30.011728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 494/1008] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:30.017020 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0055ee9-a7c4-454c-a735-2f4c090ae5b4 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:30.017345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0055ee9-a7c4-454c-a735-2f4c090ae5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:30.017700 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0055ee9-a7c4-454c-a735-2f4c090ae5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:30.034996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a0055ee9-a7c4-454c-a735-2f4c090ae5b4 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:30.036197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a0055ee9-a7c4-454c-a735-2f4c090ae5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:30.084876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:30.110876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 515/1009] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:30.134227 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf632206-3d2d-4e7d-ae0d-3ce75fd23f5c None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:30.239883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf632206-3d2d-4e7d-ae0d-3ce75fd23f5c None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:30.273863 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350d231-e703-44df-ad85-7b9fc97d8242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:30.274537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d231-e703-44df-ad85-7b9fc97d8242 None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:30.274826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d231-e703-44df-ad85-7b9fc97d8242 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:30.275108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d231-e703-44df-ad85-7b9fc97d8242 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:30.275849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350d231-e703-44df-ad85-7b9fc97d8242 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:30.277251 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350d231-e703-44df-ad85-7b9fc97d8242 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:30.348050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53486e3-ad7c-4ee5-ae9f-4991231d60eb None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:30.348344 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53486e3-ad7c-4ee5-ae9f-4991231d60eb None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:30.348627 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53486e3-ad7c-4ee5-ae9f-4991231d60eb None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:30.350086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 516/1010] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:30.354856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909ef0b-4cf5-4226-8dd1-232fae759215 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:30.355165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909ef0b-4cf5-4226-8dd1-232fae759215 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:30.355433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909ef0b-4cf5-4226-8dd1-232fae759215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:30.371662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 495/1011] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:11:30 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:11:30.375677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-8909ef0b-4cf5-4226-8dd1-232fae759215 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:30.375677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8909ef0b-4cf5-4226-8dd1-232fae759215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:30.464596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 517/1012] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:30 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:30.488750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350d231-e703-44df-ad85-7b9fc97d8242 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:30.512813 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:30.596566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350d231-e703-44df-ad85-7b9fc97d8242 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:30.630881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5fb2e-0fd7-4f2e-b6a0-b8825de7973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:30.631898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5fb2e-0fd7-4f2e-b6a0-b8825de7973c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:30.632352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5fb2e-0fd7-4f2e-b6a0-b8825de7973c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:30.632777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5fb2e-0fd7-4f2e-b6a0-b8825de7973c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:30.633617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5fb2e-0fd7-4f2e-b6a0-b8825de7973c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:30.635108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5fb2e-0fd7-4f2e-b6a0-b8825de7973c None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-7ff5fb2e-0fd7-4f2e-b6a0-b8825de7973c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:30.647439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:30.648678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 16:11:30.649801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:30.652321 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 496/1013] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:30.657951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909ef0b-4cf5-4226-8dd1-232fae759215 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:30.758663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909ef0b-4cf5-4226-8dd1-232fae759215 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:30.760993 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:30.793598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93ab14-0539-4082-b36b-6e2d12435b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:30.794299 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93ab14-0539-4082-b36b-6e2d12435b78 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:30.794867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93ab14-0539-4082-b36b-6e2d12435b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:30.795163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93ab14-0539-4082-b36b-6e2d12435b78 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:30.795867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93ab14-0539-4082-b36b-6e2d12435b78 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:30.796176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93ab14-0539-4082-b36b-6e2d12435b78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:30.797579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93ab14-0539-4082-b36b-6e2d12435b78 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:30.806935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 518/1014] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 16:11:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:30.808262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5fb2e-0fd7-4f2e-b6a0-b8825de7973c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:30.902216 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:30.918613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5fb2e-0fd7-4f2e-b6a0-b8825de7973c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:30.973590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be517589-77fd-44a1-8e63-4de6b53f7a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:30.974597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be517589-77fd-44a1-8e63-4de6b53f7a12 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:30.975065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be517589-77fd-44a1-8e63-4de6b53f7a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:30.975556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be517589-77fd-44a1-8e63-4de6b53f7a12 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:30.976473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be517589-77fd-44a1-8e63-4de6b53f7a12 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:30.976968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be517589-77fd-44a1-8e63-4de6b53f7a12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:30.978572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be517589-77fd-44a1-8e63-4de6b53f7a12 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:30.984594 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 497/1015] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 16:11:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:30.990473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93ab14-0539-4082-b36b-6e2d12435b78 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:31.093604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93ab14-0539-4082-b36b-6e2d12435b78 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:31.128354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aabae2-ebcf-47db-9f7a-7dbad6be780d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:31.129013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aabae2-ebcf-47db-9f7a-7dbad6be780d None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:31.129330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aabae2-ebcf-47db-9f7a-7dbad6be780d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:31.129606 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aabae2-ebcf-47db-9f7a-7dbad6be780d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:31.130347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aabae2-ebcf-47db-9f7a-7dbad6be780d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:31.131749 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aabae2-ebcf-47db-9f7a-7dbad6be780d None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:31.205992 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 519/1016] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 16:11:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:11:31.906865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d3d38-0953-47d4-8346-dfba511b2bfa None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:31.907426 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d3d38-0953-47d4-8346-dfba511b2bfa None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:31.907426 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d3d38-0953-47d4-8346-dfba511b2bfa None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:31.909392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 498/1017] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:31.914669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5989776-a086-4f79-bcde-14b220af0569 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:31.915062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5989776-a086-4f79-bcde-14b220af0569 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:31.915404 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5989776-a086-4f79-bcde-14b220af0569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:31.932554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a5989776-a086-4f79-bcde-14b220af0569 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:31.933753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a5989776-a086-4f79-bcde-14b220af0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:31.951522 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:32.013160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 520/1018] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:32.032212 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d3d38-0953-47d4-8346-dfba511b2bfa None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:32.137502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d3d38-0953-47d4-8346-dfba511b2bfa None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:32.173520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ff45a-9076-4cc2-89d7-834e509019f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:32.175115 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ff45a-9076-4cc2-89d7-834e509019f1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:32.175402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ff45a-9076-4cc2-89d7-834e509019f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:32.175684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ff45a-9076-4cc2-89d7-834e509019f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:32.176913 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ff45a-9076-4cc2-89d7-834e509019f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:32.179559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ff45a-9076-4cc2-89d7-834e509019f1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:32.187186 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 499/1019] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:32.188606 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5989776-a086-4f79-bcde-14b220af0569 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:32.290934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5989776-a086-4f79-bcde-14b220af0569 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:32.325156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56907c-3f63-4e83-8fa3-70d60d110539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:32.325901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56907c-3f63-4e83-8fa3-70d60d110539 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:32.326184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56907c-3f63-4e83-8fa3-70d60d110539 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:32.326457 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56907c-3f63-4e83-8fa3-70d60d110539 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:32.327165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56907c-3f63-4e83-8fa3-70d60d110539 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:32.328602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56907c-3f63-4e83-8fa3-70d60d110539 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:32.425414 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 521/1020] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:11:32 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:11:32.476239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dce48-2664-47b4-a903-60ca43bc0e2f None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:32.476830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dce48-2664-47b4-a903-60ca43bc0e2f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:32.477352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dce48-2664-47b4-a903-60ca43bc0e2f None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:32.479502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 500/1021] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:32.485513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fd2f9-8ddb-42f9-a4cb-91c499cf27d2 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:32.485817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fd2f9-8ddb-42f9-a4cb-91c499cf27d2 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:32.486066 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fd2f9-8ddb-42f9-a4cb-91c499cf27d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:32.491744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:32.507150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ed3fd2f9-8ddb-42f9-a4cb-91c499cf27d2 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:32.508518 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ed3fd2f9-8ddb-42f9-a4cb-91c499cf27d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:32.601255 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 522/1022] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:32.622231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dce48-2664-47b4-a903-60ca43bc0e2f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:32.645096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:32.744270 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dce48-2664-47b4-a903-60ca43bc0e2f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:32.780827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c2951-1ef3-4aaf-9660-39e383a78502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:32.781650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c2951-1ef3-4aaf-9660-39e383a78502 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:32.781933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c2951-1ef3-4aaf-9660-39e383a78502 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:32.782207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c2951-1ef3-4aaf-9660-39e383a78502 None admin] PATH_INFO: `/v3/services/image` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:32.782865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c2951-1ef3-4aaf-9660-39e383a78502 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:32.784764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c2951-1ef3-4aaf-9660-39e383a78502 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-4c0c2951-1ef3-4aaf-9660-39e383a78502 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:32.796786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:32.797881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 16:11:32.798721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:32.800583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 501/1023] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Jul 12 16:11:32 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:32.805099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fd2f9-8ddb-42f9-a4cb-91c499cf27d2 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:32.904380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fd2f9-8ddb-42f9-a4cb-91c499cf27d2 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:32.980818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:32.986280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3790ab-fc21-4430-bfc9-b9e4e45e6f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:32.986951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3790ab-fc21-4430-bfc9-b9e4e45e6f87 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:32.987228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3790ab-fc21-4430-bfc9-b9e4e45e6f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:32.987500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3790ab-fc21-4430-bfc9-b9e4e45e6f87 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:32.988202 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3790ab-fc21-4430-bfc9-b9e4e45e6f87 None admin] RBAC: Adding query filter params (name=image) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:32.988505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3790ab-fc21-4430-bfc9-b9e4e45e6f87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:32.989893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3790ab-fc21-4430-bfc9-b9e4e45e6f87 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:32.999614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 523/1024] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:33.001206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c2951-1ef3-4aaf-9660-39e383a78502 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:33.083407 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:33.102571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c2951-1ef3-4aaf-9660-39e383a78502 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:33.137318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b6c56-fa3e-4fe9-8a69-695c2634e243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:33.138226 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b6c56-fa3e-4fe9-8a69-695c2634e243 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:33.138674 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b6c56-fa3e-4fe9-8a69-695c2634e243 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:33.139103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b6c56-fa3e-4fe9-8a69-695c2634e243 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:33.139958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b6c56-fa3e-4fe9-8a69-695c2634e243 None admin] RBAC: Adding query filter params (type=image) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:33.140422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b6c56-fa3e-4fe9-8a69-695c2634e243 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:33.141937 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b6c56-fa3e-4fe9-8a69-695c2634e243 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:33.148079 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 502/1025] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:33.153591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3790ab-fc21-4430-bfc9-b9e4e45e6f87 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:33.256175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3790ab-fc21-4430-bfc9-b9e4e45e6f87 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:33.290477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda1cb7-5c74-4a9e-bf3c-07e8d7f5220a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:33.291136 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda1cb7-5c74-4a9e-bf3c-07e8d7f5220a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:33.291473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda1cb7-5c74-4a9e-bf3c-07e8d7f5220a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:33.291756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda1cb7-5c74-4a9e-bf3c-07e8d7f5220a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:33.292543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda1cb7-5c74-4a9e-bf3c-07e8d7f5220a None admin] RBAC: Adding query filter params (interface=public, service_id=b2dd1bc2c6f94222afc14d7c99bad1d3, region_id=RegionOne) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:33.292858 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda1cb7-5c74-4a9e-bf3c-07e8d7f5220a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:33.294264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda1cb7-5c74-4a9e-bf3c-07e8d7f5220a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:33.303822 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 524/1026] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 16:11:33 2022] GET /identity/v3/endpoints?service_id=b2dd1bc2c6f94222afc14d7c99bad1d3&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:33.305053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b6c56-fa3e-4fe9-8a69-695c2634e243 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:33.361524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c55c5-a569-4cd5-aa77-e28939f08238 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:33.361810 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c55c5-a569-4cd5-aa77-e28939f08238 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:33.362086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c55c5-a569-4cd5-aa77-e28939f08238 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:33.363581 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 525/1027] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:11:33.368086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf0481-5de3-4a2a-aecb-54f0413caac9 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:33.368380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf0481-5de3-4a2a-aecb-54f0413caac9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:33.368636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf0481-5de3-4a2a-aecb-54f0413caac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:33.386011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-c9bf0481-5de3-4a2a-aecb-54f0413caac9 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:33.387974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c9bf0481-5de3-4a2a-aecb-54f0413caac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:33.412862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b6c56-fa3e-4fe9-8a69-695c2634e243 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:33.448436 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ddcbc-4447-47b3-89cf-65618338ef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:33.449105 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ddcbc-4447-47b3-89cf-65618338ef71 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:33.449413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ddcbc-4447-47b3-89cf-65618338ef71 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:33.449689 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ddcbc-4447-47b3-89cf-65618338ef71 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:33.450404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ddcbc-4447-47b3-89cf-65618338ef71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:33.451756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ddcbc-4447-47b3-89cf-65618338ef71 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:33.462766 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:33.469562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 503/1028] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 16:11:33 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:11:33.472713 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 526/1029] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:33.490027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ddcbc-4447-47b3-89cf-65618338ef71 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:33.502904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:33.604630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ddcbc-4447-47b3-89cf-65618338ef71 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:33.640790 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1bb824-7313-4b21-b8c9-dc6a570487c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:33.641655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bb824-7313-4b21-b8c9-dc6a570487c4 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:33.641940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bb824-7313-4b21-b8c9-dc6a570487c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:33.642214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bb824-7313-4b21-b8c9-dc6a570487c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:33.652548 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1bb824-7313-4b21-b8c9-dc6a570487c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-8f1bb824-7313-4b21-b8c9-dc6a570487c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:33.661256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:33.662184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:33.663468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:33.663468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:33.663468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:33.663468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:33.663468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:33.663468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:33.663468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:33.663468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:33.663468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:33.663468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:33.663468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 16:11:33.663468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:33.663468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 504/1030] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Jul 12 16:11:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:33.668634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf0481-5de3-4a2a-aecb-54f0413caac9 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:33.767093 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf0481-5de3-4a2a-aecb-54f0413caac9 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:33.802091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dffa29-0654-4663-bae2-6122506fc63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:33.802755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dffa29-0654-4663-bae2-6122506fc63f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:33.803037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dffa29-0654-4663-bae2-6122506fc63f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:33.803315 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dffa29-0654-4663-bae2-6122506fc63f None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:33.804059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dffa29-0654-4663-bae2-6122506fc63f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:33.804367 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dffa29-0654-4663-bae2-6122506fc63f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:33.805806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dffa29-0654-4663-bae2-6122506fc63f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:33.819566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 527/1031] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 16:11:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:33.821222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1bb824-7313-4b21-b8c9-dc6a570487c4 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:33.890326 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:33.925213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1bb824-7313-4b21-b8c9-dc6a570487c4 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:33.962874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5319e2a-8d5b-48be-b0ec-7d3f28e88e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:33.963676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5319e2a-8d5b-48be-b0ec-7d3f28e88e9a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:33.963963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5319e2a-8d5b-48be-b0ec-7d3f28e88e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:33.964241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5319e2a-8d5b-48be-b0ec-7d3f28e88e9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:33.975075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5319e2a-8d5b-48be-b0ec-7d3f28e88e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:33.976534 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5319e2a-8d5b-48be-b0ec-7d3f28e88e9a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-b5319e2a-8d5b-48be-b0ec-7d3f28e88e9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:33.993973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:33.994904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:33.995807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:33.995807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:33.995807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:33.995807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:33.995807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 505/1032] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:34.001141 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dffa29-0654-4663-bae2-6122506fc63f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:34.056869 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:34.105272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dffa29-0654-4663-bae2-6122506fc63f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:34.139508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050b4bf-ead7-481c-bf16-6a3a1068b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:34.140172 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050b4bf-ead7-481c-bf16-6a3a1068b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:34.140511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050b4bf-ead7-481c-bf16-6a3a1068b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:34.140738 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050b4bf-ead7-481c-bf16-6a3a1068b6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:34.141489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050b4bf-ead7-481c-bf16-6a3a1068b6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:34.141801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050b4bf-ead7-481c-bf16-6a3a1068b6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:34.143736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050b4bf-ead7-481c-bf16-6a3a1068b6e2 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:34.156122 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 528/1033] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:34.161750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5319e2a-8d5b-48be-b0ec-7d3f28e88e9a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:34.263453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5319e2a-8d5b-48be-b0ec-7d3f28e88e9a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:34.282531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:34.297354 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de2ecb-95ae-4e89-ab4a-5805164c6cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:34.301253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2ecb-95ae-4e89-ab4a-5805164c6cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:34.301253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2ecb-95ae-4e89-ab4a-5805164c6cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:34.301253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2ecb-95ae-4e89-ab4a-5805164c6cb9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:34.307000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de2ecb-95ae-4e89-ab4a-5805164c6cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:34.308433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de2ecb-95ae-4e89-ab4a-5805164c6cb9 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-d0de2ecb-95ae-4e89-ab4a-5805164c6cb9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:11:34.322979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:34.324033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:34.325034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:34.325034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:34.325034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:11:34.325034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:11:34.325034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:11:34.325034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:11:34.325034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:11:34.325034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:11:34.325034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:11:34.325034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:34.328911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 506/1034] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 16:11:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:34.330173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050b4bf-ead7-481c-bf16-6a3a1068b6e2 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:34.431284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050b4bf-ead7-481c-bf16-6a3a1068b6e2 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:34.444614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:34.471446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d29de-76f4-4fb2-929b-7ee69b040657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:34.472165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d29de-76f4-4fb2-929b-7ee69b040657 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:34.473187 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d29de-76f4-4fb2-929b-7ee69b040657 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:34.473826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d29de-76f4-4fb2-929b-7ee69b040657 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:34.474895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d29de-76f4-4fb2-929b-7ee69b040657 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:34.475614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d29de-76f4-4fb2-929b-7ee69b040657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:34.477035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d29de-76f4-4fb2-929b-7ee69b040657 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:34.494643 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 529/1035] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 16:11:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:34.500264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de2ecb-95ae-4e89-ab4a-5805164c6cb9 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:34.541856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2f26c-9df2-4757-ba18-791e70161294 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:34.542150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2f26c-9df2-4757-ba18-791e70161294 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:34.542435 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2f26c-9df2-4757-ba18-791e70161294 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:34.544314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 530/1036] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:34.548669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff917a-78ef-4b90-aea5-1a5b6bce9deb None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:34.549010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff917a-78ef-4b90-aea5-1a5b6bce9deb None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:34.549329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff917a-78ef-4b90-aea5-1a5b6bce9deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:34.566632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-8bff917a-78ef-4b90-aea5-1a5b6bce9deb None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:34.567824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8bff917a-78ef-4b90-aea5-1a5b6bce9deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:34.606800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de2ecb-95ae-4e89-ab4a-5805164c6cb9 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:34.642369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c37a2-4394-4a3b-98e7-3b91c0149c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:34.643570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c37a2-4394-4a3b-98e7-3b91c0149c3e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:34.643857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c37a2-4394-4a3b-98e7-3b91c0149c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:34.644134 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c37a2-4394-4a3b-98e7-3b91c0149c3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:34.645385 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 531/1037] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:34.669919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff917a-78ef-4b90-aea5-1a5b6bce9deb None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:34.701479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:34.722468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c37a2-4394-4a3b-98e7-3b91c0149c3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:34.723964 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c37a2-4394-4a3b-98e7-3b91c0149c3e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:34.773285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:34.776513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff917a-78ef-4b90-aea5-1a5b6bce9deb None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:34.811830 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b3af1-bd14-41da-8ecb-07d739230c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:34.812614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b3af1-bd14-41da-8ecb-07d739230c4c None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:34.812900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b3af1-bd14-41da-8ecb-07d739230c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:34.813468 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b3af1-bd14-41da-8ecb-07d739230c4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:34.815167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b3af1-bd14-41da-8ecb-07d739230c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:34.816596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b3af1-bd14-41da-8ecb-07d739230c4c None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:34.818235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 532/1038] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:34.823898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b3af1-bd14-41da-8ecb-07d739230c4c None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:34.829803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 507/1039] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:11:34 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:11:34.835761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c37a2-4394-4a3b-98e7-3b91c0149c3e None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:34.914920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:34.933933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b3af1-bd14-41da-8ecb-07d739230c4c None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:34.934573 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c37a2-4394-4a3b-98e7-3b91c0149c3e None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:34.971469 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347939af-8457-4736-86d7-a4f6b48b77f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:34.972235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347939af-8457-4736-86d7-a4f6b48b77f5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:34.972524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347939af-8457-4736-86d7-a4f6b48b77f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:34.972801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347939af-8457-4736-86d7-a4f6b48b77f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:34.974203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78016c38-485f-4c87-a312-981fc1a3f3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:34.975041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78016c38-485f-4c87-a312-981fc1a3f3a6 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:34.975524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78016c38-485f-4c87-a312-981fc1a3f3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:34.975803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78016c38-485f-4c87-a312-981fc1a3f3a6 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:34.976515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78016c38-485f-4c87-a312-981fc1a3f3a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:34.978059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78016c38-485f-4c87-a312-981fc1a3f3a6 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:34.983155 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347939af-8457-4736-86d7-a4f6b48b77f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:34.984571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347939af-8457-4736-86d7-a4f6b48b77f5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-347939af-8457-4736-86d7-a4f6b48b77f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:35.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:35.003838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:35.009510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:35.009510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:35.009510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:35.009510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:35.009510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 508/1040] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:35.009510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347939af-8457-4736-86d7-a4f6b48b77f5 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:35.079243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 533/1041] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:11:34 2022] POST /identity/v3/users => generated 285 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:11:35.117312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347939af-8457-4736-86d7-a4f6b48b77f5 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:35.151501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:35.156973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21d3c-2131-46ec-9495-b52e8cd8be52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:35.157679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21d3c-2131-46ec-9495-b52e8cd8be52 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:35.157962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21d3c-2131-46ec-9495-b52e8cd8be52 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:35.158330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21d3c-2131-46ec-9495-b52e8cd8be52 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:35.159042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21d3c-2131-46ec-9495-b52e8cd8be52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:35.159317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21d3c-2131-46ec-9495-b52e8cd8be52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:35.160704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21d3c-2131-46ec-9495-b52e8cd8be52 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:35.177945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 509/1042] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:35.180037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78016c38-485f-4c87-a312-981fc1a3f3a6 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:35.210146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:35.291741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78016c38-485f-4c87-a312-981fc1a3f3a6 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:35.327990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb16544-f354-4beb-b47e-28eb6c3ab67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:35.328784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb16544-f354-4beb-b47e-28eb6c3ab67c None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:35.329062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb16544-f354-4beb-b47e-28eb6c3ab67c None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:35.329370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb16544-f354-4beb-b47e-28eb6c3ab67c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:35.336610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb16544-f354-4beb-b47e-28eb6c3ab67c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:35.338075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb16544-f354-4beb-b47e-28eb6c3ab67c None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-3eb16544-f354-4beb-b47e-28eb6c3ab67c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:11:35.352999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:35.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:35.355302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:11:35.355302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:11:35.355302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:11:35.355302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:11:35.355302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:11:35.355302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:11:35.355302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:35.355302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:35.357465 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 534/1043] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:35.363483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21d3c-2131-46ec-9495-b52e8cd8be52 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:35.472810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21d3c-2131-46ec-9495-b52e8cd8be52 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:35.515135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ccd1f-90af-47ef-8be6-35c2301e20c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:35.515808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ccd1f-90af-47ef-8be6-35c2301e20c5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:35.516097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ccd1f-90af-47ef-8be6-35c2301e20c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:35.516465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ccd1f-90af-47ef-8be6-35c2301e20c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:35.517295 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ccd1f-90af-47ef-8be6-35c2301e20c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:35.518154 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ccd1f-90af-47ef-8be6-35c2301e20c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:35.519580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ccd1f-90af-47ef-8be6-35c2301e20c5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:35.527943 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec84e1c-2d22-44d5-9f73-1dd4efb2cd9f None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:35.528235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec84e1c-2d22-44d5-9f73-1dd4efb2cd9f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:35.528516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec84e1c-2d22-44d5-9f73-1dd4efb2cd9f None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:35.529927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 535/1044] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:11:35.532671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 510/1045] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:11:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:35.535266 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8ee90-bece-4f3a-abb4-e8cb5d811fd5 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:35.535553 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8ee90-bece-4f3a-abb4-e8cb5d811fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:35.535828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8ee90-bece-4f3a-abb4-e8cb5d811fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:35.539318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ccd1f-90af-47ef-8be6-35c2301e20c5 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:35.552817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-49a8ee90-bece-4f3a-abb4-e8cb5d811fd5 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:35.553988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-49a8ee90-bece-4f3a-abb4-e8cb5d811fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:35.595192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:35.629363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 536/1046] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:35.645914 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ccd1f-90af-47ef-8be6-35c2301e20c5 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:35.651860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8ee90-bece-4f3a-abb4-e8cb5d811fd5 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:35.667667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:35.685711 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5911af-339f-4f2f-963a-123e040ec2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:35.686534 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5911af-339f-4f2f-963a-123e040ec2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:35.686824 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5911af-339f-4f2f-963a-123e040ec2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:35.687842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5911af-339f-4f2f-963a-123e040ec2c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:35.688967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5911af-339f-4f2f-963a-123e040ec2c3 None admin] RBAC: Adding query filter params (role.id=d0229fddd2ba4c12ac455b83d2316347, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=f36355ce7ff841f3bd9e228fbad64a83) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:35.689815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5911af-339f-4f2f-963a-123e040ec2c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:35.691249 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5911af-339f-4f2f-963a-123e040ec2c3 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:35.708144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 511/1047] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:11:35 2022] GET /identity/v3/role_assignments?user.id=f36355ce7ff841f3bd9e228fbad64a83&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=d0229fddd2ba4c12ac455b83d2316347 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:35.760780 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8ee90-bece-4f3a-abb4-e8cb5d811fd5 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:35.797596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec5063-f4e7-4325-ae7f-e6844348233f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:35.798409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec5063-f4e7-4325-ae7f-e6844348233f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:35.798749 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec5063-f4e7-4325-ae7f-e6844348233f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:35.799034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec5063-f4e7-4325-ae7f-e6844348233f None admin] PATH_INFO: `/v3/services/image` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:35.799705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec5063-f4e7-4325-ae7f-e6844348233f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:35.801097 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec5063-f4e7-4325-ae7f-e6844348233f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-aaec5063-f4e7-4325-ae7f-e6844348233f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:35.814094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:35.815708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:35.821747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 537/1048] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Jul 12 16:11:35 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:35.822561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5911af-339f-4f2f-963a-123e040ec2c3 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:35.927184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5911af-339f-4f2f-963a-123e040ec2c3 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:35.944473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:35.962570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24a851-04ce-42c6-845e-1b95ffb1831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:35.963271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24a851-04ce-42c6-845e-1b95ffb1831c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:35.963596 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24a851-04ce-42c6-845e-1b95ffb1831c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:35.963853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24a851-04ce-42c6-845e-1b95ffb1831c None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:35.964572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24a851-04ce-42c6-845e-1b95ffb1831c None admin] RBAC: Adding query filter params (name=image) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:35.964885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24a851-04ce-42c6-845e-1b95ffb1831c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:35.966281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24a851-04ce-42c6-845e-1b95ffb1831c None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:35.976025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 512/1049] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:35.977286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec5063-f4e7-4325-ae7f-e6844348233f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:36.055862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:36.077958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec5063-f4e7-4325-ae7f-e6844348233f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:36.112855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d8ed5-7aa5-4c3e-a182-b088aee87b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:36.113554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8ed5-7aa5-4c3e-a182-b088aee87b29 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:36.113844 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8ed5-7aa5-4c3e-a182-b088aee87b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:36.114124 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8ed5-7aa5-4c3e-a182-b088aee87b29 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:36.114831 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d8ed5-7aa5-4c3e-a182-b088aee87b29 None admin] RBAC: Adding query filter params (type=image) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:36.115139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d8ed5-7aa5-4c3e-a182-b088aee87b29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:36.116512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d8ed5-7aa5-4c3e-a182-b088aee87b29 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:36.126133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 538/1050] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:36.127892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24a851-04ce-42c6-845e-1b95ffb1831c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:36.229598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24a851-04ce-42c6-845e-1b95ffb1831c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:36.265151 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8c8b6-144d-4ca0-ba6d-0056cc79b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:36.265821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8c8b6-144d-4ca0-ba6d-0056cc79b2da None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:36.266107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8c8b6-144d-4ca0-ba6d-0056cc79b2da None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:36.266385 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8c8b6-144d-4ca0-ba6d-0056cc79b2da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:36.267133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8c8b6-144d-4ca0-ba6d-0056cc79b2da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:36.268492 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8c8b6-144d-4ca0-ba6d-0056cc79b2da None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:36.376234 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 513/1051] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 16:11:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:11:37.211817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6c14a-a116-4334-bb68-93a34ddfe40d None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:37.212339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6c14a-a116-4334-bb68-93a34ddfe40d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:37.212419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6c14a-a116-4334-bb68-93a34ddfe40d None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:37.213814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 539/1052] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:37.218904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a649b0b-5b3c-4cb7-8cf3-ded756e7607a None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:37.219206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a649b0b-5b3c-4cb7-8cf3-ded756e7607a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:37.219489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a649b0b-5b3c-4cb7-8cf3-ded756e7607a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:37.236312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-7a649b0b-5b3c-4cb7-8cf3-ded756e7607a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:37.237539 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7a649b0b-5b3c-4cb7-8cf3-ded756e7607a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:37.266865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:37.312661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 514/1053] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:37.336844 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6c14a-a116-4334-bb68-93a34ddfe40d None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:37.442678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6c14a-a116-4334-bb68-93a34ddfe40d None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:37.478026 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa3ee9-64f8-4079-b747-af2dbaaca7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:37.478752 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa3ee9-64f8-4079-b747-af2dbaaca7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:37.479033 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa3ee9-64f8-4079-b747-af2dbaaca7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:37.479303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa3ee9-64f8-4079-b747-af2dbaaca7d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:37.492067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa3ee9-64f8-4079-b747-af2dbaaca7d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-1baa3ee9-64f8-4079-b747-af2dbaaca7d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:37.499784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:37.500722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:37.507501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:37.507501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:37.507501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:37.507501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:37.507501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:37.507501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:37.507501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:37.507501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:37.507501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:37.507501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:37.507501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:11:37.507501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:37.507501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 540/1054] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:11:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:37.510839 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a649b0b-5b3c-4cb7-8cf3-ded756e7607a None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:37.617588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a649b0b-5b3c-4cb7-8cf3-ded756e7607a None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:37.651300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef6397-61b7-4301-b509-5704880701da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:37.651973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef6397-61b7-4301-b509-5704880701da None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:37.652484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef6397-61b7-4301-b509-5704880701da None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:37.652767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef6397-61b7-4301-b509-5704880701da None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:37.653545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef6397-61b7-4301-b509-5704880701da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:37.653856 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef6397-61b7-4301-b509-5704880701da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:37.655214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef6397-61b7-4301-b509-5704880701da None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:37.667848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 515/1055] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:11:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:37.669766 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa3ee9-64f8-4079-b747-af2dbaaca7d2 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:37.672851 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:37.734204 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8f453-ffbe-409d-9348-193d9a7d9766 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:37.734405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8f453-ffbe-409d-9348-193d9a7d9766 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:37.734684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8f453-ffbe-409d-9348-193d9a7d9766 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:37.736058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 516/1056] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:11:37.742021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a60f7-d37e-4157-850b-d1ae7e993fc1 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:37.742318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a60f7-d37e-4157-850b-d1ae7e993fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:37.742601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a60f7-d37e-4157-850b-d1ae7e993fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:37.759827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-217a60f7-d37e-4157-850b-d1ae7e993fc1 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:37.761024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-217a60f7-d37e-4157-850b-d1ae7e993fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:37.778479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:37.780000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa3ee9-64f8-4079-b747-af2dbaaca7d2 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:37.816914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd3b45-ed89-47ee-a1e4-c4f7398b87b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:37.817820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd3b45-ed89-47ee-a1e4-c4f7398b87b6 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:37.818086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd3b45-ed89-47ee-a1e4-c4f7398b87b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:37.818393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd3b45-ed89-47ee-a1e4-c4f7398b87b6 None admin] PATH_INFO: `/v3/users/9461ea7e38bb4a758a6a1986b440c132` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:37.833956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd3b45-ed89-47ee-a1e4-c4f7398b87b6 None admin] RBAC: Authorizing `identity:get_user(user_id=9461ea7e38bb4a758a6a1986b440c132)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:37.835420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd3b45-ed89-47ee-a1e4-c4f7398b87b6 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:37.841983 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 541/1057] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:11:37 2022] GET /identity/v3/users/9461ea7e38bb4a758a6a1986b440c132 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:37.842106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 517/1058] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:37.842673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd3b45-ed89-47ee-a1e4-c4f7398b87b6 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:37.854538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a60f7-d37e-4157-850b-d1ae7e993fc1 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:37.910687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:37.954635 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd3b45-ed89-47ee-a1e4-c4f7398b87b6 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:37.960381 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a60f7-d37e-4157-850b-d1ae7e993fc1 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:37.992580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145b464-4853-4ba6-a456-3c862454dde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:37.993189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145b464-4853-4ba6-a456-3c862454dde4 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:37.993482 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145b464-4853-4ba6-a456-3c862454dde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:37.993761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145b464-4853-4ba6-a456-3c862454dde4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:37.999412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e74e-e06b-46d3-af30-afe930fef964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:38.000233 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e74e-e06b-46d3-af30-afe930fef964 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:38.000517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e74e-e06b-46d3-af30-afe930fef964 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:38.000793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e74e-e06b-46d3-af30-afe930fef964 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:38.011931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3e74e-e06b-46d3-af30-afe930fef964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-49b3e74e-e06b-46d3-af30-afe930fef964 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:38.020878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:38.022068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:38.022949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:38.022949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:38.022949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:38.022949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:38.022949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:38.022949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:38.022949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:38.022949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:38.022949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:38.022949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:38.022949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 16:11:38.022949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:38.022949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 518/1059] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Jul 12 16:11:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:38.027784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e74e-e06b-46d3-af30-afe930fef964 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:38.044719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:38.072231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145b464-4853-4ba6-a456-3c862454dde4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:38.073768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145b464-4853-4ba6-a456-3c862454dde4 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:38.133184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:38.134246 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e74e-e06b-46d3-af30-afe930fef964 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:38.169402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bf26f-a7db-436f-b6f7-116d152d0637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:38.170184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bf26f-a7db-436f-b6f7-116d152d0637 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:38.170471 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bf26f-a7db-436f-b6f7-116d152d0637 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:38.170748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bf26f-a7db-436f-b6f7-116d152d0637 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:38.171500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bf26f-a7db-436f-b6f7-116d152d0637 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:38.171811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bf26f-a7db-436f-b6f7-116d152d0637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:38.173205 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bf26f-a7db-436f-b6f7-116d152d0637 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:38.186769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 519/1060] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 16:11:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:38.186924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 542/1061] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:11:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 16:11:38.187626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bf26f-a7db-436f-b6f7-116d152d0637 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:38.189106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145b464-4853-4ba6-a456-3c862454dde4 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:38.276603 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:38.291839 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145b464-4853-4ba6-a456-3c862454dde4 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:38.305852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bf26f-a7db-436f-b6f7-116d152d0637 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:38.326951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24970c73-d135-4be2-926c-46cffaca4c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:38.327813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24970c73-d135-4be2-926c-46cffaca4c46 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:38.328095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24970c73-d135-4be2-926c-46cffaca4c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:38.328368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24970c73-d135-4be2-926c-46cffaca4c46 None admin] PATH_INFO: `/v3/projects/0837dc899d4443d59818f0d805c43661` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:38.329581 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24970c73-d135-4be2-926c-46cffaca4c46 None admin] RBAC: Authorizing `identity:get_project(project_id=0837dc899d4443d59818f0d805c43661)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:38.331068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24970c73-d135-4be2-926c-46cffaca4c46 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:38.333048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 543/1062] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:11:38 2022] GET /identity/v3/projects/0837dc899d4443d59818f0d805c43661 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:38.338791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24970c73-d135-4be2-926c-46cffaca4c46 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:38.350620 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94047636-8582-49d7-bdf2-bd0d7173edd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:38.351612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94047636-8582-49d7-bdf2-bd0d7173edd2 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:38.352070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94047636-8582-49d7-bdf2-bd0d7173edd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:38.352357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94047636-8582-49d7-bdf2-bd0d7173edd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:38.364163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94047636-8582-49d7-bdf2-bd0d7173edd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:38.365805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94047636-8582-49d7-bdf2-bd0d7173edd2 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:38.368186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-94047636-8582-49d7-bdf2-bd0d7173edd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:38.384413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:38.385479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:38.386441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:38.386441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:38.386441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:38.386441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:38.386441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 520/1063] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:38.391429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94047636-8582-49d7-bdf2-bd0d7173edd2 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:38.445830 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24970c73-d135-4be2-926c-46cffaca4c46 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:38.483202 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d0659-2216-4d2e-ba89-08d56c1c45b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:38.483860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d0659-2216-4d2e-ba89-08d56c1c45b5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:38.484145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d0659-2216-4d2e-ba89-08d56c1c45b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:38.484421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d0659-2216-4d2e-ba89-08d56c1c45b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:38.485275 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d0659-2216-4d2e-ba89-08d56c1c45b5 None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=0837dc899d4443d59818f0d805c43661, user.id=9461ea7e38bb4a758a6a1986b440c132) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:38.485588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d0659-2216-4d2e-ba89-08d56c1c45b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:38.487051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d0659-2216-4d2e-ba89-08d56c1c45b5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:38.492458 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 544/1064] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:11:38 2022] GET /identity/v3/role_assignments?user.id=9461ea7e38bb4a758a6a1986b440c132&scope.project.id=0837dc899d4443d59818f0d805c43661&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:38.493675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cbd60-6682-43ae-83b8-c3f3a354e609 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:38.493962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cbd60-6682-43ae-83b8-c3f3a354e609 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:38.494238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cbd60-6682-43ae-83b8-c3f3a354e609 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:38.495490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 545/1065] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:38.501875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235e9fc-0e72-4a05-bca3-856feaab63e5 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:38.502192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235e9fc-0e72-4a05-bca3-856feaab63e5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:38.502477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235e9fc-0e72-4a05-bca3-856feaab63e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:38.504327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94047636-8582-49d7-bdf2-bd0d7173edd2 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:38.521351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e235e9fc-0e72-4a05-bca3-856feaab63e5 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:38.522578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e235e9fc-0e72-4a05-bca3-856feaab63e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:38.537455 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:38.546771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574f8e2-3bf1-4b1f-8ab8-673315b7db70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:38.547503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574f8e2-3bf1-4b1f-8ab8-673315b7db70 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:38.551109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574f8e2-3bf1-4b1f-8ab8-673315b7db70 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:38.551109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574f8e2-3bf1-4b1f-8ab8-673315b7db70 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:38.551109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574f8e2-3bf1-4b1f-8ab8-673315b7db70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:38.551109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574f8e2-3bf1-4b1f-8ab8-673315b7db70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:38.551109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574f8e2-3bf1-4b1f-8ab8-673315b7db70 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:38.565176 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 521/1066] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:38.572259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574f8e2-3bf1-4b1f-8ab8-673315b7db70 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:38.605022 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 546/1067] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:38.627757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235e9fc-0e72-4a05-bca3-856feaab63e5 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:38.655267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:38.688390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574f8e2-3bf1-4b1f-8ab8-673315b7db70 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:38.730449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed01a24-ed75-4e87-a715-bb8ca821c08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:38.731242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed01a24-ed75-4e87-a715-bb8ca821c08c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:38.731526 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed01a24-ed75-4e87-a715-bb8ca821c08c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:38.731798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed01a24-ed75-4e87-a715-bb8ca821c08c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:38.732971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235e9fc-0e72-4a05-bca3-856feaab63e5 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:38.739986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed01a24-ed75-4e87-a715-bb8ca821c08c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:38.741606 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed01a24-ed75-4e87-a715-bb8ca821c08c None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-2ed01a24-ed75-4e87-a715-bb8ca821c08c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:11:38.757579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:38.758568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:38.759523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:38.759523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:38.759523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:11:38.759523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:11:38.759523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:11:38.759523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:11:38.759523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:11:38.759523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:11:38.759523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:11:38.759523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:38.759523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 522/1068] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 16:11:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:38.764368 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed01a24-ed75-4e87-a715-bb8ca821c08c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:38.771525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e89e75-5286-4fc2-a2a5-fd1ad46685b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:38.772185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e89e75-5286-4fc2-a2a5-fd1ad46685b5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:38.772473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e89e75-5286-4fc2-a2a5-fd1ad46685b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:38.772756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e89e75-5286-4fc2-a2a5-fd1ad46685b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:38.817553 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:38.842385 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e89e75-5286-4fc2-a2a5-fd1ad46685b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:38.843896 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e89e75-5286-4fc2-a2a5-fd1ad46685b5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:38.867761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:38.873279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed01a24-ed75-4e87-a715-bb8ca821c08c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:38.913996 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc13cf-cfa8-4f8a-9b6c-c1a6e0de4439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:38.914666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc13cf-cfa8-4f8a-9b6c-c1a6e0de4439 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:38.914948 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc13cf-cfa8-4f8a-9b6c-c1a6e0de4439 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:38.915221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc13cf-cfa8-4f8a-9b6c-c1a6e0de4439 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:38.916065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc13cf-cfa8-4f8a-9b6c-c1a6e0de4439 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:38.916374 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc13cf-cfa8-4f8a-9b6c-c1a6e0de4439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:38.918028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc13cf-cfa8-4f8a-9b6c-c1a6e0de4439 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:38.941163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 523/1069] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 16:11:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:38.942707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc13cf-cfa8-4f8a-9b6c-c1a6e0de4439 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:38.959503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 547/1070] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:11:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:11:38.965821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e89e75-5286-4fc2-a2a5-fd1ad46685b5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:39.049391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc13cf-cfa8-4f8a-9b6c-c1a6e0de4439 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:39.057313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:39.066740 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e89e75-5286-4fc2-a2a5-fd1ad46685b5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:39.084413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e2172-3e76-473d-bb73-1356f0539dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:39.085174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2172-3e76-473d-bb73-1356f0539dfe None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:39.085462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2172-3e76-473d-bb73-1356f0539dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:39.085740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2172-3e76-473d-bb73-1356f0539dfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:39.091277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:39.096342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e2172-3e76-473d-bb73-1356f0539dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:39.097849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e2172-3e76-473d-bb73-1356f0539dfe None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:39.104366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a14a6e-87a7-441e-ab03-1806582435af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:39.105395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a14a6e-87a7-441e-ab03-1806582435af None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:39.105925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a14a6e-87a7-441e-ab03-1806582435af None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:39.106367 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a14a6e-87a7-441e-ab03-1806582435af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-7f2e2172-3e76-473d-bb73-1356f0539dfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:39.116396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:39.117694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:39.118617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:39.118617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:39.118617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:39.118617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:39.118852 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a14a6e-87a7-441e-ab03-1806582435af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:39.118852 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a14a6e-87a7-441e-ab03-1806582435af None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:39.121254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 524/1071] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:39.123648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e2172-3e76-473d-bb73-1356f0539dfe None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-30a14a6e-87a7-441e-ab03-1806582435af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:39.139147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:39.140270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:39.141454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:39.141454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:39.141454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:39.141454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:39.143525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 548/1072] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:39.149314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a14a6e-87a7-441e-ab03-1806582435af None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:39.229960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e2172-3e76-473d-bb73-1356f0539dfe None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:39.261147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a14a6e-87a7-441e-ab03-1806582435af None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:39.264408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974462a-d211-40f6-908f-a7008f1bbfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:39.265069 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974462a-d211-40f6-908f-a7008f1bbfb3 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:39.265378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974462a-d211-40f6-908f-a7008f1bbfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:39.265655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974462a-d211-40f6-908f-a7008f1bbfb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:39.266367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974462a-d211-40f6-908f-a7008f1bbfb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:39.266674 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974462a-d211-40f6-908f-a7008f1bbfb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:39.268555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974462a-d211-40f6-908f-a7008f1bbfb3 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:39.281258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 525/1073] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:39.287429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974462a-d211-40f6-908f-a7008f1bbfb3 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:39.296332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f062-67c5-4b27-84b4-60d5e171e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:39.297002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f062-67c5-4b27-84b4-60d5e171e02a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:39.297330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f062-67c5-4b27-84b4-60d5e171e02a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:39.297608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f062-67c5-4b27-84b4-60d5e171e02a None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:39.298333 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f062-67c5-4b27-84b4-60d5e171e02a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:39.298866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f062-67c5-4b27-84b4-60d5e171e02a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:39.300043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f062-67c5-4b27-84b4-60d5e171e02a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:39.308194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:39.325149 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 549/1074] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:39.398811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974462a-d211-40f6-908f-a7008f1bbfb3 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:39.434563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b3eb7-3951-4758-ac86-71b5d8692a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:39.435366 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b3eb7-3951-4758-ac86-71b5d8692a98 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:39.435650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b3eb7-3951-4758-ac86-71b5d8692a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:39.435927 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b3eb7-3951-4758-ac86-71b5d8692a98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:39.444303 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b3eb7-3951-4758-ac86-71b5d8692a98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:39.445849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b3eb7-3951-4758-ac86-71b5d8692a98 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-1c3b3eb7-3951-4758-ac86-71b5d8692a98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:11:39.463868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:39.464791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:39.465740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:11:39.465740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:11:39.465740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:11:39.465740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:11:39.465740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:11:39.465740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:11:39.465740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:39.465740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:39.465740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 526/1075] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:39.471163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f062-67c5-4b27-84b4-60d5e171e02a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:39.507851 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:39.585427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f062-67c5-4b27-84b4-60d5e171e02a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:39.623474 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb46e8-e706-4b6f-8817-4ef55b4d4330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:39.624442 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb46e8-e706-4b6f-8817-4ef55b4d4330 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:39.624909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb46e8-e706-4b6f-8817-4ef55b4d4330 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:39.625417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb46e8-e706-4b6f-8817-4ef55b4d4330 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:39.626386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb46e8-e706-4b6f-8817-4ef55b4d4330 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:39.626885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb46e8-e706-4b6f-8817-4ef55b4d4330 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:39.628336 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb46e8-e706-4b6f-8817-4ef55b4d4330 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:39.642255 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 550/1076] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:11:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:39.648230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b3eb7-3951-4758-ac86-71b5d8692a98 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:39.726003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:39.746629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b3eb7-3951-4758-ac86-71b5d8692a98 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:39.780275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0ea18-e0bd-4c3f-85c9-bf55fd63a55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:39.781169 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0ea18-e0bd-4c3f-85c9-bf55fd63a55d None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:39.781461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0ea18-e0bd-4c3f-85c9-bf55fd63a55d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:39.781737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0ea18-e0bd-4c3f-85c9-bf55fd63a55d None admin] PATH_INFO: `/v3/projects/2101dde305df44bc90d33b01976e8265/users/f36355ce7ff841f3bd9e228fbad64a83/roles/d0229fddd2ba4c12ac455b83d2316347` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:39.784563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0ea18-e0bd-4c3f-85c9-bf55fd63a55d None admin] RBAC: Authorizing `identity:create_grant(project_id=2101dde305df44bc90d33b01976e8265, user_id=f36355ce7ff841f3bd9e228fbad64a83, role_id=d0229fddd2ba4c12ac455b83d2316347)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:39.786003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0ea18-e0bd-4c3f-85c9-bf55fd63a55d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:39.843842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 527/1077] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:11:39 2022] PUT /identity/v3/projects/2101dde305df44bc90d33b01976e8265/users/f36355ce7ff841f3bd9e228fbad64a83/roles/d0229fddd2ba4c12ac455b83d2316347 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:11:40.513618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15267cd-a51d-40de-960a-9ca9018aa70e None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:40.514130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15267cd-a51d-40de-960a-9ca9018aa70e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:40.514221 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15267cd-a51d-40de-960a-9ca9018aa70e None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:40.515698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 551/1078] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:40.520889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57419ae-b538-46b8-97d0-ecb7c39bda49 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:40.521425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57419ae-b538-46b8-97d0-ecb7c39bda49 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:40.521598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57419ae-b538-46b8-97d0-ecb7c39bda49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:40.537444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-c57419ae-b538-46b8-97d0-ecb7c39bda49 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:40.538631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c57419ae-b538-46b8-97d0-ecb7c39bda49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:40.603455 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 528/1079] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:40.625802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15267cd-a51d-40de-960a-9ca9018aa70e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:40.717286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:40.724621 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15267cd-a51d-40de-960a-9ca9018aa70e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:40.756066 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1ce36-6da7-40f1-a09d-df4e36c7f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:40.756851 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1ce36-6da7-40f1-a09d-df4e36c7f959 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:40.757155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1ce36-6da7-40f1-a09d-df4e36c7f959 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:40.757437 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1ce36-6da7-40f1-a09d-df4e36c7f959 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:40.768125 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1ce36-6da7-40f1-a09d-df4e36c7f959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-c9b1ce36-6da7-40f1-a09d-df4e36c7f959 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:40.775751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:40.776711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:40.777624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:40.777624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:40.777624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:40.777624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:40.777624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:40.777624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:40.777624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:40.777624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:40.777624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:40.777624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:40.777624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:11:40.777624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:40.777624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 552/1080] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:11:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:40.783832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57419ae-b538-46b8-97d0-ecb7c39bda49 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:40.848078 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:40.881649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57419ae-b538-46b8-97d0-ecb7c39bda49 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:40.915590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcc9a9-8a66-41bc-bf64-a077dee2d3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:40.916280 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcc9a9-8a66-41bc-bf64-a077dee2d3aa None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:40.916567 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcc9a9-8a66-41bc-bf64-a077dee2d3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:40.916844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcc9a9-8a66-41bc-bf64-a077dee2d3aa None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:40.917654 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfcc9a9-8a66-41bc-bf64-a077dee2d3aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:40.917965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfcc9a9-8a66-41bc-bf64-a077dee2d3aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:40.919372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfcc9a9-8a66-41bc-bf64-a077dee2d3aa None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:40.929523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 529/1081] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:11:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:40.936929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1ce36-6da7-40f1-a09d-df4e36c7f959 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:41.033459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1ce36-6da7-40f1-a09d-df4e36c7f959 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:41.065708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f872dc8-e90b-4fd9-8523-2cef4ec77939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:41.066572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f872dc8-e90b-4fd9-8523-2cef4ec77939 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:41.066856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f872dc8-e90b-4fd9-8523-2cef4ec77939 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:41.067132 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f872dc8-e90b-4fd9-8523-2cef4ec77939 None admin] PATH_INFO: `/v3/users/9461ea7e38bb4a758a6a1986b440c132` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:41.068303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f872dc8-e90b-4fd9-8523-2cef4ec77939 None admin] RBAC: Authorizing `identity:get_user(user_id=9461ea7e38bb4a758a6a1986b440c132)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:41.069771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f872dc8-e90b-4fd9-8523-2cef4ec77939 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:41.071397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 553/1082] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:11:40 2022] GET /identity/v3/users/9461ea7e38bb4a758a6a1986b440c132 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:41.077219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcc9a9-8a66-41bc-bf64-a077dee2d3aa None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:41.173443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcc9a9-8a66-41bc-bf64-a077dee2d3aa None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:41.201432 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:41.207576 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8d87c-e1b0-44fb-ad66-26677571922a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:41.208425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8d87c-e1b0-44fb-ad66-26677571922a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:41.211281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8d87c-e1b0-44fb-ad66-26677571922a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:41.211281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8d87c-e1b0-44fb-ad66-26677571922a None admin] PATH_INFO: `/v3/projects/0837dc899d4443d59818f0d805c43661` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:41.211281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8d87c-e1b0-44fb-ad66-26677571922a None admin] RBAC: Authorizing `identity:get_project(project_id=0837dc899d4443d59818f0d805c43661)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:41.211700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8d87c-e1b0-44fb-ad66-26677571922a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:41.213246 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 530/1083] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:11:41 2022] GET /identity/v3/projects/0837dc899d4443d59818f0d805c43661 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:41.219602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f872dc8-e90b-4fd9-8523-2cef4ec77939 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:41.244313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:41.320207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f872dc8-e90b-4fd9-8523-2cef4ec77939 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:41.353512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf349f2-b161-4e5e-976d-ebd4bb3bde05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:41.354397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf349f2-b161-4e5e-976d-ebd4bb3bde05 None admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:41.354680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf349f2-b161-4e5e-976d-ebd4bb3bde05 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:41.354957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf349f2-b161-4e5e-976d-ebd4bb3bde05 None admin] PATH_INFO: `/v3/projects/0837dc899d4443d59818f0d805c43661/users/9461ea7e38bb4a758a6a1986b440c132/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:41.356885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf349f2-b161-4e5e-976d-ebd4bb3bde05 None admin] RBAC: Authorizing `identity:create_grant(project_id=0837dc899d4443d59818f0d805c43661, user_id=9461ea7e38bb4a758a6a1986b440c132, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:41.358351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf349f2-b161-4e5e-976d-ebd4bb3bde05 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:41.414990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 554/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:11:41 2022] PUT /identity/v3/projects/0837dc899d4443d59818f0d805c43661/users/9461ea7e38bb4a758a6a1986b440c132/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:11:41.857432 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e086aec-e06a-4433-8a9d-cff21866ea2f None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:41.857958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e086aec-e06a-4433-8a9d-cff21866ea2f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:41.858073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e086aec-e06a-4433-8a9d-cff21866ea2f None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:41.859390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 531/1085] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:41.865243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c50ce-889b-45d9-8193-f429b5dbc57f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:41.865703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c50ce-889b-45d9-8193-f429b5dbc57f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:41.865798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c50ce-889b-45d9-8193-f429b5dbc57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:41.882053 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-5b2c50ce-889b-45d9-8193-f429b5dbc57f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:41.883234 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-5b2c50ce-889b-45d9-8193-f429b5dbc57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:41.949661 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 555/1086] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:41.973723 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e086aec-e06a-4433-8a9d-cff21866ea2f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:42.072293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e086aec-e06a-4433-8a9d-cff21866ea2f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:42.107157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311c579-a7ff-40ed-87ab-48ce26773459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:42.108031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c579-a7ff-40ed-87ab-48ce26773459 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:42.108259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c579-a7ff-40ed-87ab-48ce26773459 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:42.108535 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c579-a7ff-40ed-87ab-48ce26773459 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:42.118770 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311c579-a7ff-40ed-87ab-48ce26773459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-b311c579-a7ff-40ed-87ab-48ce26773459 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:42.126965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:42.128040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:42.128891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:42.128891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:42.128891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:42.128891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:42.128891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:42.128891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:42.128891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:42.128891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:42.128891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:42.128891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:42.128891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 16:11:42.128891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:42.128891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 532/1087] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Jul 12 16:11:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:42.134125 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c50ce-889b-45d9-8193-f429b5dbc57f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:42.148549 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:42.231598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c50ce-889b-45d9-8193-f429b5dbc57f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:42.263675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959223-dec7-4f52-87d2-957974e4dbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:42.264335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959223-dec7-4f52-87d2-957974e4dbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:42.264621 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959223-dec7-4f52-87d2-957974e4dbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:42.264899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959223-dec7-4f52-87d2-957974e4dbf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:42.265678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959223-dec7-4f52-87d2-957974e4dbf9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:42.265987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959223-dec7-4f52-87d2-957974e4dbf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:42.267895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959223-dec7-4f52-87d2-957974e4dbf9 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:42.275582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 556/1088] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 16:11:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:42.281254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311c579-a7ff-40ed-87ab-48ce26773459 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:42.338816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:42.379948 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311c579-a7ff-40ed-87ab-48ce26773459 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:42.412764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb455b9-26c3-4b36-b737-3878e02115ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:42.413571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb455b9-26c3-4b36-b737-3878e02115ce None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:42.413853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb455b9-26c3-4b36-b737-3878e02115ce None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:42.414125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb455b9-26c3-4b36-b737-3878e02115ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:42.424354 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb455b9-26c3-4b36-b737-3878e02115ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:42.425805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb455b9-26c3-4b36-b737-3878e02115ce None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-8cb455b9-26c3-4b36-b737-3878e02115ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:42.443200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:42.444328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:42.450025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:42.450025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:42.450025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:42.450025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:42.450025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 533/1089] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:42.450682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959223-dec7-4f52-87d2-957974e4dbf9 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:42.528051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:42.552036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959223-dec7-4f52-87d2-957974e4dbf9 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:42.587005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7e847-2ecb-4fce-86f4-3faf0d977afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:42.587667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7e847-2ecb-4fce-86f4-3faf0d977afb None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:42.587954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7e847-2ecb-4fce-86f4-3faf0d977afb None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:42.588235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7e847-2ecb-4fce-86f4-3faf0d977afb None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:42.588955 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7e847-2ecb-4fce-86f4-3faf0d977afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:42.589296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7e847-2ecb-4fce-86f4-3faf0d977afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:42.590665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7e847-2ecb-4fce-86f4-3faf0d977afb None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:42.602174 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 557/1090] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:42.607762 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb455b9-26c3-4b36-b737-3878e02115ce None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:42.707123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb455b9-26c3-4b36-b737-3878e02115ce None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:42.716855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:42.739563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd63a5-6390-4fba-a2f1-a30c28e20a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:42.740432 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd63a5-6390-4fba-a2f1-a30c28e20a07 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:42.740718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd63a5-6390-4fba-a2f1-a30c28e20a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:42.740997 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd63a5-6390-4fba-a2f1-a30c28e20a07 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:42.748247 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd63a5-6390-4fba-a2f1-a30c28e20a07 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:42.749713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd63a5-6390-4fba-a2f1-a30c28e20a07 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-53dd63a5-6390-4fba-a2f1-a30c28e20a07 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:11:42.764316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:42.765348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:42.766309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:42.766309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:42.766309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:11:42.766309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:11:42.766309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:11:42.766309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:11:42.766309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:11:42.766309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:11:42.766309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 16:11:42.766309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:42.769274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 534/1091] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 16:11:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:42.771161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7e847-2ecb-4fce-86f4-3faf0d977afb None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:42.866343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7e847-2ecb-4fce-86f4-3faf0d977afb None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:42.899829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87464601-51e2-4a45-bdd2-70b6b26184ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:42.900504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87464601-51e2-4a45-bdd2-70b6b26184ef None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:42.900829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87464601-51e2-4a45-bdd2-70b6b26184ef None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:42.901195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87464601-51e2-4a45-bdd2-70b6b26184ef None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:42.902040 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87464601-51e2-4a45-bdd2-70b6b26184ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:42.902354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87464601-51e2-4a45-bdd2-70b6b26184ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:42.903785 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87464601-51e2-4a45-bdd2-70b6b26184ef None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:42.905431 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:42.921416 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 558/1092] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 16:11:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:42.927825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd63a5-6390-4fba-a2f1-a30c28e20a07 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:43.025261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd63a5-6390-4fba-a2f1-a30c28e20a07 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:43.057734 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a0855-bd53-4ba0-bad6-fff774fce611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:43.058375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0855-bd53-4ba0-bad6-fff774fce611 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:43.058656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0855-bd53-4ba0-bad6-fff774fce611 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:43.058929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0855-bd53-4ba0-bad6-fff774fce611 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:43.097130 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:43.124565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a0855-bd53-4ba0-bad6-fff774fce611 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:43.126028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a0855-bd53-4ba0-bad6-fff774fce611 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:43.220188 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 535/1093] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:11:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:11:43.226417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87464601-51e2-4a45-bdd2-70b6b26184ef None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:43.322642 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87464601-51e2-4a45-bdd2-70b6b26184ef None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:43.355736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a88acd-32ab-48ee-a41e-ed1450ea5405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:43.356532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a88acd-32ab-48ee-a41e-ed1450ea5405 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:43.356819 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a88acd-32ab-48ee-a41e-ed1450ea5405 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:43.357097 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a88acd-32ab-48ee-a41e-ed1450ea5405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:43.367493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a88acd-32ab-48ee-a41e-ed1450ea5405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:43.368948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a88acd-32ab-48ee-a41e-ed1450ea5405 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-d4a88acd-32ab-48ee-a41e-ed1450ea5405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:11:43.386199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:43.387265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:43.392905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:11:43.392905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:11:43.392905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:11:43.392905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:43.392905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 559/1094] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:43.393209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a0855-bd53-4ba0-bad6-fff774fce611 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:43.420967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51064af-fdbb-4774-ab7e-79e0a496dd44 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:43.421282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51064af-fdbb-4774-ab7e-79e0a496dd44 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:43.421559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51064af-fdbb-4774-ab7e-79e0a496dd44 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:43.422929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 560/1095] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:11:43.428551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a65e6-3806-412a-bd21-8eec8ff08884 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:43.428839 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a65e6-3806-412a-bd21-8eec8ff08884 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:43.429144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a65e6-3806-412a-bd21-8eec8ff08884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:43.446678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-f26a65e6-3806-412a-bd21-8eec8ff08884 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:43.447909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f26a65e6-3806-412a-bd21-8eec8ff08884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:43.466433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:43.492720 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:43.496309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a0855-bd53-4ba0-bad6-fff774fce611 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:43.519489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 561/1096] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:11:43.530062 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9244ca-045b-4eaf-8c78-0917440db610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:43.530720 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9244ca-045b-4eaf-8c78-0917440db610 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:43.531006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9244ca-045b-4eaf-8c78-0917440db610 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:43.531285 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9244ca-045b-4eaf-8c78-0917440db610 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:43.532001 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9244ca-045b-4eaf-8c78-0917440db610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:43.532310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9244ca-045b-4eaf-8c78-0917440db610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:43.534247 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9244ca-045b-4eaf-8c78-0917440db610 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:43.543229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a65e6-3806-412a-bd21-8eec8ff08884 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:43.545564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 536/1097] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:43.551602 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9244ca-045b-4eaf-8c78-0917440db610 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:43.640641 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a65e6-3806-412a-bd21-8eec8ff08884 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:43.656238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9244ca-045b-4eaf-8c78-0917440db610 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:43.674219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360f4e7-8113-43ff-8a91-475a7e94c813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:43.675002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f4e7-8113-43ff-8a91-475a7e94c813 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:43.675284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f4e7-8113-43ff-8a91-475a7e94c813 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:43.675554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f4e7-8113-43ff-8a91-475a7e94c813 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:43.684832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:43.685533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360f4e7-8113-43ff-8a91-475a7e94c813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:11:43.691835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111893ac-1bbd-4b2e-b52c-9967c650262d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:43.692413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111893ac-1bbd-4b2e-b52c-9967c650262d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:43.692675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111893ac-1bbd-4b2e-b52c-9967c650262d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:43.692953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111893ac-1bbd-4b2e-b52c-9967c650262d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-f360f4e7-8113-43ff-8a91-475a7e94c813 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:11:43.694618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:43.695729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:43.696802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:43.696802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:43.696802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:43.696802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:43.696802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:11:43.696802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:11:43.696802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:11:43.696802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:11:43.696802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:11:43.696802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:11:43.696802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:11:43.696802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:11:43.696802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 562/1098] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:11:43.701867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360f4e7-8113-43ff-8a91-475a7e94c813 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:43.702798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111893ac-1bbd-4b2e-b52c-9967c650262d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:43.704261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111893ac-1bbd-4b2e-b52c-9967c650262d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-111893ac-1bbd-4b2e-b52c-9967c650262d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:11:43.719698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:11:43.720792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:11:43.726667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:11:43.726667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:11:43.726667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:11:43.726667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:11:43.726667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:11:43.726667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:11:43.726667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:11:43.726667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:11:43.726667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 537/1099] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:11:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:11:43.726667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111893ac-1bbd-4b2e-b52c-9967c650262d None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:43.735320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:43.802243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360f4e7-8113-43ff-8a91-475a7e94c813 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:43.824680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111893ac-1bbd-4b2e-b52c-9967c650262d None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:43.835516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9488ac-fa71-44e5-bf62-717a40260607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:43.836175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9488ac-fa71-44e5-bf62-717a40260607 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:43.836458 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9488ac-fa71-44e5-bf62-717a40260607 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:43.836731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9488ac-fa71-44e5-bf62-717a40260607 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:43.837507 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9488ac-fa71-44e5-bf62-717a40260607 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:43.837815 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9488ac-fa71-44e5-bf62-717a40260607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:43.839181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9488ac-fa71-44e5-bf62-717a40260607 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:43.848216 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 563/1100] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:11:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:43.853850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9488ac-fa71-44e5-bf62-717a40260607 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:43.858165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e637c-439e-4a39-9a70-9a6c53586d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:43.858819 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e637c-439e-4a39-9a70-9a6c53586d7f None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:43.859103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e637c-439e-4a39-9a70-9a6c53586d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:43.859380 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e637c-439e-4a39-9a70-9a6c53586d7f None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:43.860191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e637c-439e-4a39-9a70-9a6c53586d7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:43.860501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e637c-439e-4a39-9a70-9a6c53586d7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:43.862525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e637c-439e-4a39-9a70-9a6c53586d7f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:43.873940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 538/1101] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:11:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:43.882414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e637c-439e-4a39-9a70-9a6c53586d7f None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:43.931697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:43.952122 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:43.957679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9488ac-fa71-44e5-bf62-717a40260607 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:43.980823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e637c-439e-4a39-9a70-9a6c53586d7f None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:43.991068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dac426-0d62-4550-9504-6b950e7105ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:43.991981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dac426-0d62-4550-9504-6b950e7105ca None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:43.992263 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dac426-0d62-4550-9504-6b950e7105ca None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:43.992536 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dac426-0d62-4550-9504-6b950e7105ca None admin] PATH_INFO: `/v3/users/9461ea7e38bb4a758a6a1986b440c132` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:43.993757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dac426-0d62-4550-9504-6b950e7105ca None admin] RBAC: Authorizing `identity:get_user(user_id=9461ea7e38bb4a758a6a1986b440c132)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:43.995192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dac426-0d62-4550-9504-6b950e7105ca None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:43.996825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 564/1102] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:11:43 2022] GET /identity/v3/users/9461ea7e38bb4a758a6a1986b440c132 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:44.002650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dac426-0d62-4550-9504-6b950e7105ca None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:44.014327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8ff4-8332-4411-a5f9-9478dc0e3bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:44.015002 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8ff4-8332-4411-a5f9-9478dc0e3bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:44.015287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8ff4-8332-4411-a5f9-9478dc0e3bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:44.015565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8ff4-8332-4411-a5f9-9478dc0e3bb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:44.016395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde8ff4-8332-4411-a5f9-9478dc0e3bb1 None admin] RBAC: Adding query filter params (role.id=d0229fddd2ba4c12ac455b83d2316347, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=f36355ce7ff841f3bd9e228fbad64a83) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:44.016706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde8ff4-8332-4411-a5f9-9478dc0e3bb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:44.018177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde8ff4-8332-4411-a5f9-9478dc0e3bb1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:44.024119 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 539/1103] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:11:43 2022] GET /identity/v3/role_assignments?user.id=f36355ce7ff841f3bd9e228fbad64a83&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=d0229fddd2ba4c12ac455b83d2316347 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:44.106002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dac426-0d62-4550-9504-6b950e7105ca None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:44.141348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99646da-c4bd-4209-8baf-b5bd40e6af3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:44.142001 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99646da-c4bd-4209-8baf-b5bd40e6af3a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:44.142361 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99646da-c4bd-4209-8baf-b5bd40e6af3a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:44.142644 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99646da-c4bd-4209-8baf-b5bd40e6af3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:44.178443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:44.216525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99646da-c4bd-4209-8baf-b5bd40e6af3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:44.217946 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99646da-c4bd-4209-8baf-b5bd40e6af3a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:44.316656 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 565/1104] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:11:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 16:11:44.322527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8ff4-8332-4411-a5f9-9478dc0e3bb1 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:44.426004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8ff4-8332-4411-a5f9-9478dc0e3bb1 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:44.440318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:44.461238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfd8d1-6077-4d62-9579-f3c82054333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:44.462107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfd8d1-6077-4d62-9579-f3c82054333e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:44.462385 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfd8d1-6077-4d62-9579-f3c82054333e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:44.462655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfd8d1-6077-4d62-9579-f3c82054333e None admin] PATH_INFO: `/v3/projects/0837dc899d4443d59818f0d805c43661` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:44.463959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfd8d1-6077-4d62-9579-f3c82054333e None admin] RBAC: Authorizing `identity:get_project(project_id=0837dc899d4443d59818f0d805c43661)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:44.465459 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfd8d1-6077-4d62-9579-f3c82054333e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:44.467669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 540/1105] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:11:44 2022] GET /identity/v3/projects/0837dc899d4443d59818f0d805c43661 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:44.473448 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99646da-c4bd-4209-8baf-b5bd40e6af3a None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:44.537432 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:44.576313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99646da-c4bd-4209-8baf-b5bd40e6af3a None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:44.611016 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53293dfb-9371-44de-8553-505944956717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:44.612203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53293dfb-9371-44de-8553-505944956717 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:44.612489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53293dfb-9371-44de-8553-505944956717 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:44.612766 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53293dfb-9371-44de-8553-505944956717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:44.613632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53293dfb-9371-44de-8553-505944956717 None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=0837dc899d4443d59818f0d805c43661, user.id=9461ea7e38bb4a758a6a1986b440c132) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:44.613946 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53293dfb-9371-44de-8553-505944956717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:44.615383 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53293dfb-9371-44de-8553-505944956717 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:44.621495 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 566/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:11:44 2022] GET /identity/v3/role_assignments?user.id=9461ea7e38bb4a758a6a1986b440c132&scope.project.id=0837dc899d4443d59818f0d805c43661&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:46.664319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cb7fc-ca6f-435c-8096-5529eb41a130 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:46.664837 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cb7fc-ca6f-435c-8096-5529eb41a130 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:46.664958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cb7fc-ca6f-435c-8096-5529eb41a130 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:46.666308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 541/1107] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:46.671504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bc459-fa01-40c1-8d93-7f2b9953d344 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:46.671897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bc459-fa01-40c1-8d93-7f2b9953d344 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:46.672061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bc459-fa01-40c1-8d93-7f2b9953d344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:46.688668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a24bc459-fa01-40c1-8d93-7f2b9953d344 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:46.689850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a24bc459-fa01-40c1-8d93-7f2b9953d344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:46.753543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 567/1108] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:46.777730 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cb7fc-ca6f-435c-8096-5529eb41a130 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:46.876209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cb7fc-ca6f-435c-8096-5529eb41a130 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:46.909284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcdda4-833f-4c8d-b22d-26d4eadb9786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:46.910098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcdda4-833f-4c8d-b22d-26d4eadb9786 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:46.910385 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcdda4-833f-4c8d-b22d-26d4eadb9786 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:46.910701 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcdda4-833f-4c8d-b22d-26d4eadb9786 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:46.911857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcdda4-833f-4c8d-b22d-26d4eadb9786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:46.914183 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcdda4-833f-4c8d-b22d-26d4eadb9786 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:46.915017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 542/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:46.921504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bc459-fa01-40c1-8d93-7f2b9953d344 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:46.978287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:47.018845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bc459-fa01-40c1-8d93-7f2b9953d344 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:47.051311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc212e5e-e39b-4f99-85c8-8094f372c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:47.051966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc212e5e-e39b-4f99-85c8-8094f372c1aa None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:47.057502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc212e5e-e39b-4f99-85c8-8094f372c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:47.057502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc212e5e-e39b-4f99-85c8-8094f372c1aa None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:47.057502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc212e5e-e39b-4f99-85c8-8094f372c1aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:47.057502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc212e5e-e39b-4f99-85c8-8094f372c1aa None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:47.135652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 568/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:11:46 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:11:49.212368 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ca826-6f24-4d32-a4d1-2df736090878 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:49.212956 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ca826-6f24-4d32-a4d1-2df736090878 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:49.212956 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ca826-6f24-4d32-a4d1-2df736090878 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:49.214340 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 543/1111] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:49.219562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565e1fc-a3c0-45f1-a045-e50c5fb8abd8 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:49.219975 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565e1fc-a3c0-45f1-a045-e50c5fb8abd8 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:49.220126 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565e1fc-a3c0-45f1-a045-e50c5fb8abd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:49.237637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-6565e1fc-a3c0-45f1-a045-e50c5fb8abd8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:49.238808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-6565e1fc-a3c0-45f1-a045-e50c5fb8abd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:49.303160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 569/1112] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:49.326422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ca826-6f24-4d32-a4d1-2df736090878 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:49.375903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:49.425537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ca826-6f24-4d32-a4d1-2df736090878 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:49.459279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc65c62-301d-4931-ac80-81391193e226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:49.460136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc65c62-301d-4931-ac80-81391193e226 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:49.460419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc65c62-301d-4931-ac80-81391193e226 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:49.460692 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc65c62-301d-4931-ac80-81391193e226 None admin] PATH_INFO: `/v3/roles/8eb72f5f99cf44e09c674c32be4bbb9d` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:49.462145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc65c62-301d-4931-ac80-81391193e226 None admin] RBAC: Authorizing `identity:get_role(role_id=8eb72f5f99cf44e09c674c32be4bbb9d)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:49.463619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc65c62-301d-4931-ac80-81391193e226 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:49.464940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 544/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:11:49 2022] GET /identity/v3/roles/8eb72f5f99cf44e09c674c32be4bbb9d => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:49.471405 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565e1fc-a3c0-45f1-a045-e50c5fb8abd8 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:49.514358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:49.568047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565e1fc-a3c0-45f1-a045-e50c5fb8abd8 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:49.601027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fffe8-c09d-497a-af78-cd796cbe53d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:49.609477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fffe8-c09d-497a-af78-cd796cbe53d1 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:49.610005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fffe8-c09d-497a-af78-cd796cbe53d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:49.610294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fffe8-c09d-497a-af78-cd796cbe53d1 None admin] PATH_INFO: `/v3/users/d4c1b660fd8e425bb1bf54ae9e869715` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:49.623555 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fffe8-c09d-497a-af78-cd796cbe53d1 None admin] RBAC: Authorizing `identity:get_user(user_id=d4c1b660fd8e425bb1bf54ae9e869715)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:49.625003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fffe8-c09d-497a-af78-cd796cbe53d1 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:49.626714 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 570/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:11:49 2022] GET /identity/v3/users/d4c1b660fd8e425bb1bf54ae9e869715 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:49.632473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc65c62-301d-4931-ac80-81391193e226 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:49.730478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc65c62-301d-4931-ac80-81391193e226 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:49.746846 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:49.763504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcddbd-42f8-49b7-80cc-7fadefd23a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:49.764139 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcddbd-42f8-49b7-80cc-7fadefd23a93 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:49.764425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcddbd-42f8-49b7-80cc-7fadefd23a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:49.764705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcddbd-42f8-49b7-80cc-7fadefd23a93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:49.829579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcddbd-42f8-49b7-80cc-7fadefd23a93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:49.831003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcddbd-42f8-49b7-80cc-7fadefd23a93 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:49.926076 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 545/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:11:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:11:49.932057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fffe8-c09d-497a-af78-cd796cbe53d1 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:50.025945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fffe8-c09d-497a-af78-cd796cbe53d1 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:50.027380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:50.058680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747c512-2612-459f-a771-74dba0ae20b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:50.059527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747c512-2612-459f-a771-74dba0ae20b7 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:50.060015 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747c512-2612-459f-a771-74dba0ae20b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:50.060459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747c512-2612-459f-a771-74dba0ae20b7 None admin] PATH_INFO: `/v3/projects/0837dc899d4443d59818f0d805c43661` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:50.061942 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747c512-2612-459f-a771-74dba0ae20b7 None admin] RBAC: Authorizing `identity:get_project(project_id=0837dc899d4443d59818f0d805c43661)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:50.063622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747c512-2612-459f-a771-74dba0ae20b7 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:50.065341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 571/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:11:49 2022] GET /identity/v3/projects/0837dc899d4443d59818f0d805c43661 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:50.071417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcddbd-42f8-49b7-80cc-7fadefd23a93 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:50.089107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:50.166297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcddbd-42f8-49b7-80cc-7fadefd23a93 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:50.198891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67ebaf-b594-40c4-afbe-6b25a0174f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:50.199525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67ebaf-b594-40c4-afbe-6b25a0174f0d None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:50.199810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67ebaf-b594-40c4-afbe-6b25a0174f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:50.200082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67ebaf-b594-40c4-afbe-6b25a0174f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:50.200905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67ebaf-b594-40c4-afbe-6b25a0174f0d None admin] RBAC: Adding query filter params (role.id=8eb72f5f99cf44e09c674c32be4bbb9d, scope.project.id=0837dc899d4443d59818f0d805c43661, user.id=d4c1b660fd8e425bb1bf54ae9e869715) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:50.201244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67ebaf-b594-40c4-afbe-6b25a0174f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:50.202648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67ebaf-b594-40c4-afbe-6b25a0174f0d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:50.208414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 546/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:11:50 2022] GET /identity/v3/role_assignments?user.id=d4c1b660fd8e425bb1bf54ae9e869715&scope.project.id=0837dc899d4443d59818f0d805c43661&role.id=8eb72f5f99cf44e09c674c32be4bbb9d => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:52.197400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b6130-df33-4bbc-8db5-db83c8e48205 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:52.197927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b6130-df33-4bbc-8db5-db83c8e48205 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:52.197927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b6130-df33-4bbc-8db5-db83c8e48205 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:52.199308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 572/1118] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:52.204415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f8066-9cfe-4ec4-b73b-379fdad69a1f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:52.204801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f8066-9cfe-4ec4-b73b-379fdad69a1f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:52.204986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f8066-9cfe-4ec4-b73b-379fdad69a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:52.221852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-6b1f8066-9cfe-4ec4-b73b-379fdad69a1f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:52.223039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6b1f8066-9cfe-4ec4-b73b-379fdad69a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:52.287563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 547/1119] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:52.309854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b6130-df33-4bbc-8db5-db83c8e48205 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:52.407612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b6130-df33-4bbc-8db5-db83c8e48205 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:52.440920 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df053a-4f33-406d-8f25-cbd03bbaf67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:52.441779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df053a-4f33-406d-8f25-cbd03bbaf67f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:52.442057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df053a-4f33-406d-8f25-cbd03bbaf67f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:52.442325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df053a-4f33-406d-8f25-cbd03bbaf67f None admin] PATH_INFO: `/v3/roles/8eb72f5f99cf44e09c674c32be4bbb9d` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:52.443758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df053a-4f33-406d-8f25-cbd03bbaf67f None admin] RBAC: Authorizing `identity:get_role(role_id=8eb72f5f99cf44e09c674c32be4bbb9d)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:52.445126 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df053a-4f33-406d-8f25-cbd03bbaf67f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:52.446477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 573/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:11:52 2022] GET /identity/v3/roles/8eb72f5f99cf44e09c674c32be4bbb9d => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:52.452377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f8066-9cfe-4ec4-b73b-379fdad69a1f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:52.466425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:52.548312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f8066-9cfe-4ec4-b73b-379fdad69a1f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:52.581722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7e5db-1f05-4420-b075-e365fa7e8ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:52.582581 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7e5db-1f05-4420-b075-e365fa7e8ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:52.582866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7e5db-1f05-4420-b075-e365fa7e8ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:52.583142 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7e5db-1f05-4420-b075-e365fa7e8ea4 None admin] PATH_INFO: `/v3/users/d4c1b660fd8e425bb1bf54ae9e869715` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:52.584310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7e5db-1f05-4420-b075-e365fa7e8ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=d4c1b660fd8e425bb1bf54ae9e869715)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:52.585764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7e5db-1f05-4420-b075-e365fa7e8ea4 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:52.587373 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 548/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:11:52 2022] GET /identity/v3/users/d4c1b660fd8e425bb1bf54ae9e869715 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:11:52.593427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df053a-4f33-406d-8f25-cbd03bbaf67f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:52.632640 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:52.689470 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df053a-4f33-406d-8f25-cbd03bbaf67f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:52.722023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd0217-c39b-4eab-8f1a-4e2b282598f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:52.722809 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd0217-c39b-4eab-8f1a-4e2b282598f1 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:52.723090 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd0217-c39b-4eab-8f1a-4e2b282598f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:52.723363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd0217-c39b-4eab-8f1a-4e2b282598f1 None admin] PATH_INFO: `/v3/projects/0837dc899d4443d59818f0d805c43661` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:52.724528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd0217-c39b-4eab-8f1a-4e2b282598f1 None admin] RBAC: Authorizing `identity:get_project(project_id=0837dc899d4443d59818f0d805c43661)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:52.725985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd0217-c39b-4eab-8f1a-4e2b282598f1 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:52.727646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 574/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:11:52 2022] GET /identity/v3/projects/0837dc899d4443d59818f0d805c43661 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:52.733486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7e5db-1f05-4420-b075-e365fa7e8ea4 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:52.813482 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:52.831417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7e5db-1f05-4420-b075-e365fa7e8ea4 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:52.864894 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1ac71-dc71-4f10-a32f-7ef76944d41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:52.865786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1ac71-dc71-4f10-a32f-7ef76944d41e None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:52.866070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1ac71-dc71-4f10-a32f-7ef76944d41e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:52.866342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1ac71-dc71-4f10-a32f-7ef76944d41e None admin] PATH_INFO: `/v3/projects/0837dc899d4443d59818f0d805c43661/users/d4c1b660fd8e425bb1bf54ae9e869715/roles/8eb72f5f99cf44e09c674c32be4bbb9d` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:52.868492 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1ac71-dc71-4f10-a32f-7ef76944d41e None admin] RBAC: Authorizing `identity:create_grant(project_id=0837dc899d4443d59818f0d805c43661, user_id=d4c1b660fd8e425bb1bf54ae9e869715, role_id=8eb72f5f99cf44e09c674c32be4bbb9d)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:52.869929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1ac71-dc71-4f10-a32f-7ef76944d41e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:52.923547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 549/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:11:52 2022] PUT /identity/v3/projects/0837dc899d4443d59818f0d805c43661/users/d4c1b660fd8e425bb1bf54ae9e869715/roles/8eb72f5f99cf44e09c674c32be4bbb9d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:11:54.911732 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536ebc-effb-4750-9230-9b30006f16c4 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:54.912280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536ebc-effb-4750-9230-9b30006f16c4 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:54.912280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536ebc-effb-4750-9230-9b30006f16c4 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:54.913676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 575/1124] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:54.918943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc31024-c454-43ba-91f2-3fbf87fa0bb8 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:54.919408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc31024-c454-43ba-91f2-3fbf87fa0bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:54.919583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc31024-c454-43ba-91f2-3fbf87fa0bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:54.936995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-ecc31024-c454-43ba-91f2-3fbf87fa0bb8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:54.938482 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-ecc31024-c454-43ba-91f2-3fbf87fa0bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:55.002656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 550/1125] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:55.025476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01536ebc-effb-4750-9230-9b30006f16c4 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:55.122526 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01536ebc-effb-4750-9230-9b30006f16c4 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:55.130057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:55.155120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035e3e3-a1e3-494e-8957-a375b0305c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:55.155951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035e3e3-a1e3-494e-8957-a375b0305c55 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:55.156231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035e3e3-a1e3-494e-8957-a375b0305c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:55.156502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035e3e3-a1e3-494e-8957-a375b0305c55 None admin] PATH_INFO: `/v3/roles/8eb72f5f99cf44e09c674c32be4bbb9d` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:55.158230 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035e3e3-a1e3-494e-8957-a375b0305c55 None admin] RBAC: Authorizing `identity:get_role(role_id=8eb72f5f99cf44e09c674c32be4bbb9d)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:55.160065 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035e3e3-a1e3-494e-8957-a375b0305c55 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:55.161487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 576/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:11:55 2022] GET /identity/v3/roles/8eb72f5f99cf44e09c674c32be4bbb9d => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:55.167097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc31024-c454-43ba-91f2-3fbf87fa0bb8 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:55.233617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:55.263345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc31024-c454-43ba-91f2-3fbf87fa0bb8 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:55.295976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23c3dc-74a2-40c2-ae1a-a4f730926d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:55.296829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c3dc-74a2-40c2-ae1a-a4f730926d96 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:55.297140 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c3dc-74a2-40c2-ae1a-a4f730926d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:55.297409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c3dc-74a2-40c2-ae1a-a4f730926d96 None admin] PATH_INFO: `/v3/users/d4c1b660fd8e425bb1bf54ae9e869715` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:55.298565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23c3dc-74a2-40c2-ae1a-a4f730926d96 None admin] RBAC: Authorizing `identity:get_user(user_id=d4c1b660fd8e425bb1bf54ae9e869715)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:55.299967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23c3dc-74a2-40c2-ae1a-a4f730926d96 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:55.301593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 551/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:11:55 2022] GET /identity/v3/users/d4c1b660fd8e425bb1bf54ae9e869715 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:55.307220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035e3e3-a1e3-494e-8957-a375b0305c55 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:55.403544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035e3e3-a1e3-494e-8957-a375b0305c55 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:55.447680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429df23f-b843-460b-8937-68fb39435797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:55.447680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429df23f-b843-460b-8937-68fb39435797 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:55.447680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429df23f-b843-460b-8937-68fb39435797 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:55.447680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429df23f-b843-460b-8937-68fb39435797 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:55.489296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:55.513310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429df23f-b843-460b-8937-68fb39435797 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:55.514772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429df23f-b843-460b-8937-68fb39435797 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:55.608084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 577/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:11:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 16:11:55.614390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23c3dc-74a2-40c2-ae1a-a4f730926d96 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:55.711171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23c3dc-74a2-40c2-ae1a-a4f730926d96 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:55.743695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e32c5-f0b7-4ef5-9aec-8c8b9626aa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:55.744540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e32c5-f0b7-4ef5-9aec-8c8b9626aa26 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:55.744826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e32c5-f0b7-4ef5-9aec-8c8b9626aa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:55.745102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e32c5-f0b7-4ef5-9aec-8c8b9626aa26 None admin] PATH_INFO: `/v3/projects/0837dc899d4443d59818f0d805c43661` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:55.746299 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e32c5-f0b7-4ef5-9aec-8c8b9626aa26 None admin] RBAC: Authorizing `identity:get_project(project_id=0837dc899d4443d59818f0d805c43661)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:55.747714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e32c5-f0b7-4ef5-9aec-8c8b9626aa26 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:55.749436 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 552/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:11:55 2022] GET /identity/v3/projects/0837dc899d4443d59818f0d805c43661 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:55.756012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429df23f-b843-460b-8937-68fb39435797 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:55.827360 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:55.851139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429df23f-b843-460b-8937-68fb39435797 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:55.883503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679cba3-5dd7-485a-b433-05a7cb00fe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:55.884138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679cba3-5dd7-485a-b433-05a7cb00fe32 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:55.884419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679cba3-5dd7-485a-b433-05a7cb00fe32 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:55.884693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679cba3-5dd7-485a-b433-05a7cb00fe32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:55.885542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679cba3-5dd7-485a-b433-05a7cb00fe32 None admin] RBAC: Adding query filter params (role.id=8eb72f5f99cf44e09c674c32be4bbb9d, scope.project.id=0837dc899d4443d59818f0d805c43661, user.id=d4c1b660fd8e425bb1bf54ae9e869715) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:11:55.885856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679cba3-5dd7-485a-b433-05a7cb00fe32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:55.887284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679cba3-5dd7-485a-b433-05a7cb00fe32 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:55.892909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 578/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:11:55 2022] GET /identity/v3/role_assignments?user.id=d4c1b660fd8e425bb1bf54ae9e869715&scope.project.id=0837dc899d4443d59818f0d805c43661&role.id=8eb72f5f99cf44e09c674c32be4bbb9d => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:57.911477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb8a1c-eeb5-4d5c-9d23-dec5cd7df9b8 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:57.912029 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb8a1c-eeb5-4d5c-9d23-dec5cd7df9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:57.912029 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb8a1c-eeb5-4d5c-9d23-dec5cd7df9b8 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:57.913409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 553/1131] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:11:57.918439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bff5f4-43be-4684-9d3c-53fc372dcac1 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:57.918806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bff5f4-43be-4684-9d3c-53fc372dcac1 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:57.918999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bff5f4-43be-4684-9d3c-53fc372dcac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:57.935395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-34bff5f4-43be-4684-9d3c-53fc372dcac1 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:11:57.936594 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-34bff5f4-43be-4684-9d3c-53fc372dcac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:11:58.001134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 579/1132] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:11:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:11:58.024907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb8a1c-eeb5-4d5c-9d23-dec5cd7df9b8 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:58.034237 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:58.123220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb8a1c-eeb5-4d5c-9d23-dec5cd7df9b8 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:58.156082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a72d0-55cb-4232-b305-20816b455bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:58.156857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a72d0-55cb-4232-b305-20816b455bfb None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:58.157161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a72d0-55cb-4232-b305-20816b455bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:58.157442 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a72d0-55cb-4232-b305-20816b455bfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:58.158624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a72d0-55cb-4232-b305-20816b455bfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:58.160036 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a72d0-55cb-4232-b305-20816b455bfb None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:58.161699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 554/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:11:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:11:58.167351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bff5f4-43be-4684-9d3c-53fc372dcac1 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:11:58.230929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:11:58.263956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bff5f4-43be-4684-9d3c-53fc372dcac1 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:11:58.296141 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24d432-ac25-4321-a0a6-410906ee9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:11:58.296791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24d432-ac25-4321-a0a6-410906ee9374 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:11:58.297077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24d432-ac25-4321-a0a6-410906ee9374 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:11:58.297385 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24d432-ac25-4321-a0a6-410906ee9374 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:11:58.298087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24d432-ac25-4321-a0a6-410906ee9374 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:11:58.299532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24d432-ac25-4321-a0a6-410906ee9374 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:11:58.415795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 580/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:11:58 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:12:00.442161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da635f-6fb7-4624-a726-119a6e67e832 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:00.442703 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da635f-6fb7-4624-a726-119a6e67e832 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:00.442703 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da635f-6fb7-4624-a726-119a6e67e832 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:00.444095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 555/1135] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:12:00.449265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b9374-34fa-4002-a936-ea050786e1cb None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:00.449683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b9374-34fa-4002-a936-ea050786e1cb None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:00.449833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b9374-34fa-4002-a936-ea050786e1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:00.466844 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-9a3b9374-34fa-4002-a936-ea050786e1cb None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:12:00.468036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9a3b9374-34fa-4002-a936-ea050786e1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:12:00.532634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 581/1136] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:12:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:12:00.556623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da635f-6fb7-4624-a726-119a6e67e832 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:00.630124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:00.655316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da635f-6fb7-4624-a726-119a6e67e832 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:00.688699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e1388-f237-46ea-a039-ee5745f0b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:00.690118 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e1388-f237-46ea-a039-ee5745f0b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:00.690399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e1388-f237-46ea-a039-ee5745f0b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:00.690671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e1388-f237-46ea-a039-ee5745f0b0b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:00.691813 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e1388-f237-46ea-a039-ee5745f0b0b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:00.693311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e1388-f237-46ea-a039-ee5745f0b0b8 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:00.694847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 556/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:12:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:00.700455 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b9374-34fa-4002-a936-ea050786e1cb None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:00.747924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:00.794867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b9374-34fa-4002-a936-ea050786e1cb None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:00.827816 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aab45-7f20-4c71-bb98-4c3c0f5a2f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:00.828473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aab45-7f20-4c71-bb98-4c3c0f5a2f07 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:00.828753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aab45-7f20-4c71-bb98-4c3c0f5a2f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:00.829024 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aab45-7f20-4c71-bb98-4c3c0f5a2f07 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:00.829754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30aab45-7f20-4c71-bb98-4c3c0f5a2f07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:00.831309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30aab45-7f20-4c71-bb98-4c3c0f5a2f07 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:00.929562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 582/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:12:00 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:12:02.992416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278509c6-f7d1-4f2e-8d76-26a578626c3b None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:02.992944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278509c6-f7d1-4f2e-8d76-26a578626c3b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:02.992944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278509c6-f7d1-4f2e-8d76-26a578626c3b None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:02.994374 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 557/1139] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:12:02.999349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d448cc6-2850-40e0-b607-f6fe093291e6 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:02.999760 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d448cc6-2850-40e0-b607-f6fe093291e6 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:02.999914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d448cc6-2850-40e0-b607-f6fe093291e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:03.016239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-3d448cc6-2850-40e0-b607-f6fe093291e6 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:12:03.017955 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3d448cc6-2850-40e0-b607-f6fe093291e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:12:03.082291 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 583/1140] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:12:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:12:03.105875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278509c6-f7d1-4f2e-8d76-26a578626c3b None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:03.203672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278509c6-f7d1-4f2e-8d76-26a578626c3b None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:03.236969 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c275fc-68e8-40f2-9690-3d2df6fb0284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:03.237771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c275fc-68e8-40f2-9690-3d2df6fb0284 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:03.238056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c275fc-68e8-40f2-9690-3d2df6fb0284 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:03.238331 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c275fc-68e8-40f2-9690-3d2df6fb0284 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:03.248119 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c275fc-68e8-40f2-9690-3d2df6fb0284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-60c275fc-68e8-40f2-9690-3d2df6fb0284 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:12:03.255616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:12:03.256800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:12:03.257985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:12:03.257985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:12:03.257985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:12:03.257985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:12:03.257985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:12:03.257985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:12:03.257985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:12:03.257985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:12:03.257985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:12:03.257985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:12:03.257985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:12:03.257985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:12:03.257985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 558/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:12:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:12:03.262509 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d448cc6-2850-40e0-b607-f6fe093291e6 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:03.296489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:03.358666 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d448cc6-2850-40e0-b607-f6fe093291e6 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:03.392196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562c38d-06f6-476b-b0e9-67489f903ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:03.393487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562c38d-06f6-476b-b0e9-67489f903ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:03.393768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562c38d-06f6-476b-b0e9-67489f903ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:03.394043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562c38d-06f6-476b-b0e9-67489f903ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:03.394781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562c38d-06f6-476b-b0e9-67489f903ee5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:12:03.395087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562c38d-06f6-476b-b0e9-67489f903ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:03.396448 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562c38d-06f6-476b-b0e9-67489f903ee5 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:03.404382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 584/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:12:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:03.410037 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c275fc-68e8-40f2-9690-3d2df6fb0284 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:03.412830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:03.510881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c275fc-68e8-40f2-9690-3d2df6fb0284 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:03.542973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c84fb-a759-45da-ad8c-c372bad94f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:03.543838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c84fb-a759-45da-ad8c-c372bad94f1c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:03.544129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c84fb-a759-45da-ad8c-c372bad94f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:03.544406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c84fb-a759-45da-ad8c-c372bad94f1c None admin] PATH_INFO: `/v3/users/23ea76193145404ca5c77476ac2ce7ad` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:03.557683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c84fb-a759-45da-ad8c-c372bad94f1c None admin] RBAC: Authorizing `identity:get_user(user_id=23ea76193145404ca5c77476ac2ce7ad)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:03.559106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c84fb-a759-45da-ad8c-c372bad94f1c None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:03.560747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 559/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:12:03 2022] GET /identity/v3/users/23ea76193145404ca5c77476ac2ce7ad => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:03.566730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562c38d-06f6-476b-b0e9-67489f903ee5 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:03.659754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:03.663379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562c38d-06f6-476b-b0e9-67489f903ee5 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:03.696106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efc269-3de4-4cd0-8189-0a43f20dcbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:03.696755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efc269-3de4-4cd0-8189-0a43f20dcbfa None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:03.697021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efc269-3de4-4cd0-8189-0a43f20dcbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:03.697324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efc269-3de4-4cd0-8189-0a43f20dcbfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:03.761254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efc269-3de4-4cd0-8189-0a43f20dcbfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:03.762638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efc269-3de4-4cd0-8189-0a43f20dcbfa None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:03.852777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:03.857109 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 585/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:12:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:12:03.862972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c84fb-a759-45da-ad8c-c372bad94f1c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:03.920536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:03.959104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c84fb-a759-45da-ad8c-c372bad94f1c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:03.992187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e3f49-e4c7-4024-aeaa-013f8032e7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:03.993035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e3f49-e4c7-4024-aeaa-013f8032e7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:03.993608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e3f49-e4c7-4024-aeaa-013f8032e7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:03.993608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e3f49-e4c7-4024-aeaa-013f8032e7c5 None admin] PATH_INFO: `/v3/projects/05250349eabc46a7b590d2d31bbfeb47` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:03.994832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e3f49-e4c7-4024-aeaa-013f8032e7c5 None admin] RBAC: Authorizing `identity:get_project(project_id=05250349eabc46a7b590d2d31bbfeb47)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:03.996246 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e3f49-e4c7-4024-aeaa-013f8032e7c5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:03.997963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 560/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:12:03 2022] GET /identity/v3/projects/05250349eabc46a7b590d2d31bbfeb47 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:04.003929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efc269-3de4-4cd0-8189-0a43f20dcbfa None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:04.100133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efc269-3de4-4cd0-8189-0a43f20dcbfa None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:04.132794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a8e85-4869-447e-9d70-7d94fb61868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:04.133459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a8e85-4869-447e-9d70-7d94fb61868f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:04.133737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a8e85-4869-447e-9d70-7d94fb61868f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:04.134006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a8e85-4869-447e-9d70-7d94fb61868f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:04.134825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a8e85-4869-447e-9d70-7d94fb61868f None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=05250349eabc46a7b590d2d31bbfeb47, user.id=23ea76193145404ca5c77476ac2ce7ad) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:12:04.135129 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a8e85-4869-447e-9d70-7d94fb61868f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:04.136555 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a8e85-4869-447e-9d70-7d94fb61868f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:04.141798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 586/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:12:04 2022] GET /identity/v3/role_assignments?user.id=23ea76193145404ca5c77476ac2ce7ad&scope.project.id=05250349eabc46a7b590d2d31bbfeb47&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:06.133348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acca53-fb62-4e2c-ae40-2a518fc37aa4 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:06.133881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acca53-fb62-4e2c-ae40-2a518fc37aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:06.133972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acca53-fb62-4e2c-ae40-2a518fc37aa4 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:06.135292 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 561/1147] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:12:06.140408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d7c57-239a-4381-a0f4-d22b10bbaa92 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:06.140852 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d7c57-239a-4381-a0f4-d22b10bbaa92 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:06.140976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d7c57-239a-4381-a0f4-d22b10bbaa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:06.157722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-aa7d7c57-239a-4381-a0f4-d22b10bbaa92 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:12:06.159521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-aa7d7c57-239a-4381-a0f4-d22b10bbaa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:12:06.213739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:06.224023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 587/1148] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:12:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:12:06.246797 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acca53-fb62-4e2c-ae40-2a518fc37aa4 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:06.344871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acca53-fb62-4e2c-ae40-2a518fc37aa4 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:06.371037 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:06.378459 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0e650-5900-4714-8ee4-8f7cfe84e759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:06.379244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0e650-5900-4714-8ee4-8f7cfe84e759 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:06.379527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0e650-5900-4714-8ee4-8f7cfe84e759 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:06.379805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0e650-5900-4714-8ee4-8f7cfe84e759 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:06.389717 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0e650-5900-4714-8ee4-8f7cfe84e759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-06a0e650-5900-4714-8ee4-8f7cfe84e759 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:12:06.397468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:12:06.398611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:12:06.399625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:12:06.399625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:12:06.399625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:12:06.399625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:12:06.399625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:12:06.399625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:12:06.399625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:12:06.399625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:12:06.399625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:12:06.399625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:12:06.399625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:12:06.399625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:12:06.399625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 562/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:12:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:12:06.404611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d7c57-239a-4381-a0f4-d22b10bbaa92 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:06.500842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d7c57-239a-4381-a0f4-d22b10bbaa92 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:06.533436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c0f62-831a-4602-a5f3-30fb0313352d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:06.534097 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c0f62-831a-4602-a5f3-30fb0313352d None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:06.534383 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c0f62-831a-4602-a5f3-30fb0313352d None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:06.534660 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c0f62-831a-4602-a5f3-30fb0313352d None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:06.535408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c0f62-831a-4602-a5f3-30fb0313352d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:12:06.535716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c0f62-831a-4602-a5f3-30fb0313352d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:06.537084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c0f62-831a-4602-a5f3-30fb0313352d None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:06.544885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 588/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:12:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:06.551406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0e650-5900-4714-8ee4-8f7cfe84e759 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:06.646555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0e650-5900-4714-8ee4-8f7cfe84e759 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:06.678919 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b4d87-7613-403f-bad3-0d9deae4191c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:06.679757 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b4d87-7613-403f-bad3-0d9deae4191c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:06.680035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b4d87-7613-403f-bad3-0d9deae4191c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:06.680306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b4d87-7613-403f-bad3-0d9deae4191c None admin] PATH_INFO: `/v3/users/23ea76193145404ca5c77476ac2ce7ad` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:06.681498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b4d87-7613-403f-bad3-0d9deae4191c None admin] RBAC: Authorizing `identity:get_user(user_id=23ea76193145404ca5c77476ac2ce7ad)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:06.682899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b4d87-7613-403f-bad3-0d9deae4191c None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:06.684480 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 563/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:12:06 2022] GET /identity/v3/users/23ea76193145404ca5c77476ac2ce7ad => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:06.690373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c0f62-831a-4602-a5f3-30fb0313352d None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:06.743331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:06.785481 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c0f62-831a-4602-a5f3-30fb0313352d None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:06.818132 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ba3b3-c1f8-44e2-9f70-9523edd4251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:06.818975 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ba3b3-c1f8-44e2-9f70-9523edd4251f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:06.819261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ba3b3-c1f8-44e2-9f70-9523edd4251f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:06.819538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ba3b3-c1f8-44e2-9f70-9523edd4251f None admin] PATH_INFO: `/v3/projects/05250349eabc46a7b590d2d31bbfeb47` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:06.820697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ba3b3-c1f8-44e2-9f70-9523edd4251f None admin] RBAC: Authorizing `identity:get_project(project_id=05250349eabc46a7b590d2d31bbfeb47)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:06.822254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ba3b3-c1f8-44e2-9f70-9523edd4251f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:06.823927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 589/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:12:06 2022] GET /identity/v3/projects/05250349eabc46a7b590d2d31bbfeb47 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:06.829557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b4d87-7613-403f-bad3-0d9deae4191c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:06.884966 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:06.928157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b4d87-7613-403f-bad3-0d9deae4191c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:06.962155 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bef45b-09a1-45b1-8c31-9b2e7baef08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:06.963028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bef45b-09a1-45b1-8c31-9b2e7baef08f None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:06.963312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bef45b-09a1-45b1-8c31-9b2e7baef08f None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:06.963588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bef45b-09a1-45b1-8c31-9b2e7baef08f None admin] PATH_INFO: `/v3/projects/05250349eabc46a7b590d2d31bbfeb47/users/23ea76193145404ca5c77476ac2ce7ad/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:06.965546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bef45b-09a1-45b1-8c31-9b2e7baef08f None admin] RBAC: Authorizing `identity:create_grant(project_id=05250349eabc46a7b590d2d31bbfeb47, user_id=23ea76193145404ca5c77476ac2ce7ad, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:06.966965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bef45b-09a1-45b1-8c31-9b2e7baef08f None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:07.038422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 564/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:12:06 2022] PUT /identity/v3/projects/05250349eabc46a7b590d2d31bbfeb47/users/23ea76193145404ca5c77476ac2ce7ad/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:12:09.032924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced99dd2-b554-4870-ae14-e6926e34f847 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:09.033501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced99dd2-b554-4870-ae14-e6926e34f847 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:09.033501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced99dd2-b554-4870-ae14-e6926e34f847 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:09.034874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 590/1154] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:12:09.040054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f422e6-2669-4706-a055-027bbac6aa2e None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:09.040434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f422e6-2669-4706-a055-027bbac6aa2e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:09.040624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f422e6-2669-4706-a055-027bbac6aa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:09.057604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-46f422e6-2669-4706-a055-027bbac6aa2e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:12:09.058792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-46f422e6-2669-4706-a055-027bbac6aa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:12:09.123438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 565/1155] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:12:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:12:09.147164 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced99dd2-b554-4870-ae14-e6926e34f847 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:09.245232 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced99dd2-b554-4870-ae14-e6926e34f847 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:09.267111 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:09.277922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f595b84-abd1-4c5e-b38a-5f6215d912bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:09.278693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f595b84-abd1-4c5e-b38a-5f6215d912bc None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:09.278973 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f595b84-abd1-4c5e-b38a-5f6215d912bc None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:09.279245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f595b84-abd1-4c5e-b38a-5f6215d912bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:09.289165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f595b84-abd1-4c5e-b38a-5f6215d912bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-4f595b84-abd1-4c5e-b38a-5f6215d912bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:12:09.296735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:12:09.297897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:12:09.299763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:12:09.299763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:12:09.299763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:12:09.299763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:12:09.299763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:12:09.299763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:12:09.299763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:12:09.299763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:12:09.299763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:12:09.299763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:12:09.299763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:12:09.299763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:12:09.299763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 591/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:12:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:12:09.304371 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f422e6-2669-4706-a055-027bbac6aa2e None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:09.349884 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:09.400451 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f422e6-2669-4706-a055-027bbac6aa2e None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:09.434395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22082b2-48cb-482b-8180-01350db52637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:09.435057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22082b2-48cb-482b-8180-01350db52637 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:09.435345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22082b2-48cb-482b-8180-01350db52637 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:09.435626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22082b2-48cb-482b-8180-01350db52637 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:09.436370 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22082b2-48cb-482b-8180-01350db52637 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:12:09.436679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22082b2-48cb-482b-8180-01350db52637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:09.438330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22082b2-48cb-482b-8180-01350db52637 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:09.446203 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 566/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:12:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:09.452030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f595b84-abd1-4c5e-b38a-5f6215d912bc None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:09.549372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f595b84-abd1-4c5e-b38a-5f6215d912bc None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:09.580999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131476ca-5efa-427d-a4f6-47b057a4ede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:09.581876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131476ca-5efa-427d-a4f6-47b057a4ede0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:09.582157 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131476ca-5efa-427d-a4f6-47b057a4ede0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:09.582430 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131476ca-5efa-427d-a4f6-47b057a4ede0 None admin] PATH_INFO: `/v3/users/23ea76193145404ca5c77476ac2ce7ad` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:09.583575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131476ca-5efa-427d-a4f6-47b057a4ede0 None admin] RBAC: Authorizing `identity:get_user(user_id=23ea76193145404ca5c77476ac2ce7ad)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:09.585002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131476ca-5efa-427d-a4f6-47b057a4ede0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:09.586629 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 592/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:12:09 2022] GET /identity/v3/users/23ea76193145404ca5c77476ac2ce7ad => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:09.592295 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22082b2-48cb-482b-8180-01350db52637 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:09.689803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22082b2-48cb-482b-8180-01350db52637 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:09.698233 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:09.722416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107b6ed-a28b-4e66-9807-079fa6c83a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:09.723054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107b6ed-a28b-4e66-9807-079fa6c83a51 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:09.723339 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107b6ed-a28b-4e66-9807-079fa6c83a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:09.723615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107b6ed-a28b-4e66-9807-079fa6c83a51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:09.788406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107b6ed-a28b-4e66-9807-079fa6c83a51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:09.789865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107b6ed-a28b-4e66-9807-079fa6c83a51 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:09.883009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 567/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:12:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:12:09.888919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131476ca-5efa-427d-a4f6-47b057a4ede0 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:09.937893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:09.987593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131476ca-5efa-427d-a4f6-47b057a4ede0 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:10.021136 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f6829-d760-40e9-9398-6c1a452bb8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:10.022003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f6829-d760-40e9-9398-6c1a452bb8ba None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:10.022288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f6829-d760-40e9-9398-6c1a452bb8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:10.022562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f6829-d760-40e9-9398-6c1a452bb8ba None admin] PATH_INFO: `/v3/projects/05250349eabc46a7b590d2d31bbfeb47` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:10.023716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f6829-d760-40e9-9398-6c1a452bb8ba None admin] RBAC: Authorizing `identity:get_project(project_id=05250349eabc46a7b590d2d31bbfeb47)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:10.025174 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f6829-d760-40e9-9398-6c1a452bb8ba None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:10.026861 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 593/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:12:09 2022] GET /identity/v3/projects/05250349eabc46a7b590d2d31bbfeb47 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:10.033754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107b6ed-a28b-4e66-9807-079fa6c83a51 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:10.043630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:10.128825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107b6ed-a28b-4e66-9807-079fa6c83a51 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:10.161509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dc724-61a9-4f17-8944-ca78309d16e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:10.162104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dc724-61a9-4f17-8944-ca78309d16e1 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:10.162393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dc724-61a9-4f17-8944-ca78309d16e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:10.162676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dc724-61a9-4f17-8944-ca78309d16e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:10.163511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dc724-61a9-4f17-8944-ca78309d16e1 None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=05250349eabc46a7b590d2d31bbfeb47, user.id=23ea76193145404ca5c77476ac2ce7ad) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:12:10.163828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dc724-61a9-4f17-8944-ca78309d16e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:10.165277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dc724-61a9-4f17-8944-ca78309d16e1 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:10.171059 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 568/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:12:10 2022] GET /identity/v3/role_assignments?user.id=23ea76193145404ca5c77476ac2ce7ad&scope.project.id=05250349eabc46a7b590d2d31bbfeb47&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:12.204246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d1c33-b718-4a6d-bc4d-f8efeaaadec6 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:12.204780 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d1c33-b718-4a6d-bc4d-f8efeaaadec6 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:12.204780 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d1c33-b718-4a6d-bc4d-f8efeaaadec6 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:12.206219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 594/1162] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:12:12.211278 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b6c6f-1522-4297-858c-669c8a49b220 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:12.211712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b6c6f-1522-4297-858c-669c8a49b220 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:12.211869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b6c6f-1522-4297-858c-669c8a49b220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:12.228152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-592b6c6f-1522-4297-858c-669c8a49b220 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:12:12.229372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-592b6c6f-1522-4297-858c-669c8a49b220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:12:12.293263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 569/1163] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:12:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:12:12.316872 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d1c33-b718-4a6d-bc4d-f8efeaaadec6 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:12.416160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d1c33-b718-4a6d-bc4d-f8efeaaadec6 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:12.433220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:12.449533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4c1ed-a4e2-41da-b3d8-68d36acc9643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:12.450173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c1ed-a4e2-41da-b3d8-68d36acc9643 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:12.454097 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c1ed-a4e2-41da-b3d8-68d36acc9643 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:12.454097 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c1ed-a4e2-41da-b3d8-68d36acc9643 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:12.516299 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4c1ed-a4e2-41da-b3d8-68d36acc9643 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:12.517788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4c1ed-a4e2-41da-b3d8-68d36acc9643 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:12.612480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 595/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:12:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:12:12.618404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b6c6f-1522-4297-858c-669c8a49b220 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:12.620570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:12.714441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b6c6f-1522-4297-858c-669c8a49b220 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:12.747358 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64112ee5-58bc-4fe9-9ce7-e2f8bc3bc739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:12.748145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64112ee5-58bc-4fe9-9ce7-e2f8bc3bc739 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:12.748430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64112ee5-58bc-4fe9-9ce7-e2f8bc3bc739 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:12.748709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64112ee5-58bc-4fe9-9ce7-e2f8bc3bc739 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:12.755745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64112ee5-58bc-4fe9-9ce7-e2f8bc3bc739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:12.757207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64112ee5-58bc-4fe9-9ce7-e2f8bc3bc739 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-64112ee5-58bc-4fe9-9ce7-e2f8bc3bc739 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:12:12.771030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:12:12.772242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:12:12.773335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 570/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 16:12:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:12:12.777986 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4c1ed-a4e2-41da-b3d8-68d36acc9643 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:12.796433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:12.873777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4c1ed-a4e2-41da-b3d8-68d36acc9643 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:12.906002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0f9eb-90cc-4d78-aa3b-9ef426cde46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:12.906645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f9eb-90cc-4d78-aa3b-9ef426cde46b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:12.906924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f9eb-90cc-4d78-aa3b-9ef426cde46b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:12.907196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f9eb-90cc-4d78-aa3b-9ef426cde46b None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:12.907925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0f9eb-90cc-4d78-aa3b-9ef426cde46b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:12:12.908227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0f9eb-90cc-4d78-aa3b-9ef426cde46b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:12.909610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0f9eb-90cc-4d78-aa3b-9ef426cde46b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:12.916452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 596/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 16:12:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:14.908274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86047d-1ce4-4f9c-844c-dd505e2b30f8 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:14.908796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86047d-1ce4-4f9c-844c-dd505e2b30f8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:14.908889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86047d-1ce4-4f9c-844c-dd505e2b30f8 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:14.910246 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 571/1167] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:12:14.915583 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d60515-8aa8-4947-91d8-19390de0c7e0 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:14.915995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d60515-8aa8-4947-91d8-19390de0c7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:14.916178 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d60515-8aa8-4947-91d8-19390de0c7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:14.933130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-62d60515-8aa8-4947-91d8-19390de0c7e0 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:12:14.934314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-62d60515-8aa8-4947-91d8-19390de0c7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:12:14.998754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 597/1168] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:12:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:12:15.021740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86047d-1ce4-4f9c-844c-dd505e2b30f8 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:15.084015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:15.122029 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86047d-1ce4-4f9c-844c-dd505e2b30f8 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:15.154541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e976e-9d1a-4b2e-b5bb-d1a67590b42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:15.155181 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e976e-9d1a-4b2e-b5bb-d1a67590b42e None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:15.155461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e976e-9d1a-4b2e-b5bb-d1a67590b42e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:15.155733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e976e-9d1a-4b2e-b5bb-d1a67590b42e None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:15.156456 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e976e-9d1a-4b2e-b5bb-d1a67590b42e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:15.158500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e976e-9d1a-4b2e-b5bb-d1a67590b42e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:15.255239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 572/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Tue Jul 12 16:12:15 2022] POST /identity/v3/domains => generated 267 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:12:17.286705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c126-8cad-4be1-92ee-23a8db7f37d0 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:17.287232 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c126-8cad-4be1-92ee-23a8db7f37d0 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:17.287326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c126-8cad-4be1-92ee-23a8db7f37d0 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:17.288644 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 598/1170] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:12:17.293674 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98ae55-98cc-4d03-8bbd-37f7b3626bb7 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:17.294059 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98ae55-98cc-4d03-8bbd-37f7b3626bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:17.294231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98ae55-98cc-4d03-8bbd-37f7b3626bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:17.311068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-3c98ae55-98cc-4d03-8bbd-37f7b3626bb7 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:12:17.312486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3c98ae55-98cc-4d03-8bbd-37f7b3626bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:12:17.376113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 573/1171] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:12:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:12:17.399540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8c126-8cad-4be1-92ee-23a8db7f37d0 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:17.413944 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:17.498940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8c126-8cad-4be1-92ee-23a8db7f37d0 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:17.531542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e4c00-cbc8-4606-9b52-e8604d5b210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:17.532393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e4c00-cbc8-4606-9b52-e8604d5b210e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:17.532677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e4c00-cbc8-4606-9b52-e8604d5b210e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:17.532951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e4c00-cbc8-4606-9b52-e8604d5b210e None admin] PATH_INFO: `/v3/domains/705584dbd9fa49e393a5ca9819608421` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:17.543095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e4c00-cbc8-4606-9b52-e8604d5b210e None admin] RBAC: Authorizing `identity:get_domain(domain_id=705584dbd9fa49e393a5ca9819608421)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:17.544499 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e4c00-cbc8-4606-9b52-e8604d5b210e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:17.546160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 599/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Tue Jul 12 16:12:17 2022] GET /identity/v3/domains/705584dbd9fa49e393a5ca9819608421 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:17.552529 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98ae55-98cc-4d03-8bbd-37f7b3626bb7 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:17.603026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:17.648166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98ae55-98cc-4d03-8bbd-37f7b3626bb7 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:17.682377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84181b-1fd1-49eb-9dbe-3aec58ea018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:17.683024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84181b-1fd1-49eb-9dbe-3aec58ea018e None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:17.683305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84181b-1fd1-49eb-9dbe-3aec58ea018e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:17.683582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84181b-1fd1-49eb-9dbe-3aec58ea018e None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:17.684278 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84181b-1fd1-49eb-9dbe-3aec58ea018e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:17.685735 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84181b-1fd1-49eb-9dbe-3aec58ea018e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:17.769032 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 574/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:12:17 2022] POST /identity/v3/projects => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:12:19.815263 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fa374-b8ef-48ed-9442-5c836b18f96f None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:19.815838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fa374-b8ef-48ed-9442-5c836b18f96f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:19.815838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fa374-b8ef-48ed-9442-5c836b18f96f None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:19.817213 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 600/1174] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:12:19.822374 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9367283-c495-4d55-b7d2-59d9fdd82b9c None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:19.822797 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9367283-c495-4d55-b7d2-59d9fdd82b9c None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:19.822940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9367283-c495-4d55-b7d2-59d9fdd82b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:19.839231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-c9367283-c495-4d55-b7d2-59d9fdd82b9c None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:12:19.840412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c9367283-c495-4d55-b7d2-59d9fdd82b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:12:19.903922 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 575/1175] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:12:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:12:19.929742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fa374-b8ef-48ed-9442-5c836b18f96f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:19.998590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:20.026982 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fa374-b8ef-48ed-9442-5c836b18f96f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:20.060319 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c3a90-9787-4f7d-b8a9-353b3390d08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:20.061183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c3a90-9787-4f7d-b8a9-353b3390d08f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:20.061467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c3a90-9787-4f7d-b8a9-353b3390d08f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:20.061892 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c3a90-9787-4f7d-b8a9-353b3390d08f None admin] PATH_INFO: `/v3/domains/705584dbd9fa49e393a5ca9819608421` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:20.063529 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c3a90-9787-4f7d-b8a9-353b3390d08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=705584dbd9fa49e393a5ca9819608421)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:20.064960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c3a90-9787-4f7d-b8a9-353b3390d08f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:20.066652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 601/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Tue Jul 12 16:12:19 2022] GET /identity/v3/domains/705584dbd9fa49e393a5ca9819608421 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:20.072332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9367283-c495-4d55-b7d2-59d9fdd82b9c None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:20.105545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:20.167872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9367283-c495-4d55-b7d2-59d9fdd82b9c None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:20.201308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9fb70-9bcf-4d89-9bb5-bce61fb53c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:20.201963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9fb70-9bcf-4d89-9bb5-bce61fb53c8d None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:20.202247 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9fb70-9bcf-4d89-9bb5-bce61fb53c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:20.202521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9fb70-9bcf-4d89-9bb5-bce61fb53c8d None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:20.203218 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9fb70-9bcf-4d89-9bb5-bce61fb53c8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:20.205171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9fb70-9bcf-4d89-9bb5-bce61fb53c8d None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:20.311217 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 576/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:12:20 2022] POST /identity/v3/users => generated 311 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:12:22.371700 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c7dd0-e0bb-47e3-a028-1dec6173139e None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:22.372262 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c7dd0-e0bb-47e3-a028-1dec6173139e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:22.372262 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c7dd0-e0bb-47e3-a028-1dec6173139e None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:22.373651 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 602/1178] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:12:22.379487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714a5a9-aac9-49d2-9894-e26ed506ddbe None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:22.379868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714a5a9-aac9-49d2-9894-e26ed506ddbe None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:22.380056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714a5a9-aac9-49d2-9894-e26ed506ddbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:22.397884 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-9714a5a9-aac9-49d2-9894-e26ed506ddbe None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:12:22.399066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9714a5a9-aac9-49d2-9894-e26ed506ddbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:12:22.464047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 577/1179] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:12:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:12:22.487395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c7dd0-e0bb-47e3-a028-1dec6173139e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:22.585816 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c7dd0-e0bb-47e3-a028-1dec6173139e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:22.618858 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85878fe0-4c4e-4d7e-b628-3e8739452338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:22.619646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85878fe0-4c4e-4d7e-b628-3e8739452338 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:22.619933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85878fe0-4c4e-4d7e-b628-3e8739452338 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:22.620211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85878fe0-4c4e-4d7e-b628-3e8739452338 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:22.628298 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:22.631204 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85878fe0-4c4e-4d7e-b628-3e8739452338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-85878fe0-4c4e-4d7e-b628-3e8739452338 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:12:22.638881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:12:22.640060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:12:22.641452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:12:22.641452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:12:22.641452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:12:22.641452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:12:22.641452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:12:22.641452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:12:22.641452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:12:22.641452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:12:22.641452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:12:22.641452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:12:22.641452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:12:22.641452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:12:22.641452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 603/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:12:22.646106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714a5a9-aac9-49d2-9894-e26ed506ddbe None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:22.688757 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:22.741775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714a5a9-aac9-49d2-9894-e26ed506ddbe None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:22.774437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab2e50-5abc-426c-bd68-3464ffa06223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:22.775097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2e50-5abc-426c-bd68-3464ffa06223 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:22.775386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2e50-5abc-426c-bd68-3464ffa06223 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:22.775666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2e50-5abc-426c-bd68-3464ffa06223 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:22.776408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab2e50-5abc-426c-bd68-3464ffa06223 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:12:22.776717 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab2e50-5abc-426c-bd68-3464ffa06223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:22.778107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab2e50-5abc-426c-bd68-3464ffa06223 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:22.785853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 578/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:12:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:22.791560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85878fe0-4c4e-4d7e-b628-3e8739452338 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:22.889190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85878fe0-4c4e-4d7e-b628-3e8739452338 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:22.921632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a33864-9912-4f0e-b234-23c3744fde64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:22.922591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a33864-9912-4f0e-b234-23c3744fde64 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:22.922879 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a33864-9912-4f0e-b234-23c3744fde64 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:22.923715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a33864-9912-4f0e-b234-23c3744fde64 None admin] PATH_INFO: `/v3/users/2e1b033077b04147aab69e3d86daf074` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:22.936474 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a33864-9912-4f0e-b234-23c3744fde64 None admin] RBAC: Authorizing `identity:get_user(user_id=2e1b033077b04147aab69e3d86daf074)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:22.938211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a33864-9912-4f0e-b234-23c3744fde64 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:22.939873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 604/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:12:22 2022] GET /identity/v3/users/2e1b033077b04147aab69e3d86daf074 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:22.945637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab2e50-5abc-426c-bd68-3464ffa06223 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:23.025296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:23.043292 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab2e50-5abc-426c-bd68-3464ffa06223 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:23.076400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d785c3-4258-4a64-b435-aa7a175b96f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:23.077035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d785c3-4258-4a64-b435-aa7a175b96f0 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:23.077346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d785c3-4258-4a64-b435-aa7a175b96f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:23.077623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d785c3-4258-4a64-b435-aa7a175b96f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:23.143612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d785c3-4258-4a64-b435-aa7a175b96f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:23.145146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d785c3-4258-4a64-b435-aa7a175b96f0 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:23.228193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:23.246645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 579/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:12:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:12:23.252681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a33864-9912-4f0e-b234-23c3744fde64 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:23.315232 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:23.358685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a33864-9912-4f0e-b234-23c3744fde64 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:23.394379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b87ee6-fc43-43d4-8e07-c152e5ef7cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:23.395891 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b87ee6-fc43-43d4-8e07-c152e5ef7cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:23.396180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b87ee6-fc43-43d4-8e07-c152e5ef7cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:23.396459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b87ee6-fc43-43d4-8e07-c152e5ef7cf8 None admin] PATH_INFO: `/v3/projects/d3c946dce60247338ba96ee71d4ebf70` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:23.397725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b87ee6-fc43-43d4-8e07-c152e5ef7cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c946dce60247338ba96ee71d4ebf70)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:23.399351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b87ee6-fc43-43d4-8e07-c152e5ef7cf8 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:23.401124 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 605/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:12:23 2022] GET /identity/v3/projects/d3c946dce60247338ba96ee71d4ebf70 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:12:23.407262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d785c3-4258-4a64-b435-aa7a175b96f0 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:23.504531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d785c3-4258-4a64-b435-aa7a175b96f0 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:23.537785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cf07c-cabf-4cdf-ac40-c248bb7ed9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:23.538428 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cf07c-cabf-4cdf-ac40-c248bb7ed9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:23.538717 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cf07c-cabf-4cdf-ac40-c248bb7ed9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:23.538995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cf07c-cabf-4cdf-ac40-c248bb7ed9c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:23.539824 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cf07c-cabf-4cdf-ac40-c248bb7ed9c5 None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=d3c946dce60247338ba96ee71d4ebf70, user.id=2e1b033077b04147aab69e3d86daf074) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:12:23.540140 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cf07c-cabf-4cdf-ac40-c248bb7ed9c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:23.541599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cf07c-cabf-4cdf-ac40-c248bb7ed9c5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:23.546905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 580/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:12:23 2022] GET /identity/v3/role_assignments?user.id=2e1b033077b04147aab69e3d86daf074&scope.project.id=d3c946dce60247338ba96ee71d4ebf70&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:25.515328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9657e-fc3d-474a-afd9-a77534455d30 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:25.515826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9657e-fc3d-474a-afd9-a77534455d30 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:25.515928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9657e-fc3d-474a-afd9-a77534455d30 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:25.517811 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 606/1186] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:12:25.523187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a71fd-cde8-4b3c-a774-2071750b0b61 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:25.523605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a71fd-cde8-4b3c-a774-2071750b0b61 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:25.523741 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a71fd-cde8-4b3c-a774-2071750b0b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:25.540579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-862a71fd-cde8-4b3c-a774-2071750b0b61 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:12:25.541799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-862a71fd-cde8-4b3c-a774-2071750b0b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:12:25.582907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:25.606630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 581/1187] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:12:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 16:12:25.628761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9657e-fc3d-474a-afd9-a77534455d30 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:25.727939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9657e-fc3d-474a-afd9-a77534455d30 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:25.752290 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:25.760516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68739d88-5926-42fd-9193-2c3330ae297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:25.761329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68739d88-5926-42fd-9193-2c3330ae297e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:25.761615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68739d88-5926-42fd-9193-2c3330ae297e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:25.766531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68739d88-5926-42fd-9193-2c3330ae297e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:25.772190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68739d88-5926-42fd-9193-2c3330ae297e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-68739d88-5926-42fd-9193-2c3330ae297e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:12:25.779894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:12:25.781007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:12:25.782256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:12:25.782256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:12:25.782256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:12:25.782256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:12:25.782256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:12:25.782256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:12:25.782256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:12:25.782256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:12:25.782256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:12:25.782256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:12:25.782256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:12:25.782256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:12:25.782256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 607/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:12:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:12:25.787845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a71fd-cde8-4b3c-a774-2071750b0b61 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:25.882146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a71fd-cde8-4b3c-a774-2071750b0b61 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:25.914699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3295ab-948c-462a-ba02-e4522bc889d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:25.919262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3295ab-948c-462a-ba02-e4522bc889d4 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:25.919262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3295ab-948c-462a-ba02-e4522bc889d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:25.919262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3295ab-948c-462a-ba02-e4522bc889d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:25.919262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3295ab-948c-462a-ba02-e4522bc889d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:12:25.919262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3295ab-948c-462a-ba02-e4522bc889d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:25.919262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3295ab-948c-462a-ba02-e4522bc889d4 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:25.926444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 582/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:12:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:25.932013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68739d88-5926-42fd-9193-2c3330ae297e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:26.028174 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68739d88-5926-42fd-9193-2c3330ae297e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:26.059601 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b185b9-37f3-4fa9-a6a8-1379224e2baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:26.060440 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b185b9-37f3-4fa9-a6a8-1379224e2baa None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:26.060722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b185b9-37f3-4fa9-a6a8-1379224e2baa None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:26.060999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b185b9-37f3-4fa9-a6a8-1379224e2baa None admin] PATH_INFO: `/v3/users/2e1b033077b04147aab69e3d86daf074` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:26.062446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b185b9-37f3-4fa9-a6a8-1379224e2baa None admin] RBAC: Authorizing `identity:get_user(user_id=2e1b033077b04147aab69e3d86daf074)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:26.064396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b185b9-37f3-4fa9-a6a8-1379224e2baa None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:26.066007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 608/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:12:25 2022] GET /identity/v3/users/2e1b033077b04147aab69e3d86daf074 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:26.071709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3295ab-948c-462a-ba02-e4522bc889d4 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:26.110785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:26.169473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3295ab-948c-462a-ba02-e4522bc889d4 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:26.202127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff75b4-3ad7-4a12-a7c1-ec2c106b3312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:26.202972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff75b4-3ad7-4a12-a7c1-ec2c106b3312 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:26.203256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff75b4-3ad7-4a12-a7c1-ec2c106b3312 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:26.203532 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff75b4-3ad7-4a12-a7c1-ec2c106b3312 None admin] PATH_INFO: `/v3/projects/d3c946dce60247338ba96ee71d4ebf70` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:26.204713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff75b4-3ad7-4a12-a7c1-ec2c106b3312 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c946dce60247338ba96ee71d4ebf70)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:26.206165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff75b4-3ad7-4a12-a7c1-ec2c106b3312 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:26.207836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 583/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:12:26 2022] GET /identity/v3/projects/d3c946dce60247338ba96ee71d4ebf70 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:26.214045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b185b9-37f3-4fa9-a6a8-1379224e2baa None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:26.268487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:26.311197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b185b9-37f3-4fa9-a6a8-1379224e2baa None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:26.343966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7c608-08ae-48c2-9c7d-e489d8283d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:26.345431 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7c608-08ae-48c2-9c7d-e489d8283d08 None admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:26.345715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7c608-08ae-48c2-9c7d-e489d8283d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:26.345986 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7c608-08ae-48c2-9c7d-e489d8283d08 None admin] PATH_INFO: `/v3/projects/d3c946dce60247338ba96ee71d4ebf70/users/2e1b033077b04147aab69e3d86daf074/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:26.347888 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7c608-08ae-48c2-9c7d-e489d8283d08 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3c946dce60247338ba96ee71d4ebf70, user_id=2e1b033077b04147aab69e3d86daf074, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:26.349327 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7c608-08ae-48c2-9c7d-e489d8283d08 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:26.402627 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 609/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:12:26 2022] PUT /identity/v3/projects/d3c946dce60247338ba96ee71d4ebf70/users/2e1b033077b04147aab69e3d86daf074/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:12:28.387301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64320c-63c9-44cb-860c-9b141c52597d None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:28.387859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64320c-63c9-44cb-860c-9b141c52597d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:28.387859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64320c-63c9-44cb-860c-9b141c52597d None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:28.389278 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 584/1193] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:12:28.394501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1033bae-df65-4679-9984-ab26d9b3cd1a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:28.394905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1033bae-df65-4679-9984-ab26d9b3cd1a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:28.395062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1033bae-df65-4679-9984-ab26d9b3cd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:28.411762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-b1033bae-df65-4679-9984-ab26d9b3cd1a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:12:28.412920 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b1033bae-df65-4679-9984-ab26d9b3cd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:12:28.479226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 610/1194] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:12:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:12:28.502489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64320c-63c9-44cb-860c-9b141c52597d None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:28.601125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64320c-63c9-44cb-860c-9b141c52597d None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:28.607756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:28.633309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dd6d4-8c43-4c76-8e0c-fce54b9b901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:28.634086 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dd6d4-8c43-4c76-8e0c-fce54b9b901c None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:28.634376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dd6d4-8c43-4c76-8e0c-fce54b9b901c None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:28.634650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dd6d4-8c43-4c76-8e0c-fce54b9b901c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:28.645164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dd6d4-8c43-4c76-8e0c-fce54b9b901c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-1a6dd6d4-8c43-4c76-8e0c-fce54b9b901c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:12:28.653107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:12:28.654087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:12:28.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:12:28.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:12:28.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:12:28.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:12:28.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:12:28.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:12:28.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:12:28.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:12:28.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:12:28.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:12:28.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:12:28.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:12:28.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 585/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:12:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:12:28.661177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1033bae-df65-4679-9984-ab26d9b3cd1a None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:28.704973 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:28.756398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1033bae-df65-4679-9984-ab26d9b3cd1a None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:28.789351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6059-42f5-42d8-8b61-5cc9b8a930f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:28.790003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6059-42f5-42d8-8b61-5cc9b8a930f7 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:28.790288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6059-42f5-42d8-8b61-5cc9b8a930f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:28.790568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6059-42f5-42d8-8b61-5cc9b8a930f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:28.791309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf6059-42f5-42d8-8b61-5cc9b8a930f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:12:28.791619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf6059-42f5-42d8-8b61-5cc9b8a930f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:28.793231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf6059-42f5-42d8-8b61-5cc9b8a930f7 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:28.802102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 611/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:12:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:28.807784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dd6d4-8c43-4c76-8e0c-fce54b9b901c None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:28.905457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dd6d4-8c43-4c76-8e0c-fce54b9b901c None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:28.939215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78cfe2-608e-416d-ba32-0f9c21dfb3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:28.940082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78cfe2-608e-416d-ba32-0f9c21dfb3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:28.940376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78cfe2-608e-416d-ba32-0f9c21dfb3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:28.940645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78cfe2-608e-416d-ba32-0f9c21dfb3f9 None admin] PATH_INFO: `/v3/users/2e1b033077b04147aab69e3d86daf074` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:28.941792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78cfe2-608e-416d-ba32-0f9c21dfb3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=2e1b033077b04147aab69e3d86daf074)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:28.943206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78cfe2-608e-416d-ba32-0f9c21dfb3f9 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:28.944826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 586/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 16:12:28 2022] GET /identity/v3/users/2e1b033077b04147aab69e3d86daf074 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:28.950748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6059-42f5-42d8-8b61-5cc9b8a930f7 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:29.045295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6059-42f5-42d8-8b61-5cc9b8a930f7 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:29.052451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:29.077942 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d704b6-f97d-485b-af25-cada74688b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:29.078572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d704b6-f97d-485b-af25-cada74688b58 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:29.078850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d704b6-f97d-485b-af25-cada74688b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:29.079645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d704b6-f97d-485b-af25-cada74688b58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:29.143756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d704b6-f97d-485b-af25-cada74688b58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:29.145219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d704b6-f97d-485b-af25-cada74688b58 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:29.240549 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 612/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:12:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:12:29.246357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78cfe2-608e-416d-ba32-0f9c21dfb3f9 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:29.280746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:29.346163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78cfe2-608e-416d-ba32-0f9c21dfb3f9 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:29.377895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d621656-7cbf-4049-ae6f-1987f6671573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:29.378741 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d621656-7cbf-4049-ae6f-1987f6671573 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:29.379027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d621656-7cbf-4049-ae6f-1987f6671573 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:29.379305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d621656-7cbf-4049-ae6f-1987f6671573 None admin] PATH_INFO: `/v3/projects/d3c946dce60247338ba96ee71d4ebf70` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:29.380478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d621656-7cbf-4049-ae6f-1987f6671573 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c946dce60247338ba96ee71d4ebf70)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:29.381919 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d621656-7cbf-4049-ae6f-1987f6671573 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:29.383595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 587/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 16:12:29 2022] GET /identity/v3/projects/d3c946dce60247338ba96ee71d4ebf70 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:12:29.389670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d704b6-f97d-485b-af25-cada74688b58 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:12:29.398136 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:29.487050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d704b6-f97d-485b-af25-cada74688b58 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:12:29.519049 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3416b-7728-4392-a41b-0a74b64d93c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:12:29.519631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3416b-7728-4392-a41b-0a74b64d93c1 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:12:29.519913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3416b-7728-4392-a41b-0a74b64d93c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:12:29.520188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3416b-7728-4392-a41b-0a74b64d93c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:12:29.521007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3416b-7728-4392-a41b-0a74b64d93c1 None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=d3c946dce60247338ba96ee71d4ebf70, user.id=2e1b033077b04147aab69e3d86daf074) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:12:29.521351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3416b-7728-4392-a41b-0a74b64d93c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:12:29.522771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3416b-7728-4392-a41b-0a74b64d93c1 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:12:29.528434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 613/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:12:29 2022] GET /identity/v3/role_assignments?user.id=2e1b033077b04147aab69e3d86daf074&scope.project.id=d3c946dce60247338ba96ee71d4ebf70&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:12:39.373825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=49 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:12:39.525870 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=65 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:40.876582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb6a6c-a058-4d5b-bf96-de04ae11cd04 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:40.877285 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb6a6c-a058-4d5b-bf96-de04ae11cd04 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:40.877285 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb6a6c-a058-4d5b-bf96-de04ae11cd04 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:40.878600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 588/1201] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:13:40.883807 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea825ca1-9599-407a-93ec-1788e2dae056 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:40.888292 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea825ca1-9599-407a-93ec-1788e2dae056 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:40.888292 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea825ca1-9599-407a-93ec-1788e2dae056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:40.900668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ea825ca1-9599-407a-93ec-1788e2dae056 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:13:40.901888 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ea825ca1-9599-407a-93ec-1788e2dae056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:13:40.967502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 614/1202] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:13:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:13:40.992541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb6a6c-a058-4d5b-bf96-de04ae11cd04 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:41.092852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb6a6c-a058-4d5b-bf96-de04ae11cd04 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:41.126857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f23566-7f86-44a1-8da1-294160fae108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:41.127429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f23566-7f86-44a1-8da1-294160fae108 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:41.127718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f23566-7f86-44a1-8da1-294160fae108 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:41.127998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f23566-7f86-44a1-8da1-294160fae108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:41.139116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f23566-7f86-44a1-8da1-294160fae108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:41.140550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f23566-7f86-44a1-8da1-294160fae108 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-f5f23566-7f86-44a1-8da1-294160fae108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:13:41.157445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:41.161198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:41.162489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:13:41.162489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:13:41.162489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:41.162489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:13:41.162489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 589/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:41.164670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea825ca1-9599-407a-93ec-1788e2dae056 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:41.262480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea825ca1-9599-407a-93ec-1788e2dae056 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:41.290351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:41.296067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0465325-98cd-410b-8d96-cb42e96d9e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:41.296728 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0465325-98cd-410b-8d96-cb42e96d9e01 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:41.297017 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0465325-98cd-410b-8d96-cb42e96d9e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:41.297332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0465325-98cd-410b-8d96-cb42e96d9e01 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:41.298053 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0465325-98cd-410b-8d96-cb42e96d9e01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:41.298361 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0465325-98cd-410b-8d96-cb42e96d9e01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:41.299788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0465325-98cd-410b-8d96-cb42e96d9e01 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:41.312242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 615/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:41.318566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f23566-7f86-44a1-8da1-294160fae108 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:41.371126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:41.417632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f23566-7f86-44a1-8da1-294160fae108 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:41.451237 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf8544-cfb0-4168-bd40-731aa6bef17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:41.451964 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf8544-cfb0-4168-bd40-731aa6bef17e None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:41.452248 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf8544-cfb0-4168-bd40-731aa6bef17e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:41.452521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf8544-cfb0-4168-bd40-731aa6bef17e None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:41.453275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf8544-cfb0-4168-bd40-731aa6bef17e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:41.454699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf8544-cfb0-4168-bd40-731aa6bef17e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:41.555511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 590/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 16:13:41 2022] POST /identity/v3/users => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:13:43.617049 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a4bc4-db98-44d8-9ac8-6b1553bb4a31 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:43.617612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a4bc4-db98-44d8-9ac8-6b1553bb4a31 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:43.617612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a4bc4-db98-44d8-9ac8-6b1553bb4a31 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:43.618997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 616/1206] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:13:43.624281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b0629-cf01-4bb2-8461-949ec76343bb None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:43.624719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b0629-cf01-4bb2-8461-949ec76343bb None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:43.624868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b0629-cf01-4bb2-8461-949ec76343bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:43.642071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-041b0629-cf01-4bb2-8461-949ec76343bb None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:13:43.644556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-041b0629-cf01-4bb2-8461-949ec76343bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:13:43.708654 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 591/1207] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:13:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:13:43.732452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a4bc4-db98-44d8-9ac8-6b1553bb4a31 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:43.833931 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a4bc4-db98-44d8-9ac8-6b1553bb4a31 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:43.868476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bc153-8439-455a-b223-21570a36413c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:43.869307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc153-8439-455a-b223-21570a36413c None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:43.869599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc153-8439-455a-b223-21570a36413c None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:43.869879 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc153-8439-455a-b223-21570a36413c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:43.880084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bc153-8439-455a-b223-21570a36413c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-630bc153-8439-455a-b223-21570a36413c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:13:43.888009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:43.893745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:43.894725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:43.894725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:43.894725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:43.894725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:43.894725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:13:43.894725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:13:43.894725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:13:43.894725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:13:43.894725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:13:43.894725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:13:43.894725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:13:43.894725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:13:43.894725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 617/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:13:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:43.895474 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b0629-cf01-4bb2-8461-949ec76343bb None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:43.934915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:43.992791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b0629-cf01-4bb2-8461-949ec76343bb None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:44.026183 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1c20-3ec8-49a1-821b-7b4727522716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:44.026844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1c20-3ec8-49a1-821b-7b4727522716 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:44.027131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1c20-3ec8-49a1-821b-7b4727522716 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:44.027405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1c20-3ec8-49a1-821b-7b4727522716 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:44.028145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1c20-3ec8-49a1-821b-7b4727522716 None admin] RBAC: Adding query filter params (name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:44.028448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1c20-3ec8-49a1-821b-7b4727522716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:44.029831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1c20-3ec8-49a1-821b-7b4727522716 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:44.038223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 592/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:13:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:44.044001 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bc153-8439-455a-b223-21570a36413c None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:44.093982 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:44.142829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bc153-8439-455a-b223-21570a36413c None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:44.175006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be86a7-d58d-4f6b-87d5-ee35d91a8f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:44.175788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be86a7-d58d-4f6b-87d5-ee35d91a8f14 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:44.176074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be86a7-d58d-4f6b-87d5-ee35d91a8f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:44.176349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be86a7-d58d-4f6b-87d5-ee35d91a8f14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:44.187206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be86a7-d58d-4f6b-87d5-ee35d91a8f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:44.188722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be86a7-d58d-4f6b-87d5-ee35d91a8f14 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-c7be86a7-d58d-4f6b-87d5-ee35d91a8f14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:13:44.206195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:44.207382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:44.208697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:13:44.208697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:13:44.208697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:44.208697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:13:44.208697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 618/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:44.213222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1c20-3ec8-49a1-821b-7b4727522716 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:44.307889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:44.310882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1c20-3ec8-49a1-821b-7b4727522716 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:44.342930 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1744a-0b1d-45fa-8c88-a228831c6abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:44.343584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1744a-0b1d-45fa-8c88-a228831c6abe None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:44.343868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1744a-0b1d-45fa-8c88-a228831c6abe None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:44.344143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1744a-0b1d-45fa-8c88-a228831c6abe None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:44.344860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1744a-0b1d-45fa-8c88-a228831c6abe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:44.345198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1744a-0b1d-45fa-8c88-a228831c6abe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:44.346547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1744a-0b1d-45fa-8c88-a228831c6abe None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:44.357719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 593/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:44.363403 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be86a7-d58d-4f6b-87d5-ee35d91a8f14 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:44.465361 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be86a7-d58d-4f6b-87d5-ee35d91a8f14 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:44.467948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:44.505772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f0ce6-e44a-4661-995e-ed51495b3de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:44.506574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f0ce6-e44a-4661-995e-ed51495b3de2 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:44.506862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f0ce6-e44a-4661-995e-ed51495b3de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:44.507142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f0ce6-e44a-4661-995e-ed51495b3de2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:44.514201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f0ce6-e44a-4661-995e-ed51495b3de2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:44.515696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f0ce6-e44a-4661-995e-ed51495b3de2 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-a02f0ce6-e44a-4661-995e-ed51495b3de2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:13:44.530369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:44.533757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:44.534966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:44.534966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:44.534966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:13:44.534966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:13:44.534966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:13:44.534966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:13:44.534966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:13:44.534966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:13:44.534966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 16:13:44.534966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:13:44.534966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 619/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:13:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:44.538021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1744a-0b1d-45fa-8c88-a228831c6abe None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:44.637325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1744a-0b1d-45fa-8c88-a228831c6abe None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:44.670848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3f69b-203e-439d-a583-6305fce7b57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:44.671555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3f69b-203e-439d-a583-6305fce7b57a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:44.671840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3f69b-203e-439d-a583-6305fce7b57a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:44.672117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3f69b-203e-439d-a583-6305fce7b57a None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:44.672953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3f69b-203e-439d-a583-6305fce7b57a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:44.673298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3f69b-203e-439d-a583-6305fce7b57a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:44.674750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3f69b-203e-439d-a583-6305fce7b57a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:44.692378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 594/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Jul 12 16:13:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:44.698165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f0ce6-e44a-4661-995e-ed51495b3de2 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:44.798306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f0ce6-e44a-4661-995e-ed51495b3de2 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:44.831425 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557a992-a725-4c16-a6d1-d405f2083abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:44.832115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557a992-a725-4c16-a6d1-d405f2083abb None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:44.832399 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557a992-a725-4c16-a6d1-d405f2083abb None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:44.832679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557a992-a725-4c16-a6d1-d405f2083abb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:44.863404 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:44.901777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557a992-a725-4c16-a6d1-d405f2083abb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:44.903184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557a992-a725-4c16-a6d1-d405f2083abb None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:44.997664 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 620/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:13:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 16:13:45.003473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3f69b-203e-439d-a583-6305fce7b57a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:45.022873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:45.101265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3f69b-203e-439d-a583-6305fce7b57a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:45.135890 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2de88-addc-4b6c-90eb-23872b14385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:45.136669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2de88-addc-4b6c-90eb-23872b14385a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:45.136950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2de88-addc-4b6c-90eb-23872b14385a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:45.137259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2de88-addc-4b6c-90eb-23872b14385a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:45.146973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2de88-addc-4b6c-90eb-23872b14385a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:45.148495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2de88-addc-4b6c-90eb-23872b14385a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-f7f2de88-addc-4b6c-90eb-23872b14385a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:13:45.166025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:45.167133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:45.168052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:13:45.168052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:13:45.168052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:45.168052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:13:45.168052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 595/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:45.173009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557a992-a725-4c16-a6d1-d405f2083abb None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:45.233858 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:45.271705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557a992-a725-4c16-a6d1-d405f2083abb None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:45.305831 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508ccb0-4850-4b5a-a1f5-cf2a8c26e3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:45.306490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ccb0-4850-4b5a-a1f5-cf2a8c26e3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:45.306777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ccb0-4850-4b5a-a1f5-cf2a8c26e3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:45.307054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ccb0-4850-4b5a-a1f5-cf2a8c26e3f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:45.307773 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508ccb0-4850-4b5a-a1f5-cf2a8c26e3f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:45.308090 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508ccb0-4850-4b5a-a1f5-cf2a8c26e3f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:45.309485 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508ccb0-4850-4b5a-a1f5-cf2a8c26e3f8 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:45.321374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 621/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:45.327188 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2de88-addc-4b6c-90eb-23872b14385a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:45.394542 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:45.424348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2de88-addc-4b6c-90eb-23872b14385a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:45.457590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2de4bb-9995-4b54-8903-3316308ff8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:45.458385 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2de4bb-9995-4b54-8903-3316308ff8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:45.458668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2de4bb-9995-4b54-8903-3316308ff8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:45.458942 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2de4bb-9995-4b54-8903-3316308ff8c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:45.465660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2de4bb-9995-4b54-8903-3316308ff8c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:45.467086 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2de4bb-9995-4b54-8903-3316308ff8c4 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-7d2de4bb-9995-4b54-8903-3316308ff8c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:13:45.482153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:45.483194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:45.484403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:13:45.484403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:13:45.484403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:13:45.484403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:13:45.484403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:13:45.484403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:13:45.484403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:13:45.484403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:13:45.484403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 596/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:13:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:45.489195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508ccb0-4850-4b5a-a1f5-cf2a8c26e3f8 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:45.586099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508ccb0-4850-4b5a-a1f5-cf2a8c26e3f8 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:45.609103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:45.620475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eee758-bcf2-4ff5-80da-6e5a48e8f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:45.621173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eee758-bcf2-4ff5-80da-6e5a48e8f63c None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:45.621454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eee758-bcf2-4ff5-80da-6e5a48e8f63c None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:45.621732 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eee758-bcf2-4ff5-80da-6e5a48e8f63c None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:45.622581 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eee758-bcf2-4ff5-80da-6e5a48e8f63c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:45.622899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eee758-bcf2-4ff5-80da-6e5a48e8f63c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:45.624343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eee758-bcf2-4ff5-80da-6e5a48e8f63c None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:45.635872 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 622/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:13:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:45.642045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2de4bb-9995-4b54-8903-3316308ff8c4 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:45.740727 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2de4bb-9995-4b54-8903-3316308ff8c4 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:45.769503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:45.775770 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebc753-6cb6-4916-8dae-0996737f68da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:45.779018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebc753-6cb6-4916-8dae-0996737f68da None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:45.779018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebc753-6cb6-4916-8dae-0996737f68da None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:45.779018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebc753-6cb6-4916-8dae-0996737f68da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:45.779018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebc753-6cb6-4916-8dae-0996737f68da None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=b62795a6111a4c05a24e69efc7a0faba) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:45.779018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebc753-6cb6-4916-8dae-0996737f68da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:45.779534 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebc753-6cb6-4916-8dae-0996737f68da None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:45.784934 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 597/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:13:45 2022] GET /identity/v3/role_assignments?user.id=b62795a6111a4c05a24e69efc7a0faba&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:47.766826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7217e0-7b77-4088-9070-32ab62be161d None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:47.767332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7217e0-7b77-4088-9070-32ab62be161d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:47.767332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7217e0-7b77-4088-9070-32ab62be161d None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:47.768745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 623/1220] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:13:47.774827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a0a1a-f64b-4b53-93b1-6aff289e12e5 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:47.775253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a0a1a-f64b-4b53-93b1-6aff289e12e5 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:47.775376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a0a1a-f64b-4b53-93b1-6aff289e12e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:47.792437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-d48a0a1a-f64b-4b53-93b1-6aff289e12e5 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:13:47.793655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d48a0a1a-f64b-4b53-93b1-6aff289e12e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:13:47.859161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 598/1221] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:13:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:13:47.882780 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7217e0-7b77-4088-9070-32ab62be161d None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:47.983703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7217e0-7b77-4088-9070-32ab62be161d None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:48.017736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29a0fd-b8e1-4917-95c6-840232b8e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:48.018459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29a0fd-b8e1-4917-95c6-840232b8e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:48.018744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29a0fd-b8e1-4917-95c6-840232b8e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:48.019027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29a0fd-b8e1-4917-95c6-840232b8e2c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:48.029140 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29a0fd-b8e1-4917-95c6-840232b8e2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-da29a0fd-b8e1-4917-95c6-840232b8e2c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:13:48.036787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:48.037948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:48.039027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:48.039027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:48.039027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:48.039027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:48.039027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:13:48.039027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:13:48.039027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:13:48.039027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:13:48.039027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:13:48.039027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:13:48.039027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:13:48.039027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:13:48.039027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 624/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 16:13:48.044172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a0a1a-f64b-4b53-93b1-6aff289e12e5 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:48.143494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a0a1a-f64b-4b53-93b1-6aff289e12e5 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:48.167060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:48.178030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa6156-b457-45b6-b666-ec479897e6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:48.178745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa6156-b457-45b6-b666-ec479897e6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:48.179026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa6156-b457-45b6-b666-ec479897e6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:48.179303 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa6156-b457-45b6-b666-ec479897e6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:48.180043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa6156-b457-45b6-b666-ec479897e6e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:48.180350 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa6156-b457-45b6-b666-ec479897e6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:48.181738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa6156-b457-45b6-b666-ec479897e6e5 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:48.189693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 599/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:48.195446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29a0fd-b8e1-4917-95c6-840232b8e2c0 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:48.240390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:48.294531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29a0fd-b8e1-4917-95c6-840232b8e2c0 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:48.327324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842a170-47a3-4a1f-8ef4-d778a1e83027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:48.328106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842a170-47a3-4a1f-8ef4-d778a1e83027 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:48.328390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842a170-47a3-4a1f-8ef4-d778a1e83027 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:48.328663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842a170-47a3-4a1f-8ef4-d778a1e83027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:48.340137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842a170-47a3-4a1f-8ef4-d778a1e83027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:48.341636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842a170-47a3-4a1f-8ef4-d778a1e83027 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-1842a170-47a3-4a1f-8ef4-d778a1e83027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:13:48.359578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:48.360695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:48.362052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:13:48.362052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:13:48.362052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:48.362052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:13:48.362052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 625/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:48.367361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa6156-b457-45b6-b666-ec479897e6e5 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:48.466093 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa6156-b457-45b6-b666-ec479897e6e5 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:48.498793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf2fa8-58f7-4d85-8cb3-a2eba66b23ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:48.499455 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2fa8-58f7-4d85-8cb3-a2eba66b23ed None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:48.499749 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2fa8-58f7-4d85-8cb3-a2eba66b23ed None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:48.500028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2fa8-58f7-4d85-8cb3-a2eba66b23ed None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:48.500747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf2fa8-58f7-4d85-8cb3-a2eba66b23ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:48.501056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf2fa8-58f7-4d85-8cb3-a2eba66b23ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:48.502541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf2fa8-58f7-4d85-8cb3-a2eba66b23ed None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:48.523005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 600/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:48.528851 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842a170-47a3-4a1f-8ef4-d778a1e83027 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:48.620044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:48.628325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842a170-47a3-4a1f-8ef4-d778a1e83027 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:48.661144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ef164-a6df-4c94-9462-6c1504bb9d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:48.661976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ef164-a6df-4c94-9462-6c1504bb9d6b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:48.662262 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ef164-a6df-4c94-9462-6c1504bb9d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:48.662535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ef164-a6df-4c94-9462-6c1504bb9d6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:48.669430 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ef164-a6df-4c94-9462-6c1504bb9d6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:48.670888 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ef164-a6df-4c94-9462-6c1504bb9d6b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-c32ef164-a6df-4c94-9462-6c1504bb9d6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:13:48.686223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:48.687251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:48.688228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:48.688228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:48.688228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:13:48.688228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:13:48.688228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:13:48.688228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:13:48.688228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:13:48.688228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:13:48.688228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 16:13:48.688228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:13:48.688228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 626/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:13:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:48.693855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf2fa8-58f7-4d85-8cb3-a2eba66b23ed None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:48.740422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:48.793174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf2fa8-58f7-4d85-8cb3-a2eba66b23ed None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:48.827304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a2655-893a-40f0-9933-5b4354bf63c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:48.827973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a2655-893a-40f0-9933-5b4354bf63c9 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:48.828259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a2655-893a-40f0-9933-5b4354bf63c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:48.828534 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a2655-893a-40f0-9933-5b4354bf63c9 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:48.829400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a2655-893a-40f0-9933-5b4354bf63c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:48.829710 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a2655-893a-40f0-9933-5b4354bf63c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:48.831125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a2655-893a-40f0-9933-5b4354bf63c9 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:48.847567 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 601/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Jul 12 16:13:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:13:48.853310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ef164-a6df-4c94-9462-6c1504bb9d6b None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:48.954517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ef164-a6df-4c94-9462-6c1504bb9d6b None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:48.988123 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f1b33-cf6e-4980-893c-0227cceb7254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:48.988915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f1b33-cf6e-4980-893c-0227cceb7254 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:48.989253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f1b33-cf6e-4980-893c-0227cceb7254 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:48.990144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f1b33-cf6e-4980-893c-0227cceb7254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:49.000730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f1b33-cf6e-4980-893c-0227cceb7254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:49.003575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f1b33-cf6e-4980-893c-0227cceb7254 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-f80f1b33-cf6e-4980-893c-0227cceb7254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:13:49.019413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:49.020489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:49.027037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:13:49.027037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:13:49.027037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:49.027037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:13:49.027037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 627/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:49.027394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a2655-893a-40f0-9933-5b4354bf63c9 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:49.123360 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a2655-893a-40f0-9933-5b4354bf63c9 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:49.125717 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:49.156021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70502c62-582a-4783-a761-cab87a6e48cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:49.156680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70502c62-582a-4783-a761-cab87a6e48cf None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:49.156966 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70502c62-582a-4783-a761-cab87a6e48cf None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:49.157280 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70502c62-582a-4783-a761-cab87a6e48cf None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:49.158006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70502c62-582a-4783-a761-cab87a6e48cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:49.158317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70502c62-582a-4783-a761-cab87a6e48cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:49.159677 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70502c62-582a-4783-a761-cab87a6e48cf None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:49.171151 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 602/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:49.176719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f1b33-cf6e-4980-893c-0227cceb7254 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:49.186387 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:49.275759 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f1b33-cf6e-4980-893c-0227cceb7254 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:49.308192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62597322-7cde-407c-95ab-ce9180cf986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:49.309022 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62597322-7cde-407c-95ab-ce9180cf986c None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:49.309338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62597322-7cde-407c-95ab-ce9180cf986c None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:49.309619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62597322-7cde-407c-95ab-ce9180cf986c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:49.316349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62597322-7cde-407c-95ab-ce9180cf986c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:49.317848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62597322-7cde-407c-95ab-ce9180cf986c None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-62597322-7cde-407c-95ab-ce9180cf986c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:13:49.331960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:49.333577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:49.334726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:13:49.334726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:13:49.334726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:13:49.334726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:13:49.334726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:13:49.334726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:13:49.334726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:13:49.334726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:13:49.334726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 628/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:13:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:49.339668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70502c62-582a-4783-a761-cab87a6e48cf None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:49.437792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70502c62-582a-4783-a761-cab87a6e48cf None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:49.471219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299390f-aef6-4512-86fa-005eb802a183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:49.471875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299390f-aef6-4512-86fa-005eb802a183 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:49.472161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299390f-aef6-4512-86fa-005eb802a183 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:49.472439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299390f-aef6-4512-86fa-005eb802a183 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:49.473310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299390f-aef6-4512-86fa-005eb802a183 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:49.473623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299390f-aef6-4512-86fa-005eb802a183 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:49.475656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299390f-aef6-4512-86fa-005eb802a183 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:49.488391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 603/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:13:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:49.494557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62597322-7cde-407c-95ab-ce9180cf986c None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:49.560907 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:49.593872 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62597322-7cde-407c-95ab-ce9180cf986c None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:49.626640 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deaa22-038b-429a-a3fc-dc16f19be6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:49.627531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deaa22-038b-429a-a3fc-dc16f19be6d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:49.627817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deaa22-038b-429a-a3fc-dc16f19be6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:49.628091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deaa22-038b-429a-a3fc-dc16f19be6d2 None admin] PATH_INFO: `/v3/projects/2101dde305df44bc90d33b01976e8265/users/b62795a6111a4c05a24e69efc7a0faba/roles/b3ce4434b13d4e46a67de5728f7ee232` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:49.642787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deaa22-038b-429a-a3fc-dc16f19be6d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2101dde305df44bc90d33b01976e8265, user_id=b62795a6111a4c05a24e69efc7a0faba, role_id=b3ce4434b13d4e46a67de5728f7ee232)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:49.644243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deaa22-038b-429a-a3fc-dc16f19be6d2 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:49.737857 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 629/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:13:49 2022] PUT /identity/v3/projects/2101dde305df44bc90d33b01976e8265/users/b62795a6111a4c05a24e69efc7a0faba/roles/b3ce4434b13d4e46a67de5728f7ee232 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:13:51.778953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c56274-ddfe-4c9e-bd05-cabe4bfb9380 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:51.779506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c56274-ddfe-4c9e-bd05-cabe4bfb9380 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:51.779506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c56274-ddfe-4c9e-bd05-cabe4bfb9380 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:51.780869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 604/1233] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:13:51.785985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c62a-26d9-48d7-9ae3-e8a051ba6330 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:51.786997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c62a-26d9-48d7-9ae3-e8a051ba6330 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:51.787185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c62a-26d9-48d7-9ae3-e8a051ba6330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:51.803777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-c866c62a-26d9-48d7-9ae3-e8a051ba6330 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:13:51.810600 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c866c62a-26d9-48d7-9ae3-e8a051ba6330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:13:51.870063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 630/1234] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:13:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:13:51.893861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c56274-ddfe-4c9e-bd05-cabe4bfb9380 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:51.919104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:51.994869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c56274-ddfe-4c9e-bd05-cabe4bfb9380 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:52.027733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1aed4-2159-4f7f-b04f-aefa41317a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:52.028555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1aed4-2159-4f7f-b04f-aefa41317a69 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:52.032895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1aed4-2159-4f7f-b04f-aefa41317a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:52.032895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1aed4-2159-4f7f-b04f-aefa41317a69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:52.039783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1aed4-2159-4f7f-b04f-aefa41317a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-e2d1aed4-2159-4f7f-b04f-aefa41317a69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:13:52.047361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:52.048588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:52.049756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:52.049756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:52.049756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:52.049756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:52.049756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:13:52.049756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:13:52.049756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:13:52.049756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:13:52.049756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:13:52.049756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:13:52.049756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 16:13:52.049756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:13:52.049756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 605/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 16:13:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:52.054798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866c62a-26d9-48d7-9ae3-e8a051ba6330 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:52.100194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:52.151263 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866c62a-26d9-48d7-9ae3-e8a051ba6330 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:52.183517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005f2e-21e5-484a-8627-d1f04ee920f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:52.184170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005f2e-21e5-484a-8627-d1f04ee920f1 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:52.184451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005f2e-21e5-484a-8627-d1f04ee920f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:52.184724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005f2e-21e5-484a-8627-d1f04ee920f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:52.185754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21005f2e-21e5-484a-8627-d1f04ee920f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:52.186064 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21005f2e-21e5-484a-8627-d1f04ee920f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:52.187420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21005f2e-21e5-484a-8627-d1f04ee920f1 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:52.195940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 631/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 16:13:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:52.201752 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1aed4-2159-4f7f-b04f-aefa41317a69 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:52.285684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:52.301098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1aed4-2159-4f7f-b04f-aefa41317a69 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:52.333585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042debd-661d-42bf-b34f-83da4d133f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:52.334423 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042debd-661d-42bf-b34f-83da4d133f4a None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:52.334705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042debd-661d-42bf-b34f-83da4d133f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:52.334984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042debd-661d-42bf-b34f-83da4d133f4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:52.345379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042debd-661d-42bf-b34f-83da4d133f4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:52.346864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042debd-661d-42bf-b34f-83da4d133f4a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-9042debd-661d-42bf-b34f-83da4d133f4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:13:52.365439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:52.370152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:52.371331 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:13:52.371331 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:13:52.371331 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:52.371331 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:13:52.371331 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 606/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:52.372868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005f2e-21e5-484a-8627-d1f04ee920f1 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:52.472823 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005f2e-21e5-484a-8627-d1f04ee920f1 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:52.482090 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:52.505938 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbda516-abd7-4b97-81e3-5699323da583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:52.506643 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbda516-abd7-4b97-81e3-5699323da583 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:52.506974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbda516-abd7-4b97-81e3-5699323da583 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:52.507253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbda516-abd7-4b97-81e3-5699323da583 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:52.507973 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbda516-abd7-4b97-81e3-5699323da583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:52.508285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbda516-abd7-4b97-81e3-5699323da583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:52.509690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbda516-abd7-4b97-81e3-5699323da583 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:52.522778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 632/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:13:52.528445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042debd-661d-42bf-b34f-83da4d133f4a None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:52.628402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042debd-661d-42bf-b34f-83da4d133f4a None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:52.661746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e331a-b3e8-4516-94b1-82a012583204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:52.662540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e331a-b3e8-4516-94b1-82a012583204 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:52.662821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e331a-b3e8-4516-94b1-82a012583204 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:52.663121 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e331a-b3e8-4516-94b1-82a012583204 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:52.665766 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:52.670640 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e331a-b3e8-4516-94b1-82a012583204 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:52.672063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e331a-b3e8-4516-94b1-82a012583204 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-309e331a-b3e8-4516-94b1-82a012583204 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:13:52.686473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:52.687676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:52.688882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:52.688882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:52.688882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:13:52.688882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:13:52.688882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:13:52.688882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:13:52.688882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:13:52.688882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:13:52.688882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 16:13:52.688882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:13:52.688882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 607/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:13:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:52.694193 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbda516-abd7-4b97-81e3-5699323da583 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:52.793225 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbda516-abd7-4b97-81e3-5699323da583 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:52.828123 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381219a6-6b5f-4fd6-8b26-2f9a55c97d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:52.828794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381219a6-6b5f-4fd6-8b26-2f9a55c97d63 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:52.829080 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381219a6-6b5f-4fd6-8b26-2f9a55c97d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:52.829390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381219a6-6b5f-4fd6-8b26-2f9a55c97d63 None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:52.830229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381219a6-6b5f-4fd6-8b26-2f9a55c97d63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:52.830537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381219a6-6b5f-4fd6-8b26-2f9a55c97d63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:52.831963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381219a6-6b5f-4fd6-8b26-2f9a55c97d63 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:52.849132 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 633/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Jul 12 16:13:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:52.854911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e331a-b3e8-4516-94b1-82a012583204 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:52.953066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e331a-b3e8-4516-94b1-82a012583204 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:52.986004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d41ac-978b-4b88-9a13-631e8e2ebd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:52.986634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d41ac-978b-4b88-9a13-631e8e2ebd2e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:52.986916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d41ac-978b-4b88-9a13-631e8e2ebd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:52.987186 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d41ac-978b-4b88-9a13-631e8e2ebd2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:53.047551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:53.054637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d41ac-978b-4b88-9a13-631e8e2ebd2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:53.056145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d41ac-978b-4b88-9a13-631e8e2ebd2e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:53.152414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 608/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:13:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:13:53.158235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381219a6-6b5f-4fd6-8b26-2f9a55c97d63 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:53.185956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:53.255983 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381219a6-6b5f-4fd6-8b26-2f9a55c97d63 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:53.288735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406e656-e976-4a42-9ef4-c43940c77bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:53.289550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406e656-e976-4a42-9ef4-c43940c77bfe None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:53.289838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406e656-e976-4a42-9ef4-c43940c77bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:53.290118 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406e656-e976-4a42-9ef4-c43940c77bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:53.300361 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406e656-e976-4a42-9ef4-c43940c77bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:53.301906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406e656-e976-4a42-9ef4-c43940c77bfe None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-c406e656-e976-4a42-9ef4-c43940c77bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:13:53.320595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:53.321736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:53.322717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:13:53.322717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:13:53.322717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:53.322717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:13:53.322717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 634/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:53.327550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d41ac-978b-4b88-9a13-631e8e2ebd2e None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:53.419332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:53.424909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d41ac-978b-4b88-9a13-631e8e2ebd2e None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:53.458210 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba2d77-55e2-4939-b97e-ffaebca016d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:53.458881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba2d77-55e2-4939-b97e-ffaebca016d7 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:53.459164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba2d77-55e2-4939-b97e-ffaebca016d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:53.459446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba2d77-55e2-4939-b97e-ffaebca016d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:53.460165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba2d77-55e2-4939-b97e-ffaebca016d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:53.460470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba2d77-55e2-4939-b97e-ffaebca016d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:53.461852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba2d77-55e2-4939-b97e-ffaebca016d7 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:53.473158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 609/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:53.479379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406e656-e976-4a42-9ef4-c43940c77bfe None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:53.557051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:53.577988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406e656-e976-4a42-9ef4-c43940c77bfe None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:53.610348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb0052-dd5d-4b00-bd80-e1760b3dd56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:53.611160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb0052-dd5d-4b00-bd80-e1760b3dd56f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:53.611447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb0052-dd5d-4b00-bd80-e1760b3dd56f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:53.611724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb0052-dd5d-4b00-bd80-e1760b3dd56f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:53.618759 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb0052-dd5d-4b00-bd80-e1760b3dd56f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:53.620199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb0052-dd5d-4b00-bd80-e1760b3dd56f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-39cb0052-dd5d-4b00-bd80-e1760b3dd56f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:13:53.634201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:53.635206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:53.636116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:13:53.636116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:13:53.636116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:13:53.636116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:13:53.636116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:13:53.636116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:13:53.636116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:13:53.636116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:13:53.636116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 635/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:13:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:53.641307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba2d77-55e2-4939-b97e-ffaebca016d7 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:53.737918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba2d77-55e2-4939-b97e-ffaebca016d7 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:53.770557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89e1b1-8623-4d93-b49b-3a8c9d669503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:53.771211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89e1b1-8623-4d93-b49b-3a8c9d669503 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:53.771496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89e1b1-8623-4d93-b49b-3a8c9d669503 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:53.771774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89e1b1-8623-4d93-b49b-3a8c9d669503 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:53.773085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89e1b1-8623-4d93-b49b-3a8c9d669503 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:53.773426 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89e1b1-8623-4d93-b49b-3a8c9d669503 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:53.774833 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89e1b1-8623-4d93-b49b-3a8c9d669503 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:53.786544 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 610/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:53.793221 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb0052-dd5d-4b00-bd80-e1760b3dd56f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:53.891340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb0052-dd5d-4b00-bd80-e1760b3dd56f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:53.925568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45905c-9f10-4777-b336-4b09df0ec770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:53.926221 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45905c-9f10-4777-b336-4b09df0ec770 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:53.926510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45905c-9f10-4777-b336-4b09df0ec770 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:53.926794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45905c-9f10-4777-b336-4b09df0ec770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:53.927625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45905c-9f10-4777-b336-4b09df0ec770 None admin] RBAC: Adding query filter params (role.id=b3ce4434b13d4e46a67de5728f7ee232, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=b62795a6111a4c05a24e69efc7a0faba) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:53.927940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45905c-9f10-4777-b336-4b09df0ec770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:53.929396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45905c-9f10-4777-b336-4b09df0ec770 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:53.935436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 636/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:13:53 2022] GET /identity/v3/role_assignments?user.id=b62795a6111a4c05a24e69efc7a0faba&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=b3ce4434b13d4e46a67de5728f7ee232 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:13:56.006658 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfd79f-5680-4e09-9ee3-984219405dd8 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:56.007196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfd79f-5680-4e09-9ee3-984219405dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:56.007314 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfd79f-5680-4e09-9ee3-984219405dd8 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:56.008629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 611/1247] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:13:56.013775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbb573-05be-46fa-9bfb-505a151c5fa2 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:56.014191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbb573-05be-46fa-9bfb-505a151c5fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:56.014369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbb573-05be-46fa-9bfb-505a151c5fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:56.019381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:56.031763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-03fbb573-05be-46fa-9bfb-505a151c5fa2 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:13:56.032996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-03fbb573-05be-46fa-9bfb-505a151c5fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:13:56.100283 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 637/1248] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:13:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:13:56.123861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfd79f-5680-4e09-9ee3-984219405dd8 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:56.142617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:56.223608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfd79f-5680-4e09-9ee3-984219405dd8 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:56.257310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d2b6f-3400-4484-a63f-cb571ba2717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:56.258023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d2b6f-3400-4484-a63f-cb571ba2717e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:56.258301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d2b6f-3400-4484-a63f-cb571ba2717e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:56.258573 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d2b6f-3400-4484-a63f-cb571ba2717e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:56.268304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d2b6f-3400-4484-a63f-cb571ba2717e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-021d2b6f-3400-4484-a63f-cb571ba2717e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:13:56.276015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:56.277190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:56.278263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:56.278263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:56.278263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:56.278263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:56.278263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:13:56.278263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:13:56.278263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:13:56.278263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:13:56.278263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:13:56.278263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:13:56.278263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:13:56.278263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:13:56.278263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 612/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:56.283248 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbb573-05be-46fa-9bfb-505a151c5fa2 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:56.384165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbb573-05be-46fa-9bfb-505a151c5fa2 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:56.414625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:56.419359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410eb14-306f-4d64-8eab-aa92d4581a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:56.420024 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410eb14-306f-4d64-8eab-aa92d4581a13 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:56.420310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410eb14-306f-4d64-8eab-aa92d4581a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:56.420602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410eb14-306f-4d64-8eab-aa92d4581a13 None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:56.421377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410eb14-306f-4d64-8eab-aa92d4581a13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:56.421686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410eb14-306f-4d64-8eab-aa92d4581a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:56.427508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410eb14-306f-4d64-8eab-aa92d4581a13 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:56.431479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 638/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:13:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:56.437457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d2b6f-3400-4484-a63f-cb571ba2717e None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:56.513890 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:56.536699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d2b6f-3400-4484-a63f-cb571ba2717e None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:56.570023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbccba-72b3-4dae-aa7c-1ab12ce0a24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:56.570806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbccba-72b3-4dae-aa7c-1ab12ce0a24b None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:56.571097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbccba-72b3-4dae-aa7c-1ab12ce0a24b None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:56.571431 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbccba-72b3-4dae-aa7c-1ab12ce0a24b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:56.581601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbccba-72b3-4dae-aa7c-1ab12ce0a24b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:56.583071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbccba-72b3-4dae-aa7c-1ab12ce0a24b None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-72cbccba-72b3-4dae-aa7c-1ab12ce0a24b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:13:56.600786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:56.602803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:56.603767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:13:56.603767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:13:56.603767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:56.603767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:13:56.603767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 613/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:56.608314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410eb14-306f-4d64-8eab-aa92d4581a13 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:56.707163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410eb14-306f-4d64-8eab-aa92d4581a13 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:56.740278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817d2a9-8213-4f70-9041-3ded0e0054cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:56.741557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817d2a9-8213-4f70-9041-3ded0e0054cf None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:56.741844 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817d2a9-8213-4f70-9041-3ded0e0054cf None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:56.742142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817d2a9-8213-4f70-9041-3ded0e0054cf None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:56.742868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817d2a9-8213-4f70-9041-3ded0e0054cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:56.743180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817d2a9-8213-4f70-9041-3ded0e0054cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:56.744556 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817d2a9-8213-4f70-9041-3ded0e0054cf None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:56.756036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 639/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:56.761782 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbccba-72b3-4dae-aa7c-1ab12ce0a24b None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:56.860684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbccba-72b3-4dae-aa7c-1ab12ce0a24b None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:56.886523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:56.894041 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ea45c-efdb-4b14-8b8c-5276dd4dd2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:56.894834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ea45c-efdb-4b14-8b8c-5276dd4dd2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:56.895121 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ea45c-efdb-4b14-8b8c-5276dd4dd2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:56.895403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ea45c-efdb-4b14-8b8c-5276dd4dd2e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:56.902728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ea45c-efdb-4b14-8b8c-5276dd4dd2e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:56.904162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ea45c-efdb-4b14-8b8c-5276dd4dd2e2 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-d80ea45c-efdb-4b14-8b8c-5276dd4dd2e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:13:56.918296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:56.923530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:56.924748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:56.924748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:56.924748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:13:56.924748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:13:56.924748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:13:56.924748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:13:56.924748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:13:56.924748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:13:56.924748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 16:13:56.924748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:13:56.924748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 614/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:13:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:56.926613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817d2a9-8213-4f70-9041-3ded0e0054cf None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:56.981681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:57.026023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817d2a9-8213-4f70-9041-3ded0e0054cf None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:57.058338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf8673-ee34-463f-bd6d-870d328ba91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:57.059002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf8673-ee34-463f-bd6d-870d328ba91f None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:57.059289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf8673-ee34-463f-bd6d-870d328ba91f None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:57.059592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf8673-ee34-463f-bd6d-870d328ba91f None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:57.060683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf8673-ee34-463f-bd6d-870d328ba91f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:57.060993 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf8673-ee34-463f-bd6d-870d328ba91f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:57.062455 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf8673-ee34-463f-bd6d-870d328ba91f None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:57.080567 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 640/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Jul 12 16:13:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:57.086322 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ea45c-efdb-4b14-8b8c-5276dd4dd2e2 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:57.185613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ea45c-efdb-4b14-8b8c-5276dd4dd2e2 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:57.218586 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5a5c9-de6a-4108-b270-809bd61b6159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:57.219254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5a5c9-de6a-4108-b270-809bd61b6159 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:57.219542 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5a5c9-de6a-4108-b270-809bd61b6159 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:57.219823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5a5c9-de6a-4108-b270-809bd61b6159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:57.273931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:57.285872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5a5c9-de6a-4108-b270-809bd61b6159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:57.287834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5a5c9-de6a-4108-b270-809bd61b6159 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:57.382462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 615/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:13:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 16:13:57.388478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf8673-ee34-463f-bd6d-870d328ba91f None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:57.487788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf8673-ee34-463f-bd6d-870d328ba91f None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:57.501783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:57.522748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a8b05-35d0-478e-bbf8-3827f0a8e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:57.523528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a8b05-35d0-478e-bbf8-3827f0a8e7dd None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:57.523809 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a8b05-35d0-478e-bbf8-3827f0a8e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:57.524081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a8b05-35d0-478e-bbf8-3827f0a8e7dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:57.533686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a8b05-35d0-478e-bbf8-3827f0a8e7dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:57.535394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a8b05-35d0-478e-bbf8-3827f0a8e7dd None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-114a8b05-35d0-478e-bbf8-3827f0a8e7dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:13:57.552990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:57.561735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:57.562883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:13:57.562883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:13:57.562883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:13:57.562883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:13:57.562883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 641/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:57.563274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5a5c9-de6a-4108-b270-809bd61b6159 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:57.644918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:57.656841 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5a5c9-de6a-4108-b270-809bd61b6159 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:57.690263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdee032-0542-4b3a-8548-7b3508fdb2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:57.690958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdee032-0542-4b3a-8548-7b3508fdb2af None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:57.691235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdee032-0542-4b3a-8548-7b3508fdb2af None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:57.691510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdee032-0542-4b3a-8548-7b3508fdb2af None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:57.692214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdee032-0542-4b3a-8548-7b3508fdb2af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:57.692517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdee032-0542-4b3a-8548-7b3508fdb2af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:57.693890 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdee032-0542-4b3a-8548-7b3508fdb2af None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:57.705486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 616/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:13:57.711268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a8b05-35d0-478e-bbf8-3827f0a8e7dd None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:57.807625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a8b05-35d0-478e-bbf8-3827f0a8e7dd None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:57.841065 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ab29-b255-4599-827d-1a0453e79ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:57.841907 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ab29-b255-4599-827d-1a0453e79ebd None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:57.842197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ab29-b255-4599-827d-1a0453e79ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:57.842475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ab29-b255-4599-827d-1a0453e79ebd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:57.849064 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918ab29-b255-4599-827d-1a0453e79ebd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:57.851143 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918ab29-b255-4599-827d-1a0453e79ebd None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-3918ab29-b255-4599-827d-1a0453e79ebd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:13:57.864695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:13:57.870467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:13:57.871478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:13:57.871478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:13:57.871478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:13:57.871478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:13:57.871478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:13:57.871478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:13:57.871478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:13:57.871478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:13:57.871478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 642/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:13:57.871974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdee032-0542-4b3a-8548-7b3508fdb2af None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:57.972495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdee032-0542-4b3a-8548-7b3508fdb2af None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:58.004706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6d512-0494-4738-b70f-935ce4a97894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:58.005447 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6d512-0494-4738-b70f-935ce4a97894 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:58.005733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6d512-0494-4738-b70f-935ce4a97894 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:58.006014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6d512-0494-4738-b70f-935ce4a97894 None admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:58.007304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6d512-0494-4738-b70f-935ce4a97894 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:58.007622 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6d512-0494-4738-b70f-935ce4a97894 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:58.009488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6d512-0494-4738-b70f-935ce4a97894 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:58.022622 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 617/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:13:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:13:58.028665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ab29-b255-4599-827d-1a0453e79ebd None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:13:58.055420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:13:58.125981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ab29-b255-4599-827d-1a0453e79ebd None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:13:58.161715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795eb60-9ef1-4ebf-a0b6-d01d8712679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:13:58.162370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795eb60-9ef1-4ebf-a0b6-d01d8712679b None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:13:58.162657 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795eb60-9ef1-4ebf-a0b6-d01d8712679b None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:13:58.162936 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795eb60-9ef1-4ebf-a0b6-d01d8712679b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:13:58.163764 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795eb60-9ef1-4ebf-a0b6-d01d8712679b None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=b62795a6111a4c05a24e69efc7a0faba) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:13:58.164079 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795eb60-9ef1-4ebf-a0b6-d01d8712679b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:13:58.165584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795eb60-9ef1-4ebf-a0b6-d01d8712679b None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:13:58.171028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 643/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:13:58 2022] GET /identity/v3/role_assignments?user.id=b62795a6111a4c05a24e69efc7a0faba&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:00.167338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c18bab-88be-47f5-a721-aac2ded56fda None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:00.167908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c18bab-88be-47f5-a721-aac2ded56fda None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:00.167908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c18bab-88be-47f5-a721-aac2ded56fda None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:00.170158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 618/1261] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:14:00.175447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da12d2c-22f5-416c-b74d-b1074871bd33 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:00.175859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da12d2c-22f5-416c-b74d-b1074871bd33 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:00.176089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da12d2c-22f5-416c-b74d-b1074871bd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:00.192777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-8da12d2c-22f5-416c-b74d-b1074871bd33 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:14:00.194553 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8da12d2c-22f5-416c-b74d-b1074871bd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:14:00.260979 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 644/1262] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:14:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:14:00.283886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c18bab-88be-47f5-a721-aac2ded56fda None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:00.294699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:00.387952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c18bab-88be-47f5-a721-aac2ded56fda None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:00.420947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020d401-b903-427b-a031-cde04d6543ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:00.422078 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020d401-b903-427b-a031-cde04d6543ce None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:00.422778 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020d401-b903-427b-a031-cde04d6543ce None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:00.422778 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020d401-b903-427b-a031-cde04d6543ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:00.432530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020d401-b903-427b-a031-cde04d6543ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-d020d401-b903-427b-a031-cde04d6543ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:14:00.440372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:14:00.444266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:14:00.445353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:14:00.445353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:14:00.445353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:14:00.445353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:14:00.445353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:14:00.445353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:14:00.445353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:14:00.445353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:14:00.445353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:14:00.445353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:14:00.445353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:14:00.445353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:14:00.445353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 619/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:14:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:14:00.448354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da12d2c-22f5-416c-b74d-b1074871bd33 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:00.467497 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:00.544819 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da12d2c-22f5-416c-b74d-b1074871bd33 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:00.578421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f60612-265f-4fa3-8149-74c8f25efefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:00.579084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f60612-265f-4fa3-8149-74c8f25efefd None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:00.579370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f60612-265f-4fa3-8149-74c8f25efefd None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:00.579698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f60612-265f-4fa3-8149-74c8f25efefd None admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:00.580466 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f60612-265f-4fa3-8149-74c8f25efefd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:00.580751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f60612-265f-4fa3-8149-74c8f25efefd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:00.582150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f60612-265f-4fa3-8149-74c8f25efefd None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:00.590989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 645/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:00.596690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020d401-b903-427b-a031-cde04d6543ce None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:00.661833 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:00.695063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020d401-b903-427b-a031-cde04d6543ce None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:00.727390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74f36-3e9c-4704-9b5e-320932cfeaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:00.728169 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74f36-3e9c-4704-9b5e-320932cfeaac None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:00.728448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74f36-3e9c-4704-9b5e-320932cfeaac None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:00.728720 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74f36-3e9c-4704-9b5e-320932cfeaac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:00.738946 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c74f36-3e9c-4704-9b5e-320932cfeaac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:00.740891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c74f36-3e9c-4704-9b5e-320932cfeaac None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-d2c74f36-3e9c-4704-9b5e-320932cfeaac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:14:00.759527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:14:00.760655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:14:00.762039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:14:00.762039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:14:00.762039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:14:00.762039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:14:00.762039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 620/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:14:00.766737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f60612-265f-4fa3-8149-74c8f25efefd None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:00.848055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:00.867306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f60612-265f-4fa3-8149-74c8f25efefd None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:00.901060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1806e2b-c72c-4c04-a67f-388ea4539e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:00.901751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1806e2b-c72c-4c04-a67f-388ea4539e06 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:00.902040 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1806e2b-c72c-4c04-a67f-388ea4539e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:00.902322 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1806e2b-c72c-4c04-a67f-388ea4539e06 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:00.903046 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1806e2b-c72c-4c04-a67f-388ea4539e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:00.903358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1806e2b-c72c-4c04-a67f-388ea4539e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:00.904740 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1806e2b-c72c-4c04-a67f-388ea4539e06 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:00.916488 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 646/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:00.922569 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74f36-3e9c-4704-9b5e-320932cfeaac None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:01.025796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74f36-3e9c-4704-9b5e-320932cfeaac None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:01.045480 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:01.060618 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a830dc1-d54c-47a1-bda6-2988e37d8601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:01.061452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a830dc1-d54c-47a1-bda6-2988e37d8601 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:01.061740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a830dc1-d54c-47a1-bda6-2988e37d8601 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:01.062017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a830dc1-d54c-47a1-bda6-2988e37d8601 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:01.069374 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a830dc1-d54c-47a1-bda6-2988e37d8601 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:01.071060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a830dc1-d54c-47a1-bda6-2988e37d8601 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-4a830dc1-d54c-47a1-bda6-2988e37d8601 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:14:01.084908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:14:01.086101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:14:01.087293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:14:01.087293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:14:01.087293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:14:01.087293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:14:01.087293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:14:01.087293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:14:01.087293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:14:01.087293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:14:01.087293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 16:14:01.087293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:14:01.087293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 621/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:14:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:14:01.092133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1806e2b-c72c-4c04-a67f-388ea4539e06 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:01.193303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1806e2b-c72c-4c04-a67f-388ea4539e06 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:01.225377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aefb0-22bb-4019-8747-ab820ba4e6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:01.226037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aefb0-22bb-4019-8747-ab820ba4e6ef None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:01.226317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aefb0-22bb-4019-8747-ab820ba4e6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:01.226589 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aefb0-22bb-4019-8747-ab820ba4e6ef None admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:01.227412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197aefb0-22bb-4019-8747-ab820ba4e6ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:01.227742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197aefb0-22bb-4019-8747-ab820ba4e6ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:01.229181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197aefb0-22bb-4019-8747-ab820ba4e6ef None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:01.238812 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:01.247703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 647/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Jul 12 16:14:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:01.255386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a830dc1-d54c-47a1-bda6-2988e37d8601 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:01.351970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a830dc1-d54c-47a1-bda6-2988e37d8601 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:01.383962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79103f-e78b-432f-b38e-e8ee574ad1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:01.384740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79103f-e78b-432f-b38e-e8ee574ad1ec None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:01.385023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79103f-e78b-432f-b38e-e8ee574ad1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:01.385333 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79103f-e78b-432f-b38e-e8ee574ad1ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:01.395535 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79103f-e78b-432f-b38e-e8ee574ad1ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:01.397526 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79103f-e78b-432f-b38e-e8ee574ad1ec None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-bf79103f-e78b-432f-b38e-e8ee574ad1ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:14:01.414671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:14:01.415751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:14:01.416733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:14:01.416733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:14:01.416733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:14:01.416733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:14:01.416733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 622/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:14:01.421637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aefb0-22bb-4019-8747-ab820ba4e6ef None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:01.518702 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aefb0-22bb-4019-8747-ab820ba4e6ef None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:01.551867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad4e1e-4960-4760-bfbf-2923fd08f9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:01.552521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad4e1e-4960-4760-bfbf-2923fd08f9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:01.552805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad4e1e-4960-4760-bfbf-2923fd08f9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:01.553631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad4e1e-4960-4760-bfbf-2923fd08f9e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:01.554344 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad4e1e-4960-4760-bfbf-2923fd08f9e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:01.559334 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad4e1e-4960-4760-bfbf-2923fd08f9e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:01.559334 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad4e1e-4960-4760-bfbf-2923fd08f9e7 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:01.567134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 648/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:01.573525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79103f-e78b-432f-b38e-e8ee574ad1ec None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:01.605645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:01.673089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79103f-e78b-432f-b38e-e8ee574ad1ec None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:01.706429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dda360-2847-4d94-8646-0046133e3d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:01.707221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dda360-2847-4d94-8646-0046133e3d70 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:01.707505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dda360-2847-4d94-8646-0046133e3d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:01.707777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dda360-2847-4d94-8646-0046133e3d70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:01.714329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dda360-2847-4d94-8646-0046133e3d70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:01.715818 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dda360-2847-4d94-8646-0046133e3d70 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-e8dda360-2847-4d94-8646-0046133e3d70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:14:01.730202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:14:01.731297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:14:01.732424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:14:01.732424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:14:01.732424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:14:01.732424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:14:01.732424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:14:01.732424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:14:01.732424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:14:01.732424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:14:01.732424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 623/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:14:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:14:01.737270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad4e1e-4960-4760-bfbf-2923fd08f9e7 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:01.794494 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:01.834614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad4e1e-4960-4760-bfbf-2923fd08f9e7 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:01.872094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d7c38-f7c0-4e57-8021-323f12326a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:01.872682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d7c38-f7c0-4e57-8021-323f12326a60 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:01.872962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d7c38-f7c0-4e57-8021-323f12326a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:01.873269 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d7c38-f7c0-4e57-8021-323f12326a60 None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:01.874127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d7c38-f7c0-4e57-8021-323f12326a60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:01.878578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d7c38-f7c0-4e57-8021-323f12326a60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:01.878578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d7c38-f7c0-4e57-8021-323f12326a60 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:01.888002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 649/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:14:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:01.894008 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dda360-2847-4d94-8646-0046133e3d70 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:01.983701 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:01.992560 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dda360-2847-4d94-8646-0046133e3d70 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:02.026161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3441107-f287-4fbe-a9a7-72032e5bc32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:02.027043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3441107-f287-4fbe-a9a7-72032e5bc32a None admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:02.027328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3441107-f287-4fbe-a9a7-72032e5bc32a None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:02.027606 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3441107-f287-4fbe-a9a7-72032e5bc32a None admin] PATH_INFO: `/v3/projects/2101dde305df44bc90d33b01976e8265/users/b62795a6111a4c05a24e69efc7a0faba/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:02.029565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3441107-f287-4fbe-a9a7-72032e5bc32a None admin] RBAC: Authorizing `identity:create_grant(project_id=2101dde305df44bc90d33b01976e8265, user_id=b62795a6111a4c05a24e69efc7a0faba, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:02.030980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3441107-f287-4fbe-a9a7-72032e5bc32a None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:02.138110 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 624/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 16:14:01 2022] PUT /identity/v3/projects/2101dde305df44bc90d33b01976e8265/users/b62795a6111a4c05a24e69efc7a0faba/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:14:04.158589 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab847fa-9fb9-4930-9db9-495f6d190a49 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:04.159155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab847fa-9fb9-4930-9db9-495f6d190a49 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:04.159155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab847fa-9fb9-4930-9db9-495f6d190a49 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:04.160515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 650/1274] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:14:04.166245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ec60-c2b9-4d4c-b47f-80cfeb213089 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:04.168894 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ec60-c2b9-4d4c-b47f-80cfeb213089 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:04.168894 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ec60-c2b9-4d4c-b47f-80cfeb213089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:04.183478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-4320ec60-c2b9-4d4c-b47f-80cfeb213089 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:14:04.184664 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-4320ec60-c2b9-4d4c-b47f-80cfeb213089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:14:04.252538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 625/1275] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:14:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:14:04.276713 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab847fa-9fb9-4930-9db9-495f6d190a49 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:04.376502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab847fa-9fb9-4930-9db9-495f6d190a49 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:04.393730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:04.410771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbd7e9-31e5-412e-a3ff-906a7bb070c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:04.411639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbd7e9-31e5-412e-a3ff-906a7bb070c7 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:04.411928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbd7e9-31e5-412e-a3ff-906a7bb070c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:04.412775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbd7e9-31e5-412e-a3ff-906a7bb070c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:04.422750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbd7e9-31e5-412e-a3ff-906a7bb070c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-a8dbd7e9-31e5-412e-a3ff-906a7bb070c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 16:14:04.431030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:14:04.432165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:14:04.433294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:14:04.433294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:14:04.433294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:14:04.433294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:14:04.433294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 16:14:04.433294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 16:14:04.433294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 16:14:04.433294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 16:14:04.433294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 16:14:04.433294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 16:14:04.433294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 16:14:04.433294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:14:04.433294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 651/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 16:14:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:14:04.438484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ec60-c2b9-4d4c-b47f-80cfeb213089 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:04.521424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:04.538780 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ec60-c2b9-4d4c-b47f-80cfeb213089 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:04.572639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a51e2-085c-4759-b799-91c4fee4e233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:04.573379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a51e2-085c-4759-b799-91c4fee4e233 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:04.573660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a51e2-085c-4759-b799-91c4fee4e233 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:04.573932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a51e2-085c-4759-b799-91c4fee4e233 None admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:04.574665 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a51e2-085c-4759-b799-91c4fee4e233 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:04.574965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a51e2-085c-4759-b799-91c4fee4e233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:04.576312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a51e2-085c-4759-b799-91c4fee4e233 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:04.584124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 626/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 16:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:04.590082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbd7e9-31e5-412e-a3ff-906a7bb070c7 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:04.689388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbd7e9-31e5-412e-a3ff-906a7bb070c7 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:04.722582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d51842-0d8f-4ccc-b97c-5c66418ad70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:04.723372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d51842-0d8f-4ccc-b97c-5c66418ad70e None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:04.723655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d51842-0d8f-4ccc-b97c-5c66418ad70e None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:04.723932 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d51842-0d8f-4ccc-b97c-5c66418ad70e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:04.735013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d51842-0d8f-4ccc-b97c-5c66418ad70e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:04.736478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d51842-0d8f-4ccc-b97c-5c66418ad70e None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-72d51842-0d8f-4ccc-b97c-5c66418ad70e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:14:04.753981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:14:04.760086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:14:04.761043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:14:04.761043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:14:04.761043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:14:04.761043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:14:04.761043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 652/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:14:04.761374 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a51e2-085c-4759-b799-91c4fee4e233 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:04.859850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a51e2-085c-4759-b799-91c4fee4e233 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:04.892826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27352-f836-4f66-95ca-50969e9ad753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:04.893512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27352-f836-4f66-95ca-50969e9ad753 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:04.893803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27352-f836-4f66-95ca-50969e9ad753 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:04.894080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27352-f836-4f66-95ca-50969e9ad753 None admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:04.894799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c27352-f836-4f66-95ca-50969e9ad753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:04.895108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c27352-f836-4f66-95ca-50969e9ad753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:04.896466 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c27352-f836-4f66-95ca-50969e9ad753 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:04.907955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 627/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:04.914345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d51842-0d8f-4ccc-b97c-5c66418ad70e None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:04.946182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:05.014467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d51842-0d8f-4ccc-b97c-5c66418ad70e None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:05.048339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dbff3-2fcd-4dc0-b2bb-d320ee2b8cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:05.049155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dbff3-2fcd-4dc0-b2bb-d320ee2b8cec None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:05.049447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dbff3-2fcd-4dc0-b2bb-d320ee2b8cec None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:05.049727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dbff3-2fcd-4dc0-b2bb-d320ee2b8cec None admin] PATH_INFO: `/v3/users/placement` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:05.056770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dbff3-2fcd-4dc0-b2bb-d320ee2b8cec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:05.058869 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dbff3-2fcd-4dc0-b2bb-d320ee2b8cec None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-1e7dbff3-2fcd-4dc0-b2bb-d320ee2b8cec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 16:14:05.073521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:14:05.074636 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:14:05.076074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:14:05.076074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:14:05.076074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 16:14:05.076074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 16:14:05.076074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 16:14:05.076074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 16:14:05.076074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 16:14:05.076074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 16:14:05.076074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 16:14:05.076074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:14:05.076074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 653/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:14:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:14:05.080629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27352-f836-4f66-95ca-50969e9ad753 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:05.085695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:05.178766 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27352-f836-4f66-95ca-50969e9ad753 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:05.212274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccec69b-6e44-4c47-859e-765b0b3ef060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:05.212870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccec69b-6e44-4c47-859e-765b0b3ef060 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:05.213182 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccec69b-6e44-4c47-859e-765b0b3ef060 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:05.213465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccec69b-6e44-4c47-859e-765b0b3ef060 None admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:05.214309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccec69b-6e44-4c47-859e-765b0b3ef060 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:05.214623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccec69b-6e44-4c47-859e-765b0b3ef060 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:05.216081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccec69b-6e44-4c47-859e-765b0b3ef060 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:05.233500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 628/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Jul 12 16:14:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:05.239280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dbff3-2fcd-4dc0-b2bb-d320ee2b8cec None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:05.328421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:05.338222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dbff3-2fcd-4dc0-b2bb-d320ee2b8cec None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:05.371168 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea1c90-72ea-40a9-9f80-2472691baefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:05.371797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea1c90-72ea-40a9-9f80-2472691baefd None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:05.372077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea1c90-72ea-40a9-9f80-2472691baefd None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:05.372348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea1c90-72ea-40a9-9f80-2472691baefd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:05.437916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea1c90-72ea-40a9-9f80-2472691baefd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:05.439394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea1c90-72ea-40a9-9f80-2472691baefd None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:05.527867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:05.538066 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 654/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 16:14:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 16:14:05.543745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccec69b-6e44-4c47-859e-765b0b3ef060 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:05.604976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:05.642086 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccec69b-6e44-4c47-859e-765b0b3ef060 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:05.675341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580eb26-445c-4bad-87f0-0b04a36ecc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:05.676219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580eb26-445c-4bad-87f0-0b04a36ecc23 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:05.676512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580eb26-445c-4bad-87f0-0b04a36ecc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:05.676790 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580eb26-445c-4bad-87f0-0b04a36ecc23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:05.687634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580eb26-445c-4bad-87f0-0b04a36ecc23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:05.689155 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580eb26-445c-4bad-87f0-0b04a36ecc23 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-e580eb26-445c-4bad-87f0-0b04a36ecc23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 16:14:05.706853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:14:05.707959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:14:05.709887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 16:14:05.709887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 16:14:05.709887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 16:14:05.709887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:14:05.709887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 629/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:14:05.714443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea1c90-72ea-40a9-9f80-2472691baefd None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:05.810641 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea1c90-72ea-40a9-9f80-2472691baefd None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:05.843273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d6955-e3e5-4a4f-adb6-7aba547309e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:05.843923 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d6955-e3e5-4a4f-adb6-7aba547309e0 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:05.844207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d6955-e3e5-4a4f-adb6-7aba547309e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:05.844481 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d6955-e3e5-4a4f-adb6-7aba547309e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:05.845224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d6955-e3e5-4a4f-adb6-7aba547309e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:05.845530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d6955-e3e5-4a4f-adb6-7aba547309e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:05.846892 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d6955-e3e5-4a4f-adb6-7aba547309e0 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:05.857925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 655/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 16:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:05.863753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580eb26-445c-4bad-87f0-0b04a36ecc23 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:05.961102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580eb26-445c-4bad-87f0-0b04a36ecc23 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:05.974692 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:05.994423 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d192863-8b9b-485f-8cbf-aed00cdc8086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:05.995209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d192863-8b9b-485f-8cbf-aed00cdc8086 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:05.995495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d192863-8b9b-485f-8cbf-aed00cdc8086 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:05.995771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d192863-8b9b-485f-8cbf-aed00cdc8086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:06.002193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d192863-8b9b-485f-8cbf-aed00cdc8086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:06.003619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d192863-8b9b-485f-8cbf-aed00cdc8086 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application [None req-2d192863-8b9b-485f-8cbf-aed00cdc8086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 16:14:06.018165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application with Lock( Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:14:06.019253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:14:06.020386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 16:14:06.020386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 16:14:06.020386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 16:14:06.020386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 16:14:06.020386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 16:14:06.020386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 16:14:06.020386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 16:14:06.020386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: ERROR keystone.server.flask.application Jul 12 16:14:06.020386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 630/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 16:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:14:06.025473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d6955-e3e5-4a4f-adb6-7aba547309e0 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:06.074983 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:06.123638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d6955-e3e5-4a4f-adb6-7aba547309e0 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:06.155095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e68df5-8b95-4601-941c-10d3d31791dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:06.155743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68df5-8b95-4601-941c-10d3d31791dc None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:06.156026 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68df5-8b95-4601-941c-10d3d31791dc None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:06.156300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68df5-8b95-4601-941c-10d3d31791dc None admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:06.157075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e68df5-8b95-4601-941c-10d3d31791dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:06.157411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e68df5-8b95-4601-941c-10d3d31791dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:06.158837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e68df5-8b95-4601-941c-10d3d31791dc None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:06.171668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 656/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 16:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:06.178525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d192863-8b9b-485f-8cbf-aed00cdc8086 None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:06.275399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d192863-8b9b-485f-8cbf-aed00cdc8086 None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:06.308821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16785e80-0548-487e-a8e4-514ff3974669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:06.309509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16785e80-0548-487e-a8e4-514ff3974669 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:06.310047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16785e80-0548-487e-a8e4-514ff3974669 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:06.310356 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16785e80-0548-487e-a8e4-514ff3974669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:06.311192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16785e80-0548-487e-a8e4-514ff3974669 None admin] RBAC: Adding query filter params (role.id=eaa9f23967bd48ac9f6683ba56d1e9f9, scope.project.id=2101dde305df44bc90d33b01976e8265, user.id=b62795a6111a4c05a24e69efc7a0faba) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:06.311506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16785e80-0548-487e-a8e4-514ff3974669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:06.312934 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16785e80-0548-487e-a8e4-514ff3974669 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:06.318682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 631/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 16:14:06 2022] GET /identity/v3/role_assignments?user.id=b62795a6111a4c05a24e69efc7a0faba&scope.project.id=2101dde305df44bc90d33b01976e8265&role.id=eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:14:08.347296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cf183-ec06-4b90-a048-3250a6261259 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:08.347855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cf183-ec06-4b90-a048-3250a6261259 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:08.347855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cf183-ec06-4b90-a048-3250a6261259 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:08.349260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 657/1288] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:14:08.354958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eab4f4-0e5b-4de2-9f50-74fa213b107f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:08.355372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eab4f4-0e5b-4de2-9f50-74fa213b107f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:08.355517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eab4f4-0e5b-4de2-9f50-74fa213b107f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:08.372133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-25eab4f4-0e5b-4de2-9f50-74fa213b107f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:14:08.375264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-25eab4f4-0e5b-4de2-9f50-74fa213b107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:14:08.402645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:08.439766 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 632/1289] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:14:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:14:08.463514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cf183-ec06-4b90-a048-3250a6261259 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:08.561774 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cf183-ec06-4b90-a048-3250a6261259 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:08.572461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:08.595187 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cb9ff-ee68-4b2e-96a3-2c537b9b4762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:08.595974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cb9ff-ee68-4b2e-96a3-2c537b9b4762 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:08.596257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cb9ff-ee68-4b2e-96a3-2c537b9b4762 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:08.596532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cb9ff-ee68-4b2e-96a3-2c537b9b4762 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:08.597212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cb9ff-ee68-4b2e-96a3-2c537b9b4762 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:08.598637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cb9ff-ee68-4b2e-96a3-2c537b9b4762 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-a74cb9ff-ee68-4b2e-96a3-2c537b9b4762 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:14:08.610238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:14:08.611530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:14:08.612818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 658/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 16:14:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:14:08.617468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eab4f4-0e5b-4de2-9f50-74fa213b107f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:08.713735 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eab4f4-0e5b-4de2-9f50-74fa213b107f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:08.746457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfbfdf-6e10-4568-b15f-e9522a6e9a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:08.747143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfbfdf-6e10-4568-b15f-e9522a6e9a95 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:08.747457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfbfdf-6e10-4568-b15f-e9522a6e9a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:08.747745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfbfdf-6e10-4568-b15f-e9522a6e9a95 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:08.748453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfbfdf-6e10-4568-b15f-e9522a6e9a95 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:08.748760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfbfdf-6e10-4568-b15f-e9522a6e9a95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:08.750141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfbfdf-6e10-4568-b15f-e9522a6e9a95 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:08.754962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 633/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Jul 12 16:14:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:08.761503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cb9ff-ee68-4b2e-96a3-2c537b9b4762 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:08.859350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cb9ff-ee68-4b2e-96a3-2c537b9b4762 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:08.892393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b525f-49af-40f6-8d3e-c213ad9ab611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:08.893103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b525f-49af-40f6-8d3e-c213ad9ab611 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:08.893415 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b525f-49af-40f6-8d3e-c213ad9ab611 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:08.893691 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b525f-49af-40f6-8d3e-c213ad9ab611 None admin] PATH_INFO: `/v3/services` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:08.894394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b525f-49af-40f6-8d3e-c213ad9ab611 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:08.894701 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b525f-49af-40f6-8d3e-c213ad9ab611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:08.896088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b525f-49af-40f6-8d3e-c213ad9ab611 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:08.900834 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 659/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Jul 12 16:14:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:10.927106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39980e7-deed-4915-91aa-a00d00e3e386 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:10.927679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39980e7-deed-4915-91aa-a00d00e3e386 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:10.927679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39980e7-deed-4915-91aa-a00d00e3e386 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:10.929030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 634/1293] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:14:10.934336 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638abbc-c6c0-4e40-87c9-9bfd72f38fbf None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:10.935020 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638abbc-c6c0-4e40-87c9-9bfd72f38fbf None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:10.935167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638abbc-c6c0-4e40-87c9-9bfd72f38fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:10.952144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-3638abbc-c6c0-4e40-87c9-9bfd72f38fbf None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:14:10.953354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3638abbc-c6c0-4e40-87c9-9bfd72f38fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:14:10.982514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:11.019273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 660/1294] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:14:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:14:11.042053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39980e7-deed-4915-91aa-a00d00e3e386 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:11.073583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:11.142029 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39980e7-deed-4915-91aa-a00d00e3e386 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:11.174235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709deedd-d7ff-49ba-aa7e-0605c3461387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:11.174894 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709deedd-d7ff-49ba-aa7e-0605c3461387 None admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:11.175179 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709deedd-d7ff-49ba-aa7e-0605c3461387 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:11.175456 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709deedd-d7ff-49ba-aa7e-0605c3461387 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:11.176179 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709deedd-d7ff-49ba-aa7e-0605c3461387 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:11.178130 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709deedd-d7ff-49ba-aa7e-0605c3461387 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:11.274972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 635/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 16:14:11 2022] POST /identity/v3/services => generated 246 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:14:13.311103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d880f3a-188f-44cc-bfc7-ffd35250b5a7 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:13.311631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d880f3a-188f-44cc-bfc7-ffd35250b5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:13.311729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d880f3a-188f-44cc-bfc7-ffd35250b5a7 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:13.313044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 661/1296] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:14:13.318883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d8bbc-0691-4b38-89ca-f413c82c071c None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:13.319264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d8bbc-0691-4b38-89ca-f413c82c071c None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:13.319437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d8bbc-0691-4b38-89ca-f413c82c071c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:13.335604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-088d8bbc-0691-4b38-89ca-f413c82c071c None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:14:13.336861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-088d8bbc-0691-4b38-89ca-f413c82c071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:14:13.407763 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 636/1297] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:14:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:14:13.431088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d880f3a-188f-44cc-bfc7-ffd35250b5a7 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:13.533305 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d880f3a-188f-44cc-bfc7-ffd35250b5a7 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:13.566673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbc08-b106-491c-83a7-a9259b0ca9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:13.567406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbc08-b106-491c-83a7-a9259b0ca9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:13.567693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbc08-b106-491c-83a7-a9259b0ca9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:13.567971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbc08-b106-491c-83a7-a9259b0ca9d1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:13.569247 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cbc08-b106-491c-83a7-a9259b0ca9d1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:13.576412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cbc08-b106-491c-83a7-a9259b0ca9d1 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-d51cbc08-b106-491c-83a7-a9259b0ca9d1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:14:13.582120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:14:13.583316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:14:13.584395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 662/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 16:14:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:14:13.589539 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d8bbc-0691-4b38-89ca-f413c82c071c None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:13.608047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:13.686944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d8bbc-0691-4b38-89ca-f413c82c071c None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:13.719748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb5829-2174-49a8-ac7b-f17224f08f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:13.720414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb5829-2174-49a8-ac7b-f17224f08f7e None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:13.720704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb5829-2174-49a8-ac7b-f17224f08f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:13.720986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb5829-2174-49a8-ac7b-f17224f08f7e None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:13.721729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb5829-2174-49a8-ac7b-f17224f08f7e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:13.722042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb5829-2174-49a8-ac7b-f17224f08f7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:13.723505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb5829-2174-49a8-ac7b-f17224f08f7e None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:13.729177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 637/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Jul 12 16:14:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:13.735346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbc08-b106-491c-83a7-a9259b0ca9d1 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:13.767642 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:13.834118 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbc08-b106-491c-83a7-a9259b0ca9d1 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:13.868490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a47de-e1d3-4771-b3b5-6d3472c24b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:13.869240 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a47de-e1d3-4771-b3b5-6d3472c24b4a None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:13.869458 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a47de-e1d3-4771-b3b5-6d3472c24b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:13.869736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a47de-e1d3-4771-b3b5-6d3472c24b4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:13.870532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a47de-e1d3-4771-b3b5-6d3472c24b4a None admin] RBAC: Adding query filter params (interface=public, service_id=4428bad194fc4f4aaf964fab969249c2, region_id=RegionOne) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:13.870850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a47de-e1d3-4771-b3b5-6d3472c24b4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:13.872230 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a47de-e1d3-4771-b3b5-6d3472c24b4a None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:13.877360 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 663/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 16:14:13 2022] GET /identity/v3/endpoints?service_id=4428bad194fc4f4aaf964fab969249c2&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:14:13.883055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb5829-2174-49a8-ac7b-f17224f08f7e None admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:13.963742 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:13.981824 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb5829-2174-49a8-ac7b-f17224f08f7e None admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:14.014877 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06a998-14c5-44ba-afd9-bb38fbca5c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:14.015531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06a998-14c5-44ba-afd9-bb38fbca5c77 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:14.015819 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06a998-14c5-44ba-afd9-bb38fbca5c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:14.016127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06a998-14c5-44ba-afd9-bb38fbca5c77 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:14.016804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06a998-14c5-44ba-afd9-bb38fbca5c77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:14.018203 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06a998-14c5-44ba-afd9-bb38fbca5c77 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:14.025458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 638/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 16:14:13 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:14:16.020920 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db16611-0c13-48d3-93f2-35ebc04acc45 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:16.021556 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db16611-0c13-48d3-93f2-35ebc04acc45 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:16.021556 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db16611-0c13-48d3-93f2-35ebc04acc45 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:16.023489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 664/1302] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:14:16.028813 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48001874-95b2-4e91-95e7-3d1fb0b576da None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:16.029235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48001874-95b2-4e91-95e7-3d1fb0b576da None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:16.029415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48001874-95b2-4e91-95e7-3d1fb0b576da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:16.045193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-48001874-95b2-4e91-95e7-3d1fb0b576da None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:14:16.046379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-48001874-95b2-4e91-95e7-3d1fb0b576da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:14:16.111734 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 639/1303] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:14:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 16:14:16.135089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db16611-0c13-48d3-93f2-35ebc04acc45 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:16.229312 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:16.235771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db16611-0c13-48d3-93f2-35ebc04acc45 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:16.274727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7730a8-5b2e-41c0-833c-8235e46ecd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:16.275449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7730a8-5b2e-41c0-833c-8235e46ecd91 None admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:16.275733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7730a8-5b2e-41c0-833c-8235e46ecd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:16.276011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7730a8-5b2e-41c0-833c-8235e46ecd91 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:16.276661 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7730a8-5b2e-41c0-833c-8235e46ecd91 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:16.278068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7730a8-5b2e-41c0-833c-8235e46ecd91 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application [None req-5e7730a8-5b2e-41c0-833c-8235e46ecd91 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 16:14:16.289520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 16:14:16.294758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application with Lock( Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self._enter() Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application return self.creator() Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application created_value = creator( Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: ERROR keystone.server.flask.application Jul 12 16:14:16.295846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 665/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 16:14:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 16:14:16.297204 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48001874-95b2-4e91-95e7-3d1fb0b576da None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:16.375396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:16.397451 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48001874-95b2-4e91-95e7-3d1fb0b576da None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:16.429545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df742b0c-853f-4dff-864d-357bceeea669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:16.430205 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df742b0c-853f-4dff-864d-357bceeea669 None admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:16.430490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df742b0c-853f-4dff-864d-357bceeea669 None admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:16.430766 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df742b0c-853f-4dff-864d-357bceeea669 None admin] PATH_INFO: `/v3/services` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:16.431470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df742b0c-853f-4dff-864d-357bceeea669 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:14:16.431780 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df742b0c-853f-4dff-864d-357bceeea669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:16.433164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df742b0c-853f-4dff-864d-357bceeea669 None admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:16.438388 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 640/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Jul 12 16:14:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:14:16.444364 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7730a8-5b2e-41c0-833c-8235e46ecd91 None admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:14:16.541779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7730a8-5b2e-41c0-833c-8235e46ecd91 None admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:14:16.573903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63faee92-1882-41d8-98cf-4be1cf363032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:14:16.574545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63faee92-1882-41d8-98cf-4be1cf363032 None admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:14:16.574825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63faee92-1882-41d8-98cf-4be1cf363032 None admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:14:16.575102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63faee92-1882-41d8-98cf-4be1cf363032 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:14:16.575858 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63faee92-1882-41d8-98cf-4be1cf363032 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:14:16.577233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63faee92-1882-41d8-98cf-4be1cf363032 None admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:14:16.657514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 666/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 16:14:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:14:26.439831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=30 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:14:26.652721 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:19.799745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba230243-3eec-4114-88fe-3cbc4979a5f8 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:19.799745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba230243-3eec-4114-88fe-3cbc4979a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:19.799745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba230243-3eec-4114-88fe-3cbc4979a5f8 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:19.800972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508149e0-93cc-4805-ba1a-c9e73c817149 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:19.800972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508149e0-93cc-4805-ba1a-c9e73c817149 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:19.800972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508149e0-93cc-4805-ba1a-c9e73c817149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:19.801516 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 641/1307] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:20:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:20:19.889349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-508149e0-93cc-4805-ba1a-c9e73c817149 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:19.890998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-508149e0-93cc-4805-ba1a-c9e73c817149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:20.044391 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 667/1308] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:20.086309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252201a-03da-4d4e-a266-57c85775b119 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:20.086814 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252201a-03da-4d4e-a266-57c85775b119 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:20.087244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252201a-03da-4d4e-a266-57c85775b119 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:20.089038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 642/1309] 10.222.0.26 () {54 vars in 964 bytes} [Tue Jul 12 16:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:20:20.100338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60215b38-d133-42fd-b251-4168f9d5292c None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:20.100338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60215b38-d133-42fd-b251-4168f9d5292c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:20.100338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60215b38-d133-42fd-b251-4168f9d5292c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:20.200534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-60215b38-d133-42fd-b251-4168f9d5292c None None] MFA Rules not processed for user `f6a4da4c1dca40f5bb5d158a6f33d9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:20.201800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-60215b38-d133-42fd-b251-4168f9d5292c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:20.226776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:20.285496 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 668/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Tue Jul 12 16:20:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:20.294149 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252201a-03da-4d4e-a266-57c85775b119 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:20:20.295906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8252201a-03da-4d4e-a266-57c85775b119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:20.432661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252201a-03da-4d4e-a266-57c85775b119 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:20:20.515532 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb316d-4407-4d5e-bbea-6cbe720e5abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:20:20.516484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb316d-4407-4d5e-bbea-6cbe720e5abe service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:20.516929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb316d-4407-4d5e-bbea-6cbe720e5abe service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:20.517481 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb316d-4407-4d5e-bbea-6cbe720e5abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:20.519912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a8fb316d-4407-4d5e-bbea-6cbe720e5abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:20.576075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:20.636584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb316d-4407-4d5e-bbea-6cbe720e5abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:20:20.638309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb316d-4407-4d5e-bbea-6cbe720e5abe service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:20:20.658484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 643/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:20:23.030052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02259ef9-ed24-4ae2-8df9-5a2b80dbeae9 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:23.030593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02259ef9-ed24-4ae2-8df9-5a2b80dbeae9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:23.030593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02259ef9-ed24-4ae2-8df9-5a2b80dbeae9 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:23.032006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 669/1312] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:20:23.037336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0e3d0-30e8-4832-950a-cf2d0ced2302 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:23.037777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0e3d0-30e8-4832-950a-cf2d0ced2302 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:23.037892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0e3d0-30e8-4832-950a-cf2d0ced2302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:23.106515 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-64b0e3d0-30e8-4832-950a-cf2d0ced2302 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:23.107720 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-64b0e3d0-30e8-4832-950a-cf2d0ced2302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:23.205718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 644/1313] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:23.243624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02259ef9-ed24-4ae2-8df9-5a2b80dbeae9 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:20:23.245185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-02259ef9-ed24-4ae2-8df9-5a2b80dbeae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:23.357456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02259ef9-ed24-4ae2-8df9-5a2b80dbeae9 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:20:23.433061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:23.435683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1bf51-f36a-4b09-81fe-87f52eec9102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:20:23.436352 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1bf51-f36a-4b09-81fe-87f52eec9102 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:23.436616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1bf51-f36a-4b09-81fe-87f52eec9102 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:23.436886 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1bf51-f36a-4b09-81fe-87f52eec9102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:23.438547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b3a1bf51-f36a-4b09-81fe-87f52eec9102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:23.549193 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1bf51-f36a-4b09-81fe-87f52eec9102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:20:23.550733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1bf51-f36a-4b09-81fe-87f52eec9102 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:20:23.570783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 670/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:20:26.188926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7746701-8db2-48e8-a548-c822d01a0657 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:26.189520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7746701-8db2-48e8-a548-c822d01a0657 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:26.189520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7746701-8db2-48e8-a548-c822d01a0657 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:26.190906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 645/1315] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:20:26.196038 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1f516-dfbe-4521-a586-04dfafba4e6e None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:26.196457 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1f516-dfbe-4521-a586-04dfafba4e6e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:26.196618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1f516-dfbe-4521-a586-04dfafba4e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:26.259741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-59c1f516-dfbe-4521-a586-04dfafba4e6e None None] MFA Rules not processed for user `431fd4cf20d349dd949ec11cf87197e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:26.260928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-59c1f516-dfbe-4521-a586-04dfafba4e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:26.311957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:26.356110 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 671/1316] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:20:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:26.394960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7746701-8db2-48e8-a548-c822d01a0657 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:20:26.396529 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f7746701-8db2-48e8-a548-c822d01a0657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:26.406211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:26.499337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7746701-8db2-48e8-a548-c822d01a0657 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:20:26.570221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5f904-05e6-4279-bb9a-61a3cd0d7f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:20:26.570894 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5f904-05e6-4279-bb9a-61a3cd0d7f2d service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:26.571179 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5f904-05e6-4279-bb9a-61a3cd0d7f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:26.571454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5f904-05e6-4279-bb9a-61a3cd0d7f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:26.573085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-30f5f904-05e6-4279-bb9a-61a3cd0d7f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:26.632844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:26.678896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5f904-05e6-4279-bb9a-61a3cd0d7f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:20:26.680585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5f904-05e6-4279-bb9a-61a3cd0d7f2d service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:20:26.698505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 646/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:20:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:20:29.618674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb4de6-bfc5-4fcb-8b45-2d1940fe273f None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:29.619195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb4de6-bfc5-4fcb-8b45-2d1940fe273f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:29.619317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb4de6-bfc5-4fcb-8b45-2d1940fe273f None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:29.620606 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 672/1318] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:20:29.625820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bce47d-f17a-439a-9775-3368110263b4 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:29.626242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bce47d-f17a-439a-9775-3368110263b4 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:29.626391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bce47d-f17a-439a-9775-3368110263b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:29.690564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a4bce47d-f17a-439a-9775-3368110263b4 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:29.692335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a4bce47d-f17a-439a-9775-3368110263b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:29.789300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 647/1319] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:20:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:29.839609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149346ef-dc2d-445f-a4c1-be78fc7c40f5 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:29.839903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149346ef-dc2d-445f-a4c1-be78fc7c40f5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:29.840185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149346ef-dc2d-445f-a4c1-be78fc7c40f5 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:29.841604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 673/1320] 10.222.0.26 () {54 vars in 964 bytes} [Tue Jul 12 16:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:20:29.846979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534db340-246e-4f56-a09f-5ccf68b140e6 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:29.847843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534db340-246e-4f56-a09f-5ccf68b140e6 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:29.848124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534db340-246e-4f56-a09f-5ccf68b140e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:29.869830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:29.921746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-534db340-246e-4f56-a09f-5ccf68b140e6 None None] MFA Rules not processed for user `f6a4da4c1dca40f5bb5d158a6f33d9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:29.922941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-534db340-246e-4f56-a09f-5ccf68b140e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:29.997553 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 648/1321] 10.222.0.26 () {58 vars in 1061 bytes} [Tue Jul 12 16:20:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:30.006722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149346ef-dc2d-445f-a4c1-be78fc7c40f5 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:20:30.008291 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-149346ef-dc2d-445f-a4c1-be78fc7c40f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:30.110131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149346ef-dc2d-445f-a4c1-be78fc7c40f5 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:20:30.183133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75955fa-cccf-4e28-b264-510f2b945b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:20:30.183784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75955fa-cccf-4e28-b264-510f2b945b44 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:30.184070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75955fa-cccf-4e28-b264-510f2b945b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:30.184349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75955fa-cccf-4e28-b264-510f2b945b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:30.186061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e75955fa-cccf-4e28-b264-510f2b945b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:30.193387 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:30.294114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75955fa-cccf-4e28-b264-510f2b945b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:20:30.295563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75955fa-cccf-4e28-b264-510f2b945b44 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:20:30.314390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 674/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:20:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:20:33.744409 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f8a98-265d-477d-83d0-99fcf10c024e None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:33.744968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f8a98-265d-477d-83d0-99fcf10c024e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:33.744968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f8a98-265d-477d-83d0-99fcf10c024e None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:33.746460 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 649/1323] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:20:33.751463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef78b94-a630-4a97-9b23-5d4d62971fad None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:33.751908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef78b94-a630-4a97-9b23-5d4d62971fad None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:33.752019 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef78b94-a630-4a97-9b23-5d4d62971fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:33.815788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-eef78b94-a630-4a97-9b23-5d4d62971fad None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:33.816988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-eef78b94-a630-4a97-9b23-5d4d62971fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:33.876164 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:33.915296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 675/1324] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:33.951400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f8a98-265d-477d-83d0-99fcf10c024e None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:20:33.952950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-417f8a98-265d-477d-83d0-99fcf10c024e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:34.064525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f8a98-265d-477d-83d0-99fcf10c024e None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:20:34.078220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:34.141982 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db102ceb-9bc2-4a63-827a-d000f2044704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:20:34.142635 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db102ceb-9bc2-4a63-827a-d000f2044704 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:34.142920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db102ceb-9bc2-4a63-827a-d000f2044704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:34.143193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db102ceb-9bc2-4a63-827a-d000f2044704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:34.145424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-db102ceb-9bc2-4a63-827a-d000f2044704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:34.255496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db102ceb-9bc2-4a63-827a-d000f2044704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:20:34.256927 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db102ceb-9bc2-4a63-827a-d000f2044704 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:20:34.275281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 650/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:20:36.363723 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc203e-382b-49ae-b8f8-a2f2d1a4170a None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:36.364256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc203e-382b-49ae-b8f8-a2f2d1a4170a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:36.364256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc203e-382b-49ae-b8f8-a2f2d1a4170a None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:36.365833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 676/1326] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:20:36.370952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50112b-01c6-4e8a-a044-3bfdbec624bd None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:36.371333 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50112b-01c6-4e8a-a044-3bfdbec624bd None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:36.371521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50112b-01c6-4e8a-a044-3bfdbec624bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:36.418400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:36.436711 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-9b50112b-01c6-4e8a-a044-3bfdbec624bd None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:36.437950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9b50112b-01c6-4e8a-a044-3bfdbec624bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:36.537282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 651/1327] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:36.573358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc203e-382b-49ae-b8f8-a2f2d1a4170a None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:20:36.574923 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e6bc203e-382b-49ae-b8f8-a2f2d1a4170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:36.677771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc203e-382b-49ae-b8f8-a2f2d1a4170a None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:20:36.751728 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26debc3-ab5d-4030-8bcd-b1c6f2d21824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:20:36.752388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26debc3-ab5d-4030-8bcd-b1c6f2d21824 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:36.752672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26debc3-ab5d-4030-8bcd-b1c6f2d21824 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:36.752948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26debc3-ab5d-4030-8bcd-b1c6f2d21824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:36.755008 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f26debc3-ab5d-4030-8bcd-b1c6f2d21824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:36.771483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:36.868041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26debc3-ab5d-4030-8bcd-b1c6f2d21824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:20:36.869578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26debc3-ab5d-4030-8bcd-b1c6f2d21824 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:20:36.887374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 677/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:20:38.986791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88dbdb-95fb-414d-b69d-99d3bce32f26 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:38.989656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88dbdb-95fb-414d-b69d-99d3bce32f26 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:38.989656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88dbdb-95fb-414d-b69d-99d3bce32f26 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:38.989656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 652/1329] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:20:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:20:38.994647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6f345-a261-4180-99a5-d4f793fdfa81 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:38.995080 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6f345-a261-4180-99a5-d4f793fdfa81 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:38.995212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6f345-a261-4180-99a5-d4f793fdfa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:39.061778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-f7e6f345-a261-4180-99a5-d4f793fdfa81 None None] MFA Rules not processed for user `431fd4cf20d349dd949ec11cf87197e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:39.062987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f7e6f345-a261-4180-99a5-d4f793fdfa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:39.127806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:39.162761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 678/1330] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:20:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:39.200605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88dbdb-95fb-414d-b69d-99d3bce32f26 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:20:39.202167 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6c88dbdb-95fb-414d-b69d-99d3bce32f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:39.309454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88dbdb-95fb-414d-b69d-99d3bce32f26 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:20:39.329760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:39.383120 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d3efb-0855-40f1-8893-99ac5202a6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:20:39.383778 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d3efb-0855-40f1-8893-99ac5202a6af service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:39.384064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d3efb-0855-40f1-8893-99ac5202a6af service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:39.384339 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d3efb-0855-40f1-8893-99ac5202a6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:39.386017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b49d3efb-0855-40f1-8893-99ac5202a6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:39.496348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d3efb-0855-40f1-8893-99ac5202a6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:20:39.497823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d3efb-0855-40f1-8893-99ac5202a6af service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:20:39.516017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 653/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:20:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:20:42.111159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86f9bb-ce7b-437f-885b-0e47d550e1fa None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:42.111718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86f9bb-ce7b-437f-885b-0e47d550e1fa None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:42.111718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86f9bb-ce7b-437f-885b-0e47d550e1fa None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:42.113146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 679/1332] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:20:42.118522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28aaae-ee22-4ba6-9746-225924c0ccd2 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:42.118963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28aaae-ee22-4ba6-9746-225924c0ccd2 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:42.119150 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28aaae-ee22-4ba6-9746-225924c0ccd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:42.180548 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:42.183239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-ba28aaae-ee22-4ba6-9746-225924c0ccd2 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:42.184457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-ba28aaae-ee22-4ba6-9746-225924c0ccd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:42.278449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 654/1333] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:42.315616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86f9bb-ce7b-437f-885b-0e47d550e1fa None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:20:42.317205 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ca86f9bb-ce7b-437f-885b-0e47d550e1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:42.419462 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86f9bb-ce7b-437f-885b-0e47d550e1fa None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:20:42.491580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542da26-7a5f-4e99-aead-38b58cefa3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:20:42.492231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542da26-7a5f-4e99-aead-38b58cefa3eb service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:42.492518 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542da26-7a5f-4e99-aead-38b58cefa3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:42.492795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542da26-7a5f-4e99-aead-38b58cefa3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:42.494479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4542da26-7a5f-4e99-aead-38b58cefa3eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:42.522415 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:42.602528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542da26-7a5f-4e99-aead-38b58cefa3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:20:42.603974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542da26-7a5f-4e99-aead-38b58cefa3eb service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:20:42.622108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 680/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:20:44.678372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5276cd0-5dec-476a-96f6-33b6c29fd7d4 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:44.678952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5276cd0-5dec-476a-96f6-33b6c29fd7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:44.678952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5276cd0-5dec-476a-96f6-33b6c29fd7d4 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:44.680580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 655/1335] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:20:44.685920 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee5b49-edff-4aa0-9e34-c5dd408ebf14 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:44.686337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee5b49-edff-4aa0-9e34-c5dd408ebf14 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:44.686487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee5b49-edff-4aa0-9e34-c5dd408ebf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:44.753447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-43ee5b49-edff-4aa0-9e34-c5dd408ebf14 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:44.754569 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-43ee5b49-edff-4aa0-9e34-c5dd408ebf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:44.827792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:44.850085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 681/1336] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:44.889474 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5276cd0-5dec-476a-96f6-33b6c29fd7d4 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:20:44.891083 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e5276cd0-5dec-476a-96f6-33b6c29fd7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:44.993688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5276cd0-5dec-476a-96f6-33b6c29fd7d4 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:20:45.024397 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:45.069045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba927d-a4be-433a-897e-b92591062aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:20:45.069725 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba927d-a4be-433a-897e-b92591062aef service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:45.070016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba927d-a4be-433a-897e-b92591062aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:45.070294 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba927d-a4be-433a-897e-b92591062aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:45.071991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-68ba927d-a4be-433a-897e-b92591062aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:45.177685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba927d-a4be-433a-897e-b92591062aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:20:45.179137 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba927d-a4be-433a-897e-b92591062aef service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:20:45.197922 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 656/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:20:47.915449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91aa2c0-ff77-4e24-a479-b9a75bfd915d None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:47.916006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91aa2c0-ff77-4e24-a479-b9a75bfd915d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:47.916006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91aa2c0-ff77-4e24-a479-b9a75bfd915d None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:47.917436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 682/1338] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:20:47.922661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1586d-dc39-4917-ab44-be2a800d6928 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:47.923116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1586d-dc39-4917-ab44-be2a800d6928 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:47.923214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1586d-dc39-4917-ab44-be2a800d6928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:47.987072 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-87d1586d-dc39-4917-ab44-be2a800d6928 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:47.988811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-87d1586d-dc39-4917-ab44-be2a800d6928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:47.997158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:48.083388 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 657/1339] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:20:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:48.119978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91aa2c0-ff77-4e24-a479-b9a75bfd915d None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:20:48.121537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a91aa2c0-ff77-4e24-a479-b9a75bfd915d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:48.223447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91aa2c0-ff77-4e24-a479-b9a75bfd915d None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:20:48.295873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21942eb3-bfb8-4e3c-992c-4159d2b80c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:20:48.296522 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21942eb3-bfb8-4e3c-992c-4159d2b80c31 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:48.296805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21942eb3-bfb8-4e3c-992c-4159d2b80c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:48.297082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21942eb3-bfb8-4e3c-992c-4159d2b80c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:48.298770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-21942eb3-bfb8-4e3c-992c-4159d2b80c31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:48.334712 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:48.407155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21942eb3-bfb8-4e3c-992c-4159d2b80c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:20:48.408597 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21942eb3-bfb8-4e3c-992c-4159d2b80c31 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:20:48.427341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 683/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:20:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:20:52.578397 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242a273-a7c7-4f4a-bb86-99ff216c5ec4 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:52.578957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242a273-a7c7-4f4a-bb86-99ff216c5ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:52.579172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242a273-a7c7-4f4a-bb86-99ff216c5ec4 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:52.580527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 658/1341] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:20:52.586747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c38830-9542-4f61-a012-41160d081c1a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:52.587216 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c38830-9542-4f61-a012-41160d081c1a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:52.587312 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c38830-9542-4f61-a012-41160d081c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:52.656463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e3c38830-9542-4f61-a012-41160d081c1a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:52.657703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e3c38830-9542-4f61-a012-41160d081c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:52.755604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:52.767074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 684/1342] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:52.806177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242a273-a7c7-4f4a-bb86-99ff216c5ec4 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:20:52.807699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1242a273-a7c7-4f4a-bb86-99ff216c5ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:52.911383 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242a273-a7c7-4f4a-bb86-99ff216c5ec4 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:20:52.949082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:52.985683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc713fe-d0cb-4249-a249-5540d30b5cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:20:52.986337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc713fe-d0cb-4249-a249-5540d30b5cfe service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:52.986625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc713fe-d0cb-4249-a249-5540d30b5cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:52.986899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc713fe-d0cb-4249-a249-5540d30b5cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:52.989107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-bfc713fe-d0cb-4249-a249-5540d30b5cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:53.097851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc713fe-d0cb-4249-a249-5540d30b5cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:20:53.099325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc713fe-d0cb-4249-a249-5540d30b5cfe service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:20:53.119071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 659/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:20:56.026588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b66d2-baa4-4e2c-b980-0a6e23d77be5 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:56.027115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b66d2-baa4-4e2c-b980-0a6e23d77be5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:56.027212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b66d2-baa4-4e2c-b980-0a6e23d77be5 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:56.028540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 685/1344] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:20:56.033995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd3623-84d4-4fce-9720-78a2a39ba414 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:56.038273 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd3623-84d4-4fce-9720-78a2a39ba414 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:56.038273 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd3623-84d4-4fce-9720-78a2a39ba414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:56.101554 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-9bcd3623-84d4-4fce-9720-78a2a39ba414 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:20:56.102755 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9bcd3623-84d4-4fce-9720-78a2a39ba414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:56.121202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:56.201292 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 660/1345] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:20:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:20:56.238908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b66d2-baa4-4e2c-b980-0a6e23d77be5 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:20:56.240449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-fa0b66d2-baa4-4e2c-b980-0a6e23d77be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:56.343341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b66d2-baa4-4e2c-b980-0a6e23d77be5 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:20:56.417906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9eac9-45e2-4c7c-a47f-65eebe744c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:20:56.418826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9eac9-45e2-4c7c-a47f-65eebe744c6d service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:20:56.419112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9eac9-45e2-4c7c-a47f-65eebe744c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:20:56.419390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9eac9-45e2-4c7c-a47f-65eebe744c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:20:56.421035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-09b9eac9-45e2-4c7c-a47f-65eebe744c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:20:56.465743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:20:56.531460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9eac9-45e2-4c7c-a47f-65eebe744c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:20:56.532832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9eac9-45e2-4c7c-a47f-65eebe744c6d service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:20:56.551608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 686/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:20:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:00.809737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d141255-3ae4-40bd-ad79-60ca44c1d751 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:00.810264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d141255-3ae4-40bd-ad79-60ca44c1d751 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:00.810362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d141255-3ae4-40bd-ad79-60ca44c1d751 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:00.811829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 661/1347] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:00.817127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c729ae7-2f80-4483-9dec-836f9f66f869 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:00.817619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c729ae7-2f80-4483-9dec-836f9f66f869 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:00.817715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c729ae7-2f80-4483-9dec-836f9f66f869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:00.885621 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-1c729ae7-2f80-4483-9dec-836f9f66f869 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:00.886941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1c729ae7-2f80-4483-9dec-836f9f66f869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:00.986268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:00.988957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 687/1348] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:01.026623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d141255-3ae4-40bd-ad79-60ca44c1d751 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:01.028163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9d141255-3ae4-40bd-ad79-60ca44c1d751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:01.144838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d141255-3ae4-40bd-ad79-60ca44c1d751 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:01.207268 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:01.233833 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643118-bd9c-4921-a05d-fc5cf6643bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:01.234555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643118-bd9c-4921-a05d-fc5cf6643bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:01.234840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643118-bd9c-4921-a05d-fc5cf6643bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:01.235111 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643118-bd9c-4921-a05d-fc5cf6643bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:01.236731 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-33643118-bd9c-4921-a05d-fc5cf6643bf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:01.350735 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33643118-bd9c-4921-a05d-fc5cf6643bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:01.352190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33643118-bd9c-4921-a05d-fc5cf6643bf7 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:01.370782 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 662/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:06.280732 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191a05c-6e38-4fe9-81b5-05741104589f None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:06.281314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191a05c-6e38-4fe9-81b5-05741104589f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:06.281412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191a05c-6e38-4fe9-81b5-05741104589f None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:06.282835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 688/1350] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:06.290517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bbc89-2b08-4693-bf8b-a148cf5d6012 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:06.290974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bbc89-2b08-4693-bf8b-a148cf5d6012 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:06.290974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bbc89-2b08-4693-bf8b-a148cf5d6012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:06.379767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-892bbc89-2b08-4693-bf8b-a148cf5d6012 None None] MFA Rules not processed for user `b62795a6111a4c05a24e69efc7a0faba`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:06.380949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-892bbc89-2b08-4693-bf8b-a148cf5d6012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:06.401371 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:06.506979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 663/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:21:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:10.537969 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873100d-e79e-4087-8b25-d759744b2fa8 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:10.538497 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873100d-e79e-4087-8b25-d759744b2fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:10.538769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873100d-e79e-4087-8b25-d759744b2fa8 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:10.540422 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 689/1352] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:10.545348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5abd04-81d5-4861-a619-05c84a6e38bd None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:10.545775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5abd04-81d5-4861-a619-05c84a6e38bd None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:10.545915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5abd04-81d5-4861-a619-05c84a6e38bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:10.624300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-1a5abd04-81d5-4861-a619-05c84a6e38bd None None] MFA Rules not processed for user `b62795a6111a4c05a24e69efc7a0faba`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:10.625551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1a5abd04-81d5-4861-a619-05c84a6e38bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:10.702339 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:10.738615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 664/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:21:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:12.136303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05180f-4c61-40ac-82b3-735a44050ad2 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:12.136861 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05180f-4c61-40ac-82b3-735a44050ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:12.137205 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05180f-4c61-40ac-82b3-735a44050ad2 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:12.138752 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 690/1354] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:12.144488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ccc17-a997-442b-a929-ca474d1b3b8f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:12.144884 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ccc17-a997-442b-a929-ca474d1b3b8f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:12.145044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ccc17-a997-442b-a929-ca474d1b3b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:12.220443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-176ccc17-a997-442b-a929-ca474d1b3b8f None None] MFA Rules not processed for user `b62795a6111a4c05a24e69efc7a0faba`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:12.222233 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-176ccc17-a997-442b-a929-ca474d1b3b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:12.335808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 665/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:21:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:15.678793 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55da3c-0f43-46de-9def-ff48702e947d None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:15.680027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55da3c-0f43-46de-9def-ff48702e947d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:15.680691 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55da3c-0f43-46de-9def-ff48702e947d None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:15.687606 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 691/1356] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:15.689154 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8f4c1-dfe9-4830-900f-b2851d564ea9 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:15.690907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8f4c1-dfe9-4830-900f-b2851d564ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:15.691187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8f4c1-dfe9-4830-900f-b2851d564ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:15.729945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:15.764477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-bed8f4c1-dfe9-4830-900f-b2851d564ea9 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:15.766124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-bed8f4c1-dfe9-4830-900f-b2851d564ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:15.876978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 666/1357] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:15.932560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e27934-93af-48bc-a7a7-6cc2300ac96f None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:15.933228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e27934-93af-48bc-a7a7-6cc2300ac96f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:15.933982 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e27934-93af-48bc-a7a7-6cc2300ac96f None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:15.935833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 692/1358] 10.222.0.26 () {54 vars in 961 bytes} [Tue Jul 12 16:21:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:15.943133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797239c-f529-4b01-9d64-ceccae841722 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:15.943426 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797239c-f529-4b01-9d64-ceccae841722 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:15.948014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797239c-f529-4b01-9d64-ceccae841722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:16.023121 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-0797239c-f529-4b01-9d64-ceccae841722 None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:16.024414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0797239c-f529-4b01-9d64-ceccae841722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:16.075919 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:16.145697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 667/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Jul 12 16:21:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:16.153481 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e27934-93af-48bc-a7a7-6cc2300ac96f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:16.155090 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-89e27934-93af-48bc-a7a7-6cc2300ac96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:16.307724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e27934-93af-48bc-a7a7-6cc2300ac96f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:16.387399 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:16.431582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa33c2a-d612-4d1f-ba19-96efab03d475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:16.432330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa33c2a-d612-4d1f-ba19-96efab03d475 service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:16.432618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa33c2a-d612-4d1f-ba19-96efab03d475 service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:16.432886 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa33c2a-d612-4d1f-ba19-96efab03d475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:16.434592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-6fa33c2a-d612-4d1f-ba19-96efab03d475 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:16.536517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa33c2a-d612-4d1f-ba19-96efab03d475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:16.538173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa33c2a-d612-4d1f-ba19-96efab03d475 service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:16.566624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 693/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:18.803843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67758ed7-8635-43e9-90ca-84ab148b15a2 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:18.805027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67758ed7-8635-43e9-90ca-84ab148b15a2 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:18.805529 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67758ed7-8635-43e9-90ca-84ab148b15a2 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:18.807405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 668/1361] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:18.812565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe3454-2d51-4e83-bb34-73d94fe9a6b2 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:18.813534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe3454-2d51-4e83-bb34-73d94fe9a6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:18.814014 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe3454-2d51-4e83-bb34-73d94fe9a6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:18.881001 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-8cbe3454-2d51-4e83-bb34-73d94fe9a6b2 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:18.882580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8cbe3454-2d51-4e83-bb34-73d94fe9a6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:18.921729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:18.989054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 694/1362] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:19.028072 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67758ed7-8635-43e9-90ca-84ab148b15a2 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:19.029716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-67758ed7-8635-43e9-90ca-84ab148b15a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:19.219983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67758ed7-8635-43e9-90ca-84ab148b15a2 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:19.232544 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:19.357938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc57112-d0ac-4b8b-93ff-94aaa588ad3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:19.358977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57112-d0ac-4b8b-93ff-94aaa588ad3a service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:19.358977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57112-d0ac-4b8b-93ff-94aaa588ad3a service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:19.359457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57112-d0ac-4b8b-93ff-94aaa588ad3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:19.361284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-abc57112-d0ac-4b8b-93ff-94aaa588ad3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:19.457328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc57112-d0ac-4b8b-93ff-94aaa588ad3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:19.458943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc57112-d0ac-4b8b-93ff-94aaa588ad3a service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:19.478040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 669/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:21.964106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a8dd-1321-44fd-8683-412b91fdc0a4 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:21.964999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a8dd-1321-44fd-8683-412b91fdc0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:21.965461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a8dd-1321-44fd-8683-412b91fdc0a4 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:21.967027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 695/1364] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:21.972947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69dc5-cde8-4ea2-bbb5-6ccd59ccb002 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:21.973760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69dc5-cde8-4ea2-bbb5-6ccd59ccb002 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:21.974211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69dc5-cde8-4ea2-bbb5-6ccd59ccb002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:21.989010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:22.045856 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-99f69dc5-cde8-4ea2-bbb5-6ccd59ccb002 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:22.047179 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-99f69dc5-cde8-4ea2-bbb5-6ccd59ccb002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:22.157475 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 670/1365] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:22.204403 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e6dc3-d139-4c4c-af86-fad24a9125b0 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:22.205000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e6dc3-d139-4c4c-af86-fad24a9125b0 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:22.205492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e6dc3-d139-4c4c-af86-fad24a9125b0 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:22.207135 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 696/1366] 10.222.0.26 () {54 vars in 961 bytes} [Tue Jul 12 16:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:22.212659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5693eb-9c9e-47c9-b7d9-342b68dba0ff None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:22.212952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5693eb-9c9e-47c9-b7d9-342b68dba0ff None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:22.213286 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5693eb-9c9e-47c9-b7d9-342b68dba0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:22.292436 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-9a5693eb-9c9e-47c9-b7d9-342b68dba0ff None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:22.293533 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9a5693eb-9c9e-47c9-b7d9-342b68dba0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:22.331654 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:22.421410 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 671/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Jul 12 16:21:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:21:22.427573 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e6dc3-d139-4c4c-af86-fad24a9125b0 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:22.429658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a58e6dc3-d139-4c4c-af86-fad24a9125b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:22.584608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e6dc3-d139-4c4c-af86-fad24a9125b0 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:22.605778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:22.708925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95444a2-930f-4e4f-8c3d-3b57ba9869b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:22.709664 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95444a2-930f-4e4f-8c3d-3b57ba9869b1 service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:22.709956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95444a2-930f-4e4f-8c3d-3b57ba9869b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:22.710227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95444a2-930f-4e4f-8c3d-3b57ba9869b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:22.711887 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b95444a2-930f-4e4f-8c3d-3b57ba9869b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:22.803742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95444a2-930f-4e4f-8c3d-3b57ba9869b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:22.805776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95444a2-930f-4e4f-8c3d-3b57ba9869b1 service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:22.824857 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 697/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:23.994670 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccde3c3-25cf-49e2-9f2b-b12a4d2fb830 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:23.994670 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccde3c3-25cf-49e2-9f2b-b12a4d2fb830 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:23.994670 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccde3c3-25cf-49e2-9f2b-b12a4d2fb830 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:23.994670 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 672/1369] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:23.995393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7102-515d-4431-91a5-3dbeec78c8a9 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:23.995393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7102-515d-4431-91a5-3dbeec78c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:23.995393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7102-515d-4431-91a5-3dbeec78c8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:24.027409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:24.063275 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a11b7102-515d-4431-91a5-3dbeec78c8a9 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:24.065196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a11b7102-515d-4431-91a5-3dbeec78c8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:24.173067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 698/1370] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:24.510883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd99fe6-6f79-4944-b921-b74b5af90b64 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:24.511179 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd99fe6-6f79-4944-b921-b74b5af90b64 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:24.511556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd99fe6-6f79-4944-b921-b74b5af90b64 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:24.513230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 673/1371] 10.222.0.26 () {54 vars in 963 bytes} [Tue Jul 12 16:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:24.519035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d040c-1bca-4ce1-b600-25fd5d453ff9 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:24.519330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d040c-1bca-4ce1-b600-25fd5d453ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:24.519613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d040c-1bca-4ce1-b600-25fd5d453ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:24.596855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-067d040c-1bca-4ce1-b600-25fd5d453ff9 None None] MFA Rules not processed for user `835679599bc74ed5b1b481e9be4700c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:24.598118 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-067d040c-1bca-4ce1-b600-25fd5d453ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:24.653006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:24.684063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 699/1372] 10.222.0.26 () {58 vars in 1060 bytes} [Tue Jul 12 16:21:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:24.692227 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd99fe6-6f79-4944-b921-b74b5af90b64 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:24.693771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3fd99fe6-6f79-4944-b921-b74b5af90b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:24.803243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd99fe6-6f79-4944-b921-b74b5af90b64 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:24.847805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:24.883605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03e643-a081-42ba-8481-cb733b8e994a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:24.884263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e643-a081-42ba-8481-cb733b8e994a service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:24.884549 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e643-a081-42ba-8481-cb733b8e994a service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:24.884825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e643-a081-42ba-8481-cb733b8e994a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:24.886507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2e03e643-a081-42ba-8481-cb733b8e994a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:25.001211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03e643-a081-42ba-8481-cb733b8e994a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:25.003338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03e643-a081-42ba-8481-cb733b8e994a service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:25.022188 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 674/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:25.104846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0dcd4-5343-4211-99e2-ff7661135fe3 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:25.105392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0dcd4-5343-4211-99e2-ff7661135fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:25.105517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0dcd4-5343-4211-99e2-ff7661135fe3 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:25.106898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 700/1374] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:25.112651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996fc72-7609-4b78-b838-a0fdd388a369 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:25.112945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996fc72-7609-4b78-b838-a0fdd388a369 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:25.113266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996fc72-7609-4b78-b838-a0fdd388a369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:25.179998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-6996fc72-7609-4b78-b838-a0fdd388a369 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:25.180963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6996fc72-7609-4b78-b838-a0fdd388a369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:25.203916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:25.297260 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 675/1375] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:25.339218 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0dcd4-5343-4211-99e2-ff7661135fe3 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:25.341494 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-03e0dcd4-5343-4211-99e2-ff7661135fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:25.661187 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0dcd4-5343-4211-99e2-ff7661135fe3 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:25.718622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:25.783983 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be0a67-211f-435a-b8d6-a6399028bb78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:25.784678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be0a67-211f-435a-b8d6-a6399028bb78 service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:25.784954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be0a67-211f-435a-b8d6-a6399028bb78 service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:25.785263 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be0a67-211f-435a-b8d6-a6399028bb78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:25.786884 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-87be0a67-211f-435a-b8d6-a6399028bb78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:25.878471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be0a67-211f-435a-b8d6-a6399028bb78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:25.880057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be0a67-211f-435a-b8d6-a6399028bb78 service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:25.898708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 701/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:28.086921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f765ce-b297-4aeb-bea7-b4b1847bf804 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:28.087397 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f765ce-b297-4aeb-bea7-b4b1847bf804 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:28.087556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f765ce-b297-4aeb-bea7-b4b1847bf804 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:28.088909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 676/1377] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:28.094730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543095ae-3746-4823-8e1d-882979a4ff9d None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:28.097373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543095ae-3746-4823-8e1d-882979a4ff9d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:28.097689 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543095ae-3746-4823-8e1d-882979a4ff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:28.171110 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-543095ae-3746-4823-8e1d-882979a4ff9d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:28.172743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-543095ae-3746-4823-8e1d-882979a4ff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:28.195412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:28.287036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 702/1378] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:28.331346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f765ce-b297-4aeb-bea7-b4b1847bf804 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:28.333007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c3f765ce-b297-4aeb-bea7-b4b1847bf804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:28.488757 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f765ce-b297-4aeb-bea7-b4b1847bf804 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:28.492481 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:28.636506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83627ac1-9733-41d7-bdf9-ed5c7217438f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:28.637191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83627ac1-9733-41d7-bdf9-ed5c7217438f service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:28.637481 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83627ac1-9733-41d7-bdf9-ed5c7217438f service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:28.637763 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83627ac1-9733-41d7-bdf9-ed5c7217438f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:28.639510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-83627ac1-9733-41d7-bdf9-ed5c7217438f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:28.766644 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83627ac1-9733-41d7-bdf9-ed5c7217438f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:28.768889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83627ac1-9733-41d7-bdf9-ed5c7217438f service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:28.787871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 677/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:30.961029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d550bd-4dd3-40f9-b15d-39e2bfc2b0e5 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:30.961524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d550bd-4dd3-40f9-b15d-39e2bfc2b0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:30.961641 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d550bd-4dd3-40f9-b15d-39e2bfc2b0e5 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:30.963156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 703/1380] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:21:30.968146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8d8f-7b69-4f93-89da-1db8354b9cc2 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:30.968607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8d8f-7b69-4f93-89da-1db8354b9cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:30.968702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8d8f-7b69-4f93-89da-1db8354b9cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:30.979793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:31.049343 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-773c8d8f-7b69-4f93-89da-1db8354b9cc2 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:31.050578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-773c8d8f-7b69-4f93-89da-1db8354b9cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:31.148628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 678/1381] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:31.194359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d550bd-4dd3-40f9-b15d-39e2bfc2b0e5 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:31.195874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-91d550bd-4dd3-40f9-b15d-39e2bfc2b0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:31.341833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:31.351764 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d550bd-4dd3-40f9-b15d-39e2bfc2b0e5 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:31.472285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ece17-af74-4bf0-b5e8-32879585a3be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:31.472960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ece17-af74-4bf0-b5e8-32879585a3be service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:31.473273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ece17-af74-4bf0-b5e8-32879585a3be service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:31.473543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ece17-af74-4bf0-b5e8-32879585a3be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:31.475164 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-375ece17-af74-4bf0-b5e8-32879585a3be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:31.571271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ece17-af74-4bf0-b5e8-32879585a3be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:31.572881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ece17-af74-4bf0-b5e8-32879585a3be service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:31.585711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:31.594770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 704/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:33.745963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737a663-55f7-4efd-af88-f2e18ec5dcb3 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:33.746518 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737a663-55f7-4efd-af88-f2e18ec5dcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:33.746518 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737a663-55f7-4efd-af88-f2e18ec5dcb3 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:33.747853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 679/1383] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:33.753774 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ed6cf-9d1b-4c70-89a8-1115dc3a5e22 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:33.754304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ed6cf-9d1b-4c70-89a8-1115dc3a5e22 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:33.754304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ed6cf-9d1b-4c70-89a8-1115dc3a5e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:33.820241 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a10ed6cf-9d1b-4c70-89a8-1115dc3a5e22 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:33.821502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a10ed6cf-9d1b-4c70-89a8-1115dc3a5e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:33.928180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 705/1384] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:33.970967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737a663-55f7-4efd-af88-f2e18ec5dcb3 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:33.972572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0737a663-55f7-4efd-af88-f2e18ec5dcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:34.065101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:34.127313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737a663-55f7-4efd-af88-f2e18ec5dcb3 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:34.243275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1fee4-604e-4e77-92d4-228c84e7d134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:34.243929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1fee4-604e-4e77-92d4-228c84e7d134 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:34.244216 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1fee4-604e-4e77-92d4-228c84e7d134 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:34.244492 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1fee4-604e-4e77-92d4-228c84e7d134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:34.246188 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-76b1fee4-604e-4e77-92d4-228c84e7d134 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:34.296776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:34.340681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1fee4-604e-4e77-92d4-228c84e7d134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:34.342371 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1fee4-604e-4e77-92d4-228c84e7d134 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:34.361707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 680/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:36.391644 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baec675-ac22-4b5d-8a18-117ed51f5c86 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:36.392190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baec675-ac22-4b5d-8a18-117ed51f5c86 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:36.392302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baec675-ac22-4b5d-8a18-117ed51f5c86 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:36.393680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 706/1386] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:36.399456 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafd2fc-bd18-402c-ae33-3e16c9650bf6 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:36.400222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafd2fc-bd18-402c-ae33-3e16c9650bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:36.400222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafd2fc-bd18-402c-ae33-3e16c9650bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:36.472341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-4cafd2fc-bd18-402c-ae33-3e16c9650bf6 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:36.473611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-4cafd2fc-bd18-402c-ae33-3e16c9650bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:36.578672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 681/1387] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:36.630453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baec675-ac22-4b5d-8a18-117ed51f5c86 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:36.633506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8baec675-ac22-4b5d-8a18-117ed51f5c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:36.769561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:36.868565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baec675-ac22-4b5d-8a18-117ed51f5c86 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:36.983084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb664ef-8e52-4c06-b57b-c9d5dca62268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:36.984135 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb664ef-8e52-4c06-b57b-c9d5dca62268 service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:36.984515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb664ef-8e52-4c06-b57b-c9d5dca62268 service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:36.984879 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb664ef-8e52-4c06-b57b-c9d5dca62268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:36.987604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9eb664ef-8e52-4c06-b57b-c9d5dca62268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:37.033772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:37.089546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb664ef-8e52-4c06-b57b-c9d5dca62268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:37.091241 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb664ef-8e52-4c06-b57b-c9d5dca62268 service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:37.109479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 707/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:39.362147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee68ba-0088-4000-95ef-d576c00d7ceb None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:39.362689 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee68ba-0088-4000-95ef-d576c00d7ceb None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:39.362689 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee68ba-0088-4000-95ef-d576c00d7ceb None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:39.364070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 682/1389] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:39.369388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30e21b-77ab-48ea-bb82-fda2f8c3eb23 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:39.369784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30e21b-77ab-48ea-bb82-fda2f8c3eb23 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:39.369947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30e21b-77ab-48ea-bb82-fda2f8c3eb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:39.436169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ee30e21b-77ab-48ea-bb82-fda2f8c3eb23 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:39.437400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ee30e21b-77ab-48ea-bb82-fda2f8c3eb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:39.540340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 708/1390] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:39.584235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee68ba-0088-4000-95ef-d576c00d7ceb None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:39.585774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-33ee68ba-0088-4000-95ef-d576c00d7ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:39.617459 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:39.733394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee68ba-0088-4000-95ef-d576c00d7ceb None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:39.834952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:39.847573 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462e531-fb21-4228-8258-7ebcc5d32004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:39.848828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462e531-fb21-4228-8258-7ebcc5d32004 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:39.848828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462e531-fb21-4228-8258-7ebcc5d32004 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:39.848828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462e531-fb21-4228-8258-7ebcc5d32004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:39.850482 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c462e531-fb21-4228-8258-7ebcc5d32004 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:39.943098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462e531-fb21-4228-8258-7ebcc5d32004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:39.944653 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462e531-fb21-4228-8258-7ebcc5d32004 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:39.962656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 683/1391] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:40.393700 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5617f3-5ed6-487d-bedc-ad9e738c8cd4 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:40.394264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5617f3-5ed6-487d-bedc-ad9e738c8cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:40.394264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5617f3-5ed6-487d-bedc-ad9e738c8cd4 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:40.395630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 709/1392] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:40.401035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876390b-e546-48fc-9882-e579d8c66e7f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:40.401519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876390b-e546-48fc-9882-e579d8c66e7f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:40.401651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876390b-e546-48fc-9882-e579d8c66e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:40.469634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e876390b-e546-48fc-9882-e579d8c66e7f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:40.471357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e876390b-e546-48fc-9882-e579d8c66e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:40.531162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:40.571757 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 684/1393] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:40.630137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac27da1-5c31-43b2-9b80-0d6ee96e733e None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:40.630422 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac27da1-5c31-43b2-9b80-0d6ee96e733e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:40.630693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac27da1-5c31-43b2-9b80-0d6ee96e733e None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:40.632156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 710/1394] 10.222.0.26 () {54 vars in 962 bytes} [Tue Jul 12 16:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:40.637540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b51bd-32d1-4a2d-a08c-b13adac94ca4 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:40.637850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b51bd-32d1-4a2d-a08c-b13adac94ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:40.638144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b51bd-32d1-4a2d-a08c-b13adac94ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:40.715391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-bc5b51bd-32d1-4a2d-a08c-b13adac94ca4 None None] MFA Rules not processed for user `f9f9ba17c2634999b350b887a5229e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:40.716523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-bc5b51bd-32d1-4a2d-a08c-b13adac94ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:40.792081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 685/1395] 10.222.0.26 () {58 vars in 1059 bytes} [Tue Jul 12 16:21:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:40.800155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac27da1-5c31-43b2-9b80-0d6ee96e733e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:40.801811 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1ac27da1-5c31-43b2-9b80-0d6ee96e733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:40.816254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:40.907010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac27da1-5c31-43b2-9b80-0d6ee96e733e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:40.979796 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98775fc-b68b-4513-9181-557e115566e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f9ba17c2634999b350b887a5229e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:40.980694 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98775fc-b68b-4513-9181-557e115566e4 service glance] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:40.980972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98775fc-b68b-4513-9181-557e115566e4 service glance] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:40.981286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98775fc-b68b-4513-9181-557e115566e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:40.982924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a98775fc-b68b-4513-9181-557e115566e4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:41.051603 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:41.092688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98775fc-b68b-4513-9181-557e115566e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:41.094165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98775fc-b68b-4513-9181-557e115566e4 service glance] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:41.113723 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 711/1396] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:41.943500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367ab80-ca0f-4fd7-83d6-54cc81721dd8 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:41.943974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367ab80-ca0f-4fd7-83d6-54cc81721dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:41.944091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367ab80-ca0f-4fd7-83d6-54cc81721dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:42.009284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-d367ab80-ca0f-4fd7-83d6-54cc81721dd8 None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:42.010483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d367ab80-ca0f-4fd7-83d6-54cc81721dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:42.019376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:42.100568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 686/1397] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:21:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:42.141526 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05218b25-0a93-4311-887b-971f01b41e95 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:42.141984 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05218b25-0a93-4311-887b-971f01b41e95 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:42.142670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05218b25-0a93-4311-887b-971f01b41e95 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:42.144226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 712/1398] 10.222.0.26 () {54 vars in 942 bytes} [Tue Jul 12 16:21:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:42.150216 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a100-b598-4a63-8a7a-7aeaf97f8649 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:42.150541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a100-b598-4a63-8a7a-7aeaf97f8649 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:42.150839 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a100-b598-4a63-8a7a-7aeaf97f8649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:42.208241 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634fca4-b8bb-4327-9653-14164a426587 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:42.208526 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634fca4-b8bb-4327-9653-14164a426587 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:42.208808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634fca4-b8bb-4327-9653-14164a426587 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:42.210239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 713/1399] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:21:42.215344 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafea9d-0e07-4e00-a60c-955ba101612d None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:42.215632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafea9d-0e07-4e00-a60c-955ba101612d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:42.215913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafea9d-0e07-4e00-a60c-955ba101612d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:42.228742 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-2a11a100-b598-4a63-8a7a-7aeaf97f8649 None None] MFA Rules not processed for user `143798e5887b49338f0000de5b55be68`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:42.230010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2a11a100-b598-4a63-8a7a-7aeaf97f8649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:42.282159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ffafea9d-0e07-4e00-a60c-955ba101612d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:42.283967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ffafea9d-0e07-4e00-a60c-955ba101612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:42.319958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:42.343566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 687/1400] 10.222.0.26 () {58 vars in 1039 bytes} [Tue Jul 12 16:21:42 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:42.354000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11a100-b598-4a63-8a7a-7aeaf97f8649 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:42.364463 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11a100-b598-4a63-8a7a-7aeaf97f8649 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:42.383771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 714/1401] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:21:42.452744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafea9d-0e07-4e00-a60c-955ba101612d None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:42.452744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ffafea9d-0e07-4e00-a60c-955ba101612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:42.460440 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:42.480850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdff16-de5f-4dc9-a834-508034bbf6aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:42.481545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdff16-de5f-4dc9-a834-508034bbf6aa service swift] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:42.481876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdff16-de5f-4dc9-a834-508034bbf6aa service swift] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:42.482187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdff16-de5f-4dc9-a834-508034bbf6aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:42.483949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b6fdff16-de5f-4dc9-a834-508034bbf6aa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:42.552029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafea9d-0e07-4e00-a60c-955ba101612d None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:42.573489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdff16-de5f-4dc9-a834-508034bbf6aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:42.575166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdff16-de5f-4dc9-a834-508034bbf6aa service swift] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:42.583783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 688/1402] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:21:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 16:21:42.668200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44f4fb-3a2b-4488-a23a-2fc18f4141f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:42.668772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44f4fb-3a2b-4488-a23a-2fc18f4141f9 service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:42.669054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44f4fb-3a2b-4488-a23a-2fc18f4141f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:42.669354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44f4fb-3a2b-4488-a23a-2fc18f4141f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:42.670971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3b44f4fb-3a2b-4488-a23a-2fc18f4141f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:42.688377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:42.758614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44f4fb-3a2b-4488-a23a-2fc18f4141f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:42.760197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44f4fb-3a2b-4488-a23a-2fc18f4141f9 service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:42.778759 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 715/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:21:45.043092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc1b43-1761-4cdd-97b6-a08bc00804f7 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:45.043748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc1b43-1761-4cdd-97b6-a08bc00804f7 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:45.043748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc1b43-1761-4cdd-97b6-a08bc00804f7 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:45.048858 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 689/1404] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:45.050241 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40318a87-5736-44ad-bb2f-5ccc8b6d4bd5 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:45.050654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40318a87-5736-44ad-bb2f-5ccc8b6d4bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:45.050951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40318a87-5736-44ad-bb2f-5ccc8b6d4bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:45.124944 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-40318a87-5736-44ad-bb2f-5ccc8b6d4bd5 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:45.126226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-40318a87-5736-44ad-bb2f-5ccc8b6d4bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:45.229603 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:45.236601 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 716/1405] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:45.283569 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc1b43-1761-4cdd-97b6-a08bc00804f7 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:45.285939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6cdc1b43-1761-4cdd-97b6-a08bc00804f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:45.297341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:45.460391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc1b43-1761-4cdd-97b6-a08bc00804f7 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:45.552331 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:45.589961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc9acc-f1d5-4112-be04-b2770f705d77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:45.590913 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9acc-f1d5-4112-be04-b2770f705d77 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:45.591193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9acc-f1d5-4112-be04-b2770f705d77 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:45.591464 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9acc-f1d5-4112-be04-b2770f705d77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:45.593105 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-85dc9acc-f1d5-4112-be04-b2770f705d77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:45.689022 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc9acc-f1d5-4112-be04-b2770f705d77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:45.690650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc9acc-f1d5-4112-be04-b2770f705d77 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:45.714709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 690/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:21:47.933527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b1238-991b-42fa-ae90-9dd42fe33bcc None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:47.934091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b1238-991b-42fa-ae90-9dd42fe33bcc None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:47.934091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b1238-991b-42fa-ae90-9dd42fe33bcc None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:47.935462 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 717/1407] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:21:47.940753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09e640-beef-41d7-9e33-9ca32df01f26 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:47.941215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09e640-beef-41d7-9e33-9ca32df01f26 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:47.941457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09e640-beef-41d7-9e33-9ca32df01f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:48.010258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-8a09e640-beef-41d7-9e33-9ca32df01f26 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:21:48.011382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8a09e640-beef-41d7-9e33-9ca32df01f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:48.060348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:48.119949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 691/1408] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:21:48.164274 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b1238-991b-42fa-ae90-9dd42fe33bcc None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:21:48.165809 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-5e9b1238-991b-42fa-ae90-9dd42fe33bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:48.330472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b1238-991b-42fa-ae90-9dd42fe33bcc None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:21:48.405373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:48.464403 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34326d1-b23d-407d-8813-d9477e16a5eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:21:48.465189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34326d1-b23d-407d-8813-d9477e16a5eb service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:21:48.465571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34326d1-b23d-407d-8813-d9477e16a5eb service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:21:48.465986 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34326d1-b23d-407d-8813-d9477e16a5eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:21:48.468812 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e34326d1-b23d-407d-8813-d9477e16a5eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:21:48.567803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34326d1-b23d-407d-8813-d9477e16a5eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:21:48.569444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34326d1-b23d-407d-8813-d9477e16a5eb service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:21:48.588871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 718/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:21:58.117499 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=23 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:21:58.586618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=64 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:05.917860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1fbbe-b8eb-428b-8544-3a5af3b3c424 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:05.918419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1fbbe-b8eb-428b-8544-3a5af3b3c424 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:05.918419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1fbbe-b8eb-428b-8544-3a5af3b3c424 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:05.919808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 692/1410] 10.222.0.26 () {54 vars in 918 bytes} [Tue Jul 12 16:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:05.925486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2391448-4921-415b-ba0f-12ac9f2133af None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:05.925949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2391448-4921-415b-ba0f-12ac9f2133af None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:05.926061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2391448-4921-415b-ba0f-12ac9f2133af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:05.998895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-c2391448-4921-415b-ba0f-12ac9f2133af None None] MFA Rules not processed for user `b62795a6111a4c05a24e69efc7a0faba`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:06.000015 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c2391448-4921-415b-ba0f-12ac9f2133af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:06.106188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 719/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Jul 12 16:22:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:06.120778 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838d63d-6ac3-4775-835c-de51b2caa970 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:06.121068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838d63d-6ac3-4775-835c-de51b2caa970 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:06.121391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838d63d-6ac3-4775-835c-de51b2caa970 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:06.122790 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 693/1412] 10.222.0.26 () {54 vars in 918 bytes} [Tue Jul 12 16:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:06.127997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88161800-8a97-46a6-908e-4558e0d5d493 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:06.128288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88161800-8a97-46a6-908e-4558e0d5d493 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:06.128572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88161800-8a97-46a6-908e-4558e0d5d493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:06.198930 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:06.201439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-88161800-8a97-46a6-908e-4558e0d5d493 None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:06.202652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-88161800-8a97-46a6-908e-4558e0d5d493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:06.318847 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 720/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Jul 12 16:22:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:08.801092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b4d50-771a-4d27-b617-885f41d49739 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:08.801650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b4d50-771a-4d27-b617-885f41d49739 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:08.801650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b4d50-771a-4d27-b617-885f41d49739 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:08.802982 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:08.808510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb5855-afda-433e-9daa-8dbef4107525 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:08.808952 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb5855-afda-433e-9daa-8dbef4107525 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:08.809059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb5855-afda-433e-9daa-8dbef4107525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:08.872775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-30bb5855-afda-433e-9daa-8dbef4107525 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:08.874010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-30bb5855-afda-433e-9daa-8dbef4107525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:08.927366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:08.969367 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:09.011122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b4d50-771a-4d27-b617-885f41d49739 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:09.012652 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c83b4d50-771a-4d27-b617-885f41d49739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:09.156424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b4d50-771a-4d27-b617-885f41d49739 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:09.228713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:09.268951 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dac5a-ec06-4a9f-b469-14bf48f3e448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:09.269632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dac5a-ec06-4a9f-b469-14bf48f3e448 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:09.269943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dac5a-ec06-4a9f-b469-14bf48f3e448 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:09.270220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dac5a-ec06-4a9f-b469-14bf48f3e448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:09.271864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-486dac5a-ec06-4a9f-b469-14bf48f3e448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:09.358580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dac5a-ec06-4a9f-b469-14bf48f3e448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:09.360174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dac5a-ec06-4a9f-b469-14bf48f3e448 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:09.378860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 695/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:10.279324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb5ab1-7276-4c1f-93f7-bb3e6ce1dd1a None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:10.279899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb5ab1-7276-4c1f-93f7-bb3e6ce1dd1a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:10.279899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb5ab1-7276-4c1f-93f7-bb3e6ce1dd1a None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:10.281873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 16:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:10.286800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc59fc-e42a-4217-9a2c-a387d37996a0 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:10.287206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc59fc-e42a-4217-9a2c-a387d37996a0 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:10.287359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc59fc-e42a-4217-9a2c-a387d37996a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:10.361861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-fbcc59fc-e42a-4217-9a2c-a387d37996a0 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:10.363066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-fbcc59fc-e42a-4217-9a2c-a387d37996a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:10.389668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:10.459947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 16:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:10.609807 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb5ab1-7276-4c1f-93f7-bb3e6ce1dd1a None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:10.611892 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bbbb5ab1-7276-4c1f-93f7-bb3e6ce1dd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:10.756418 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb5ab1-7276-4c1f-93f7-bb3e6ce1dd1a None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:10.795137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:10.867112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54569198-0d35-470b-af7e-d83dd35328bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:10.867688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54569198-0d35-470b-af7e-d83dd35328bf service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:10.867973 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54569198-0d35-470b-af7e-d83dd35328bf service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:10.868248 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54569198-0d35-470b-af7e-d83dd35328bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:10.869920 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-54569198-0d35-470b-af7e-d83dd35328bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:10.958374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54569198-0d35-470b-af7e-d83dd35328bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:10.959967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54569198-0d35-470b-af7e-d83dd35328bf service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:10.978173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 723/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:11.855392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb20e8c-dfe6-4f7f-bc25-aa270c6890a2 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:11.855949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb20e8c-dfe6-4f7f-bc25-aa270c6890a2 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:11.855949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb20e8c-dfe6-4f7f-bc25-aa270c6890a2 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:11.857378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 16:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:11.862857 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9d69f-5e52-4b52-8403-90d632cb6637 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:11.863268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9d69f-5e52-4b52-8403-90d632cb6637 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:11.863792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9d69f-5e52-4b52-8403-90d632cb6637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:11.914828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:11.936697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-05b9d69f-5e52-4b52-8403-90d632cb6637 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:11.938038 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-05b9d69f-5e52-4b52-8403-90d632cb6637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:12.033071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 16:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:12.184434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb20e8c-dfe6-4f7f-bc25-aa270c6890a2 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:12.186035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-ceb20e8c-dfe6-4f7f-bc25-aa270c6890a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:12.338597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb20e8c-dfe6-4f7f-bc25-aa270c6890a2 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:12.351450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:12.453359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1470350-b640-45bb-a9ba-26a5f599bf73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:12.454626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1470350-b640-45bb-a9ba-26a5f599bf73 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:12.455047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1470350-b640-45bb-a9ba-26a5f599bf73 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:12.455318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1470350-b640-45bb-a9ba-26a5f599bf73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:12.456971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e1470350-b640-45bb-a9ba-26a5f599bf73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:12.543529 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1470350-b640-45bb-a9ba-26a5f599bf73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:12.545141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1470350-b640-45bb-a9ba-26a5f599bf73 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:12.562875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 698/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:13.418835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da7623-d6cc-4372-a52f-deefb841ecb9 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:13.419398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da7623-d6cc-4372-a52f-deefb841ecb9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:13.419398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da7623-d6cc-4372-a52f-deefb841ecb9 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:13.420790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 16:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:13.426216 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38078e4-c021-4aa9-8e17-4022095d5739 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:13.426643 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38078e4-c021-4aa9-8e17-4022095d5739 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:13.426774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38078e4-c021-4aa9-8e17-4022095d5739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:13.444985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:13.501166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a38078e4-c021-4aa9-8e17-4022095d5739 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:13.502385 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a38078e4-c021-4aa9-8e17-4022095d5739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:13.596778 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 16:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:13.744047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da7623-d6cc-4372-a52f-deefb841ecb9 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:13.745593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-23da7623-d6cc-4372-a52f-deefb841ecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:13.854856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:13.890044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da7623-d6cc-4372-a52f-deefb841ecb9 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:14.000790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ec67e-96e5-4108-91c8-e99a40bccd0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:14.001910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ec67e-96e5-4108-91c8-e99a40bccd0f service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:14.002190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ec67e-96e5-4108-91c8-e99a40bccd0f service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:14.002466 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ec67e-96e5-4108-91c8-e99a40bccd0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:14.004112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9b6ec67e-96e5-4108-91c8-e99a40bccd0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:14.080596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:14.093816 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ec67e-96e5-4108-91c8-e99a40bccd0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:14.095476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ec67e-96e5-4108-91c8-e99a40bccd0f service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:14.113648 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 726/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:14.965648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c4efd-1807-41c4-b4fe-6adbd98d47ea None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:14.966229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c4efd-1807-41c4-b4fe-6adbd98d47ea None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:14.966229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c4efd-1807-41c4-b4fe-6adbd98d47ea None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:14.967630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 16:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:14.973181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af58b8-fccd-44bd-9fad-d43f3d2f9b5b None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:14.973629 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af58b8-fccd-44bd-9fad-d43f3d2f9b5b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:14.973750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af58b8-fccd-44bd-9fad-d43f3d2f9b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:15.046036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-02af58b8-fccd-44bd-9fad-d43f3d2f9b5b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:15.047250 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-02af58b8-fccd-44bd-9fad-d43f3d2f9b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:15.142923 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 16:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:15.294143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c4efd-1807-41c4-b4fe-6adbd98d47ea None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:15.295658 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9f7c4efd-1807-41c4-b4fe-6adbd98d47ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:15.379719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:15.440990 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c4efd-1807-41c4-b4fe-6adbd98d47ea None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:15.552632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f69c1-a134-436d-ac63-0c38160a5d0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:15.553499 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f69c1-a134-436d-ac63-0c38160a5d0e service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:15.553786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f69c1-a134-436d-ac63-0c38160a5d0e service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:15.554061 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f69c1-a134-436d-ac63-0c38160a5d0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:15.555704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-ff2f69c1-a134-436d-ac63-0c38160a5d0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:15.602128 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:15.641630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f69c1-a134-436d-ac63-0c38160a5d0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:15.643345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f69c1-a134-436d-ac63-0c38160a5d0e service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:15.661861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 701/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:16.623484 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba31038-40b7-4669-88c6-98645ef84c1e None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:16.624081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba31038-40b7-4669-88c6-98645ef84c1e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:16.624081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba31038-40b7-4669-88c6-98645ef84c1e None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:16.625516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 16:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:16.630976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25951468-8234-4965-9d43-e0bf3933fa39 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:16.631425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25951468-8234-4965-9d43-e0bf3933fa39 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:16.631546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25951468-8234-4965-9d43-e0bf3933fa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:16.704928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-25951468-8234-4965-9d43-e0bf3933fa39 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:16.706177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-25951468-8234-4965-9d43-e0bf3933fa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:16.805794 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 16:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:16.956419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba31038-40b7-4669-88c6-98645ef84c1e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:16.957985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0ba31038-40b7-4669-88c6-98645ef84c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:17.006925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:17.101343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba31038-40b7-4669-88c6-98645ef84c1e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:17.212394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c19b36-abe0-424f-ad09-1d0b71a185cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:17.213045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c19b36-abe0-424f-ad09-1d0b71a185cd service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:17.213370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c19b36-abe0-424f-ad09-1d0b71a185cd service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:17.213651 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c19b36-abe0-424f-ad09-1d0b71a185cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:17.215287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-77c19b36-abe0-424f-ad09-1d0b71a185cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:17.222647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:17.305531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c19b36-abe0-424f-ad09-1d0b71a185cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:17.307212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c19b36-abe0-424f-ad09-1d0b71a185cd service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:17.325043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 729/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:18.205145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c372a46-456c-44d7-be8e-a69f1c9eb065 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:18.205763 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c372a46-456c-44d7-be8e-a69f1c9eb065 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:18.205763 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c372a46-456c-44d7-be8e-a69f1c9eb065 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:18.207076 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 16:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:18.211870 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11751aa3-742d-4e66-a162-a7e3baf565c5 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:18.212287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11751aa3-742d-4e66-a162-a7e3baf565c5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:18.212433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11751aa3-742d-4e66-a162-a7e3baf565c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:18.286277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-11751aa3-742d-4e66-a162-a7e3baf565c5 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:18.287491 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-11751aa3-742d-4e66-a162-a7e3baf565c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:18.355803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:18.386667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 16:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:18.536071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c372a46-456c-44d7-be8e-a69f1c9eb065 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:18.537635 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6c372a46-456c-44d7-be8e-a69f1c9eb065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:18.555700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:18.682986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c372a46-456c-44d7-be8e-a69f1c9eb065 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:18.768511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:18.795909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9737f6-5bff-4915-9f48-a9eefcedf89f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:18.796609 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9737f6-5bff-4915-9f48-a9eefcedf89f service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:18.797080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9737f6-5bff-4915-9f48-a9eefcedf89f service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:18.797415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9737f6-5bff-4915-9f48-a9eefcedf89f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:18.800008 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-db9737f6-5bff-4915-9f48-a9eefcedf89f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:18.887373 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9737f6-5bff-4915-9f48-a9eefcedf89f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:18.888971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9737f6-5bff-4915-9f48-a9eefcedf89f service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:18.906986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 704/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:19.766195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d7e8b-76c9-4754-9044-cf23d517cf35 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:19.766690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d7e8b-76c9-4754-9044-cf23d517cf35 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:19.766789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d7e8b-76c9-4754-9044-cf23d517cf35 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:19.768176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 16:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:19.773064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e802d7b-9b40-41c3-b281-86888fd2f913 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:19.773511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e802d7b-9b40-41c3-b281-86888fd2f913 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:19.773661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e802d7b-9b40-41c3-b281-86888fd2f913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:19.847016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-7e802d7b-9b40-41c3-b281-86888fd2f913 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:19.848219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7e802d7b-9b40-41c3-b281-86888fd2f913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:19.889911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:19.945136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 16:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:20.097041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d7e8b-76c9-4754-9044-cf23d517cf35 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:20.098630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1b8d7e8b-76c9-4754-9044-cf23d517cf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:20.242056 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d7e8b-76c9-4754-9044-cf23d517cf35 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:20.296908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:20.360749 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c212d6-13f2-47dd-a5c8-edc37c3765dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:20.361355 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c212d6-13f2-47dd-a5c8-edc37c3765dd service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:20.361637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c212d6-13f2-47dd-a5c8-edc37c3765dd service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:20.361909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c212d6-13f2-47dd-a5c8-edc37c3765dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:20.363549 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-31c212d6-13f2-47dd-a5c8-edc37c3765dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:20.452666 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c212d6-13f2-47dd-a5c8-edc37c3765dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:20.454313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c212d6-13f2-47dd-a5c8-edc37c3765dd service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:20.473577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 732/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:22:21.334291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e621f-b7e7-4e73-b76f-aa92901d1cdf None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:21.334859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e621f-b7e7-4e73-b76f-aa92901d1cdf None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:21.334859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e621f-b7e7-4e73-b76f-aa92901d1cdf None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:21.336289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 16:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:21.341083 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0cc93-d9db-47de-a6ed-b514a2cc182c None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:21.341579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0cc93-d9db-47de-a6ed-b514a2cc182c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:21.341685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0cc93-d9db-47de-a6ed-b514a2cc182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:21.415287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-57f0cc93-d9db-47de-a6ed-b514a2cc182c None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:21.416496 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-57f0cc93-d9db-47de-a6ed-b514a2cc182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:21.418547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:21.513901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 16:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:22:21.663125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e621f-b7e7-4e73-b76f-aa92901d1cdf None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:21.664580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-dc3e621f-b7e7-4e73-b76f-aa92901d1cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:21.811265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e621f-b7e7-4e73-b76f-aa92901d1cdf None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:21.839126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:21.924938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92807d89-9c0c-4f52-852c-b021b7a18847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:21.925546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92807d89-9c0c-4f52-852c-b021b7a18847 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:21.925829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92807d89-9c0c-4f52-852c-b021b7a18847 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:21.926103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92807d89-9c0c-4f52-852c-b021b7a18847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:21.927746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-92807d89-9c0c-4f52-852c-b021b7a18847 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:22.014389 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92807d89-9c0c-4f52-852c-b021b7a18847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:22.015974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92807d89-9c0c-4f52-852c-b021b7a18847 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:22.035147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 707/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:23.960404 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e67e83-99ee-4e0f-8385-3cc837813125 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:23.960972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e67e83-99ee-4e0f-8385-3cc837813125 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:23.960972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e67e83-99ee-4e0f-8385-3cc837813125 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:23.962354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:23.967843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b997e-480a-4952-bf47-eadc7a7723d7 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:23.968269 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b997e-480a-4952-bf47-eadc7a7723d7 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:23.968414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b997e-480a-4952-bf47-eadc7a7723d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:24.007593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:24.032446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-644b997e-480a-4952-bf47-eadc7a7723d7 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:24.033725 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-644b997e-480a-4952-bf47-eadc7a7723d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:24.130894 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:24.168543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e67e83-99ee-4e0f-8385-3cc837813125 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:24.170117 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-61e67e83-99ee-4e0f-8385-3cc837813125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:24.273047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e67e83-99ee-4e0f-8385-3cc837813125 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:24.304962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:24.346398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f70f5f-5b40-43ad-b7ed-e14d02d6e4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:24.347045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f70f5f-5b40-43ad-b7ed-e14d02d6e4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:24.347419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f70f5f-5b40-43ad-b7ed-e14d02d6e4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:24.347699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f70f5f-5b40-43ad-b7ed-e14d02d6e4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:24.349369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-96f70f5f-5b40-43ad-b7ed-e14d02d6e4e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:24.458543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f70f5f-5b40-43ad-b7ed-e14d02d6e4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:24.459981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f70f5f-5b40-43ad-b7ed-e14d02d6e4e0 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:24.478618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 735/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:26.645505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738477b-3d73-45eb-bacc-331b8fc8c856 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:26.646067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738477b-3d73-45eb-bacc-331b8fc8c856 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:26.646067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738477b-3d73-45eb-bacc-331b8fc8c856 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:26.647399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:26.652776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca2453-3382-4f37-9615-7925593fbebb None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:26.653221 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca2453-3382-4f37-9615-7925593fbebb None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:26.653372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca2453-3382-4f37-9615-7925593fbebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:26.716376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-eeca2453-3382-4f37-9615-7925593fbebb None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:26.717594 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-eeca2453-3382-4f37-9615-7925593fbebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:26.730574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:26.814481 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:26.851457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738477b-3d73-45eb-bacc-331b8fc8c856 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:26.852981 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0738477b-3d73-45eb-bacc-331b8fc8c856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:26.954892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738477b-3d73-45eb-bacc-331b8fc8c856 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:26.966651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:27.027632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6f2af-3868-46d9-845b-09da43f392b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:27.028282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6f2af-3868-46d9-845b-09da43f392b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:27.028570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6f2af-3868-46d9-845b-09da43f392b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:27.028849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6f2af-3868-46d9-845b-09da43f392b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:27.030559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6cc6f2af-3868-46d9-845b-09da43f392b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:27.139025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6f2af-3868-46d9-845b-09da43f392b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:27.140459 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6f2af-3868-46d9-845b-09da43f392b2 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:27.159391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 710/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:29.517680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8614e-2c6b-4676-bb74-aff73f78f148 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:29.518207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8614e-2c6b-4676-bb74-aff73f78f148 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:29.518325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8614e-2c6b-4676-bb74-aff73f78f148 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:29.519618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:22:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:29.524887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f2ce1-cf48-4e95-acc5-bc607bb652c2 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:29.525427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f2ce1-cf48-4e95-acc5-bc607bb652c2 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:29.525533 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f2ce1-cf48-4e95-acc5-bc607bb652c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:29.571406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:29.589414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-679f2ce1-cf48-4e95-acc5-bc607bb652c2 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:29.590621 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-679f2ce1-cf48-4e95-acc5-bc607bb652c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:29.686370 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:29.725695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8614e-2c6b-4676-bb74-aff73f78f148 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:29.727225 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c4f8614e-2c6b-4676-bb74-aff73f78f148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:29.828452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8614e-2c6b-4676-bb74-aff73f78f148 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:29.867917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:29.904244 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7671c-e26e-4b74-a9a5-513672b9fbb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:29.904893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7671c-e26e-4b74-a9a5-513672b9fbb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:29.905202 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7671c-e26e-4b74-a9a5-513672b9fbb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:29.905482 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7671c-e26e-4b74-a9a5-513672b9fbb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:29.907118 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-16a7671c-e26e-4b74-a9a5-513672b9fbb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:30.013976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7671c-e26e-4b74-a9a5-513672b9fbb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:30.015386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7671c-e26e-4b74-a9a5-513672b9fbb6 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:30.034225 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 738/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:22:32.188501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936d16-6e03-4cd3-a68c-7fe59775210f None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:32.189599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936d16-6e03-4cd3-a68c-7fe59775210f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:32.189599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936d16-6e03-4cd3-a68c-7fe59775210f None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:32.191057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:32.196377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593feb-fa17-441c-bb74-e8e97c8a6385 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:32.196812 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593feb-fa17-441c-bb74-e8e97c8a6385 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:32.196921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593feb-fa17-441c-bb74-e8e97c8a6385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:32.260870 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-b4593feb-fa17-441c-bb74-e8e97c8a6385 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:32.262161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b4593feb-fa17-441c-bb74-e8e97c8a6385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:32.283194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:32.359293 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:32.401480 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87936d16-6e03-4cd3-a68c-7fe59775210f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:32.403016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-87936d16-6e03-4cd3-a68c-7fe59775210f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:32.508880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87936d16-6e03-4cd3-a68c-7fe59775210f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:32.528630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:32.582441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db068a4e-f04d-410f-9f8d-9d1be4d8b51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:32.583121 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db068a4e-f04d-410f-9f8d-9d1be4d8b51b service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:32.583406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db068a4e-f04d-410f-9f8d-9d1be4d8b51b service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:32.583685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db068a4e-f04d-410f-9f8d-9d1be4d8b51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:32.585382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-db068a4e-f04d-410f-9f8d-9d1be4d8b51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:32.693101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db068a4e-f04d-410f-9f8d-9d1be4d8b51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:32.694564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db068a4e-f04d-410f-9f8d-9d1be4d8b51b service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:32.712353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 713/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:34.822522 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9645-fa94-4b20-8c2e-142319ec266a None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:34.823062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9645-fa94-4b20-8c2e-142319ec266a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:34.823164 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9645-fa94-4b20-8c2e-142319ec266a None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:34.824503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:34.829803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ae5da-2b73-411b-b542-44a72d232111 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:34.830231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ae5da-2b73-411b-b542-44a72d232111 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:34.830343 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ae5da-2b73-411b-b542-44a72d232111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:34.892811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:34.895496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-999ae5da-2b73-411b-b542-44a72d232111 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:34.896709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-999ae5da-2b73-411b-b542-44a72d232111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:34.994046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:35.030876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9645-fa94-4b20-8c2e-142319ec266a None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:35.032393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f79b9645-fa94-4b20-8c2e-142319ec266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:35.133686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9645-fa94-4b20-8c2e-142319ec266a None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:35.181610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:35.205250 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ef21b-3b51-46a9-8697-ad09d5217e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:35.205899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ef21b-3b51-46a9-8697-ad09d5217e16 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:35.206184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ef21b-3b51-46a9-8697-ad09d5217e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:35.206461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ef21b-3b51-46a9-8697-ad09d5217e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:35.208099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-5c9ef21b-3b51-46a9-8697-ad09d5217e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:35.314030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ef21b-3b51-46a9-8697-ad09d5217e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:35.315465 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ef21b-3b51-46a9-8697-ad09d5217e16 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:35.334890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 741/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:37.480765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddae5f9-af27-4daf-bcc8-63400f660d4c None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:37.481290 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddae5f9-af27-4daf-bcc8-63400f660d4c None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:37.481403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddae5f9-af27-4daf-bcc8-63400f660d4c None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:37.482745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:37.488682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566490f-d3b7-48b9-8e50-058ab912e417 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:37.489082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566490f-d3b7-48b9-8e50-058ab912e417 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:37.489280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566490f-d3b7-48b9-8e50-058ab912e417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:37.552392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-4566490f-d3b7-48b9-8e50-058ab912e417 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:37.553950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4566490f-d3b7-48b9-8e50-058ab912e417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:37.582775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:37.648779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:37.687124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddae5f9-af27-4daf-bcc8-63400f660d4c None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:37.688662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-dddae5f9-af27-4daf-bcc8-63400f660d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:37.793023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddae5f9-af27-4daf-bcc8-63400f660d4c None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:37.821404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:37.866841 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f55719-d4e2-4947-a36f-37c1e83ad6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:37.867487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f55719-d4e2-4947-a36f-37c1e83ad6cf service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:37.867776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f55719-d4e2-4947-a36f-37c1e83ad6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:37.868051 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f55719-d4e2-4947-a36f-37c1e83ad6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:37.869719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-91f55719-d4e2-4947-a36f-37c1e83ad6cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:37.977705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f55719-d4e2-4947-a36f-37c1e83ad6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:37.979144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f55719-d4e2-4947-a36f-37c1e83ad6cf service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:37.998385 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 716/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:40.073371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59594-e5fc-4a54-bd7c-c1aa92120ff5 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:40.073913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59594-e5fc-4a54-bd7c-c1aa92120ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:40.073913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59594-e5fc-4a54-bd7c-c1aa92120ff5 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:40.075322 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:40.081315 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842ff79-6a34-473f-be26-0d2be01b9da0 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:40.081769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842ff79-6a34-473f-be26-0d2be01b9da0 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:40.081879 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842ff79-6a34-473f-be26-0d2be01b9da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:40.145218 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-7842ff79-6a34-473f-be26-0d2be01b9da0 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:40.146422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7842ff79-6a34-473f-be26-0d2be01b9da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:40.154566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:40.242611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:40.280532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59594-e5fc-4a54-bd7c-c1aa92120ff5 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:40.282100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4ce59594-e5fc-4a54-bd7c-c1aa92120ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:40.385205 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59594-e5fc-4a54-bd7c-c1aa92120ff5 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:40.440118 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:40.460208 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82e2d7-ce34-4251-9fda-ef839ddc5ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:40.460902 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82e2d7-ce34-4251-9fda-ef839ddc5ffc service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:40.461260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82e2d7-ce34-4251-9fda-ef839ddc5ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:40.461545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82e2d7-ce34-4251-9fda-ef839ddc5ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:40.463191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-6b82e2d7-ce34-4251-9fda-ef839ddc5ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:40.571310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82e2d7-ce34-4251-9fda-ef839ddc5ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:40.572756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82e2d7-ce34-4251-9fda-ef839ddc5ffc service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:40.590834 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 744/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:42.659674 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07f915-3617-470e-8ccc-976651d3cdd9 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:42.660231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07f915-3617-470e-8ccc-976651d3cdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:42.660231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07f915-3617-470e-8ccc-976651d3cdd9 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:42.661748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:42.667280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7bba-94b5-4358-a802-377e407ba941 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:42.667724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7bba-94b5-4358-a802-377e407ba941 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:42.667845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7bba-94b5-4358-a802-377e407ba941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:42.732768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a02d7bba-94b5-4358-a802-377e407ba941 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:42.733933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a02d7bba-94b5-4358-a802-377e407ba941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:42.771982 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:42.829370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:42.866379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07f915-3617-470e-8ccc-976651d3cdd9 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:42.867911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6f07f915-3617-470e-8ccc-976651d3cdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:42.970586 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07f915-3617-470e-8ccc-976651d3cdd9 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:43.008956 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:43.044655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dca8a-993b-4e3a-a05c-6535854ecd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:43.045338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dca8a-993b-4e3a-a05c-6535854ecd80 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:43.045628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dca8a-993b-4e3a-a05c-6535854ecd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:43.045906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dca8a-993b-4e3a-a05c-6535854ecd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:43.047687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-da6dca8a-993b-4e3a-a05c-6535854ecd80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:43.155245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dca8a-993b-4e3a-a05c-6535854ecd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:43.156673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dca8a-993b-4e3a-a05c-6535854ecd80 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:43.175691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 719/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:45.211347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b835c3-73f2-45e4-817a-1c10e853ce52 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:45.211908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b835c3-73f2-45e4-817a-1c10e853ce52 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:45.211908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b835c3-73f2-45e4-817a-1c10e853ce52 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:45.213508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:45.218799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4b306-0c5f-4d48-8f67-54610ca671b1 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:45.219454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4b306-0c5f-4d48-8f67-54610ca671b1 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:45.219756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4b306-0c5f-4d48-8f67-54610ca671b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:45.283346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-88a4b306-0c5f-4d48-8f67-54610ca671b1 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:45.284551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-88a4b306-0c5f-4d48-8f67-54610ca671b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:45.303116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:45.382105 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:45.417708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b835c3-73f2-45e4-817a-1c10e853ce52 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:45.419247 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-33b835c3-73f2-45e4-817a-1c10e853ce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:45.523213 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b835c3-73f2-45e4-817a-1c10e853ce52 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:45.588630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:45.595883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747037e-d4cc-4734-94b9-3f9b4fe16399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:45.603790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747037e-d4cc-4734-94b9-3f9b4fe16399 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:45.603790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747037e-d4cc-4734-94b9-3f9b4fe16399 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:45.603790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747037e-d4cc-4734-94b9-3f9b4fe16399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:45.603790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-2747037e-d4cc-4734-94b9-3f9b4fe16399 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:45.706341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747037e-d4cc-4734-94b9-3f9b4fe16399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:45.707822 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747037e-d4cc-4734-94b9-3f9b4fe16399 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:45.726473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 747/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:47.795820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502eaa0-aaf4-40a6-bff0-e473e3141850 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:47.796433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502eaa0-aaf4-40a6-bff0-e473e3141850 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:47.796433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502eaa0-aaf4-40a6-bff0-e473e3141850 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:47.797801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:22:47.803412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aea1e-72de-432a-a470-fb0abb32ee75 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:47.803843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aea1e-72de-432a-a470-fb0abb32ee75 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:47.803966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aea1e-72de-432a-a470-fb0abb32ee75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:47.868947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-5f4aea1e-72de-432a-a470-fb0abb32ee75 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:22:47.870167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-5f4aea1e-72de-432a-a470-fb0abb32ee75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:47.918198 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:47.966145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:22:48.002750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502eaa0-aaf4-40a6-bff0-e473e3141850 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:22:48.013501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a502eaa0-aaf4-40a6-bff0-e473e3141850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:48.109321 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502eaa0-aaf4-40a6-bff0-e473e3141850 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:22:48.155494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:48.182435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84108ab7-3a92-4d8f-a749-04832806a079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:22:48.183111 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84108ab7-3a92-4d8f-a749-04832806a079 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:22:48.183396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84108ab7-3a92-4d8f-a749-04832806a079 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:22:48.183673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84108ab7-3a92-4d8f-a749-04832806a079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:22:48.185340 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-84108ab7-3a92-4d8f-a749-04832806a079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:22:48.291524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84108ab7-3a92-4d8f-a749-04832806a079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:22:48.292884 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84108ab7-3a92-4d8f-a749-04832806a079 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:22:48.311318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 722/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:22:57.964329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=22 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:22:58.308996 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=66 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:08.015867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb950e-889a-468e-be4a-ae63060a9bc3 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:08.016393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb950e-889a-468e-be4a-ae63060a9bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:08.016393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb950e-889a-468e-be4a-ae63060a9bc3 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:08.017788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 749/1471] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:23:08.023014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed994c-05cd-48db-a4af-6f44624226e1 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:08.023472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed994c-05cd-48db-a4af-6f44624226e1 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:08.026367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed994c-05cd-48db-a4af-6f44624226e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:08.086715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-6eed994c-05cd-48db-a4af-6f44624226e1 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:23:08.087914 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6eed994c-05cd-48db-a4af-6f44624226e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:08.182947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 723/1472] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:23:08.264609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d4e9c-770d-446a-a406-0a6a4c22ab29 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:08.264897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d4e9c-770d-446a-a406-0a6a4c22ab29 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:08.265211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d4e9c-770d-446a-a406-0a6a4c22ab29 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:08.266671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 750/1473] 10.222.0.26 () {54 vars in 962 bytes} [Tue Jul 12 16:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:23:08.271467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50e360-d76b-43eb-985e-ba1f291de330 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:08.271761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50e360-d76b-43eb-985e-ba1f291de330 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:08.272056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50e360-d76b-43eb-985e-ba1f291de330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:08.347150 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-2e50e360-d76b-43eb-985e-ba1f291de330 None None] MFA Rules not processed for user `f9f9ba17c2634999b350b887a5229e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:23:08.348346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2e50e360-d76b-43eb-985e-ba1f291de330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:08.368519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:08.424136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 724/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Tue Jul 12 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:23:08.431933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d4e9c-770d-446a-a406-0a6a4c22ab29 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:23:08.433490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-788d4e9c-770d-446a-a406-0a6a4c22ab29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:08.536593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d4e9c-770d-446a-a406-0a6a4c22ab29 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:23:08.606980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad52ec9-4ed1-4f37-a71c-6363cc8f6e90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f9ba17c2634999b350b887a5229e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:23:08.607620 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad52ec9-4ed1-4f37-a71c-6363cc8f6e90 service glance] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:08.607900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad52ec9-4ed1-4f37-a71c-6363cc8f6e90 service glance] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:08.608193 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad52ec9-4ed1-4f37-a71c-6363cc8f6e90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:08.609821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-7ad52ec9-4ed1-4f37-a71c-6363cc8f6e90 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:08.663015 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:08.717937 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad52ec9-4ed1-4f37-a71c-6363cc8f6e90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:23:08.719386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad52ec9-4ed1-4f37-a71c-6363cc8f6e90 service glance] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:23:08.737530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 751/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:23:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:23:10.828067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78bb87-0b79-4090-abe3-395123128bde None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:10.828665 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78bb87-0b79-4090-abe3-395123128bde None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:10.828665 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78bb87-0b79-4090-abe3-395123128bde None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:10.830164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 725/1476] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:23:10.835411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c59405-a1be-49fb-a3a5-2b0b9ef13992 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:10.835853 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c59405-a1be-49fb-a3a5-2b0b9ef13992 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:10.835959 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c59405-a1be-49fb-a3a5-2b0b9ef13992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:10.899894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-c4c59405-a1be-49fb-a3a5-2b0b9ef13992 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:23:10.901151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c4c59405-a1be-49fb-a3a5-2b0b9ef13992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:10.996094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 752/1477] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:23:11.019337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78bb87-0b79-4090-abe3-395123128bde None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:23:11.020843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7a78bb87-0b79-4090-abe3-395123128bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:11.143745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78bb87-0b79-4090-abe3-395123128bde None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:23:11.191532 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:11.236241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335c642-b8fb-454e-ad19-4559fd4d3b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:23:11.236893 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335c642-b8fb-454e-ad19-4559fd4d3b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:11.237197 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335c642-b8fb-454e-ad19-4559fd4d3b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:11.237474 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335c642-b8fb-454e-ad19-4559fd4d3b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:11.238201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335c642-b8fb-454e-ad19-4559fd4d3b17 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:23:11.239978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: WARNING py.warnings [None req-6335c642-b8fb-454e-ad19-4559fd4d3b17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:23:11.239978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: warnings.warn(msg) Jul 12 16:23:11.239978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: Jul 12 16:23:11.241134 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335c642-b8fb-454e-ad19-4559fd4d3b17 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:23:11.259321 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 726/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 16:23:11 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:23:13.282671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3be45-cdcd-4d4f-9262-17779bfea4c8 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:13.283238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3be45-cdcd-4d4f-9262-17779bfea4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:13.283238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3be45-cdcd-4d4f-9262-17779bfea4c8 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:13.284617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 753/1479] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:23:13.289894 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757fcd7-7ce9-42e0-9864-d7682a987e5f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:13.290349 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757fcd7-7ce9-42e0-9864-d7682a987e5f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:13.290477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757fcd7-7ce9-42e0-9864-d7682a987e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:13.355758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-8757fcd7-7ce9-42e0-9864-d7682a987e5f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:23:13.356953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8757fcd7-7ce9-42e0-9864-d7682a987e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:13.454575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 727/1480] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:23:13.496631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3be45-cdcd-4d4f-9262-17779bfea4c8 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:23:13.498211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-cdb3be45-cdcd-4d4f-9262-17779bfea4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:13.508286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:13.642505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3be45-cdcd-4d4f-9262-17779bfea4c8 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:23:13.719940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:13.752611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a8915-8bde-49f4-8858-61c0563f381e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:23:13.753290 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a8915-8bde-49f4-8858-61c0563f381e service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:13.753575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a8915-8bde-49f4-8858-61c0563f381e service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:13.753855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a8915-8bde-49f4-8858-61c0563f381e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:13.755501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-153a8915-8bde-49f4-8858-61c0563f381e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:13.842953 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a8915-8bde-49f4-8858-61c0563f381e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:23:13.844546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a8915-8bde-49f4-8858-61c0563f381e service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:23:13.862557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 754/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:23:16.066718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633a9f5-9b51-45dc-a73d-b4e426452fa9 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:16.067272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633a9f5-9b51-45dc-a73d-b4e426452fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:16.067272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633a9f5-9b51-45dc-a73d-b4e426452fa9 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:16.068848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 728/1482] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:23:16.074088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672caef1-5bfc-43f1-a18e-8429f864a785 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:16.074524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672caef1-5bfc-43f1-a18e-8429f864a785 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:16.074642 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672caef1-5bfc-43f1-a18e-8429f864a785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:16.137518 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-672caef1-5bfc-43f1-a18e-8429f864a785 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:23:16.138706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-672caef1-5bfc-43f1-a18e-8429f864a785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:16.184758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:16.234138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 755/1483] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:23:16.270940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633a9f5-9b51-45dc-a73d-b4e426452fa9 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:23:16.272481 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e633a9f5-9b51-45dc-a73d-b4e426452fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:16.295723 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:16.375951 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633a9f5-9b51-45dc-a73d-b4e426452fa9 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:23:16.450915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898d877-276c-48f4-be94-be9443860461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:23:16.451568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898d877-276c-48f4-be94-be9443860461 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:16.451849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898d877-276c-48f4-be94-be9443860461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:16.452126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898d877-276c-48f4-be94-be9443860461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:16.453814 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6898d877-276c-48f4-be94-be9443860461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:16.527959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:16.562191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898d877-276c-48f4-be94-be9443860461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:23:16.563663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898d877-276c-48f4-be94-be9443860461 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:23:16.581844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 729/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:23:18.653265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cb276-7e90-4c28-8f9c-ae9b4bef0b73 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:18.653853 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cb276-7e90-4c28-8f9c-ae9b4bef0b73 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:18.653853 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cb276-7e90-4c28-8f9c-ae9b4bef0b73 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:18.655211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 756/1485] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:23:18.661038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd6db3-be11-4eca-bac8-769bad71cb0e None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:18.661542 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd6db3-be11-4eca-bac8-769bad71cb0e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:18.661652 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd6db3-be11-4eca-bac8-769bad71cb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:18.726435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-9ebd6db3-be11-4eca-bac8-769bad71cb0e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:23:18.727660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9ebd6db3-be11-4eca-bac8-769bad71cb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:18.824160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 730/1486] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:23:18.863477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cb276-7e90-4c28-8f9c-ae9b4bef0b73 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:23:18.865003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-747cb276-7e90-4c28-8f9c-ae9b4bef0b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:18.967947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cb276-7e90-4c28-8f9c-ae9b4bef0b73 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:23:19.041041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:19.043362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380253a-21c8-421f-b1ee-e8e9abfe1d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:23:19.044016 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380253a-21c8-421f-b1ee-e8e9abfe1d3d service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:19.044300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380253a-21c8-421f-b1ee-e8e9abfe1d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:19.044572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380253a-21c8-421f-b1ee-e8e9abfe1d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:19.046496 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c380253a-21c8-421f-b1ee-e8e9abfe1d3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:19.156133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380253a-21c8-421f-b1ee-e8e9abfe1d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:23:19.158268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380253a-21c8-421f-b1ee-e8e9abfe1d3d service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:23:19.176384 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 757/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:23:21.281357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbd37b-8da4-46ae-b2af-9c96441e5d5e None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:21.281933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbd37b-8da4-46ae-b2af-9c96441e5d5e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:21.281933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbd37b-8da4-46ae-b2af-9c96441e5d5e None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:21.283316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 731/1488] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:23:21.288500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f402e03-962c-4ab7-914b-132d02663321 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:21.288921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f402e03-962c-4ab7-914b-132d02663321 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:21.289051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f402e03-962c-4ab7-914b-132d02663321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:21.352907 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-6f402e03-962c-4ab7-914b-132d02663321 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:23:21.354145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-6f402e03-962c-4ab7-914b-132d02663321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:21.406463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:21.450510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 758/1489] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:23:21.490998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbd37b-8da4-46ae-b2af-9c96441e5d5e None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:23:21.492566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-14dbd37b-8da4-46ae-b2af-9c96441e5d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:21.528313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:21.596087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbd37b-8da4-46ae-b2af-9c96441e5d5e None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:23:21.669401 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4e488-56d4-4ed5-96a1-76f4371a0b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:23:21.670047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4e488-56d4-4ed5-96a1-76f4371a0b09 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:21.670330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4e488-56d4-4ed5-96a1-76f4371a0b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:21.670604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4e488-56d4-4ed5-96a1-76f4371a0b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:21.672265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d9c4e488-56d4-4ed5-96a1-76f4371a0b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:21.754092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:21.784842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4e488-56d4-4ed5-96a1-76f4371a0b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:23:21.786397 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4e488-56d4-4ed5-96a1-76f4371a0b09 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:23:21.804395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 732/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:23:24.164699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933df24-59e0-4d8c-8541-7a368d1b006c None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:24.165300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933df24-59e0-4d8c-8541-7a368d1b006c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:24.165300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933df24-59e0-4d8c-8541-7a368d1b006c None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:24.166681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 759/1491] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 16:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:23:24.172002 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405248e-7645-4397-8e84-ca4c3ce5ea62 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:24.172406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405248e-7645-4397-8e84-ca4c3ce5ea62 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:24.172572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405248e-7645-4397-8e84-ca4c3ce5ea62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:24.236822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-3405248e-7645-4397-8e84-ca4c3ce5ea62 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:23:24.238040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3405248e-7645-4397-8e84-ca4c3ce5ea62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:24.333535 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 733/1492] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 16:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:23:24.372259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933df24-59e0-4d8c-8541-7a368d1b006c None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:23:24.373816 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-5933df24-59e0-4d8c-8541-7a368d1b006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:24.481347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933df24-59e0-4d8c-8541-7a368d1b006c None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:23:24.553309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d88aa-1619-49f7-932a-3d13c6629bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:23:24.553954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d88aa-1619-49f7-932a-3d13c6629bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:23:24.554242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d88aa-1619-49f7-932a-3d13c6629bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:23:24.554519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d88aa-1619-49f7-932a-3d13c6629bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:23:24.556162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-562d88aa-1619-49f7-932a-3d13c6629bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:23:24.565103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:24.663404 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d88aa-1619-49f7-932a-3d13c6629bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:23:24.664856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d88aa-1619-49f7-932a-3d13c6629bb4 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:23:24.683301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 760/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:23:34.331668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=82 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:23:34.681060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=50 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:00.850311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680d53c-e4fa-472f-ab71-89c3aba8c413 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:00.850886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680d53c-e4fa-472f-ab71-89c3aba8c413 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:00.850886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680d53c-e4fa-472f-ab71-89c3aba8c413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:00.930561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-5680d53c-e4fa-472f-ab71-89c3aba8c413 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:25:00.931777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5680d53c-e4fa-472f-ab71-89c3aba8c413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:01.026166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 734/1494] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:25:01.034715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2b8c5-419c-4691-bf34-82be6ac9bd7e None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:01.035198 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2b8c5-419c-4691-bf34-82be6ac9bd7e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:01.035631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2b8c5-419c-4691-bf34-82be6ac9bd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:01.109539 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-d0e2b8c5-419c-4691-bf34-82be6ac9bd7e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:25:01.110671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d0e2b8c5-419c-4691-bf34-82be6ac9bd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:01.205516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 761/1495] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:25:01.210173 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680d53c-e4fa-472f-ab71-89c3aba8c413 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:25:01.211379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5680d53c-e4fa-472f-ab71-89c3aba8c413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:01.223704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680d53c-e4fa-472f-ab71-89c3aba8c413 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:25:01.285658 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:01.318846 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98fcb9-1132-4302-8f7d-2f8b3dca9ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:25:01.319509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98fcb9-1132-4302-8f7d-2f8b3dca9ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:01.319793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98fcb9-1132-4302-8f7d-2f8b3dca9ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:01.320069 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98fcb9-1132-4302-8f7d-2f8b3dca9ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:01.320789 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98fcb9-1132-4302-8f7d-2f8b3dca9ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:25:01.321094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98fcb9-1132-4302-8f7d-2f8b3dca9ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:25:01.322127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: WARNING py.warnings [None req-3f98fcb9-1132-4302-8f7d-2f8b3dca9ee8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:25:01.322127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: warnings.warn(msg) Jul 12 16:25:01.322127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: Jul 12 16:25:01.323024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98fcb9-1132-4302-8f7d-2f8b3dca9ee8 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:25:01.333916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 735/1496] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:25:01.342235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2b8c5-419c-4691-bf34-82be6ac9bd7e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:25:01.351865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2b8c5-419c-4691-bf34-82be6ac9bd7e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:25:01.411573 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:01.444615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceac7eb-15f5-4a55-a381-a6baded8ee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:25:01.445303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceac7eb-15f5-4a55-a381-a6baded8ee13 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:01.445586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceac7eb-15f5-4a55-a381-a6baded8ee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:01.445860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceac7eb-15f5-4a55-a381-a6baded8ee13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:01.446550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceac7eb-15f5-4a55-a381-a6baded8ee13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:25:01.448314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: WARNING py.warnings [None req-aceac7eb-15f5-4a55-a381-a6baded8ee13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:25:01.448314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: warnings.warn(msg) Jul 12 16:25:01.448314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: Jul 12 16:25:01.449525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceac7eb-15f5-4a55-a381-a6baded8ee13 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:25:01.580374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 762/1497] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:25:01 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:25:01.584703 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98fcb9-1132-4302-8f7d-2f8b3dca9ee8 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:25:01.586289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3f98fcb9-1132-4302-8f7d-2f8b3dca9ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:01.619112 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98fcb9-1132-4302-8f7d-2f8b3dca9ee8 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:25:01.712569 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9192f0-c6cf-466a-8755-98342436ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:25:01.713203 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9192f0-c6cf-466a-8755-98342436ce08 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:01.713487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9192f0-c6cf-466a-8755-98342436ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:01.713759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9192f0-c6cf-466a-8755-98342436ce08 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:01.714445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9192f0-c6cf-466a-8755-98342436ce08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:25:01.715442 dv-cinder-797608-56-smb devstack@keystone.service[80379]: WARNING py.warnings [None req-1e9192f0-c6cf-466a-8755-98342436ce08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:25:01.715442 dv-cinder-797608-56-smb devstack@keystone.service[80379]: warnings.warn(msg) Jul 12 16:25:01.715442 dv-cinder-797608-56-smb devstack@keystone.service[80379]: Jul 12 16:25:01.716632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9192f0-c6cf-466a-8755-98342436ce08 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:25:01.826389 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 736/1498] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:25:01 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:25:01.831176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceac7eb-15f5-4a55-a381-a6baded8ee13 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:25:01.832725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-aceac7eb-15f5-4a55-a381-a6baded8ee13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:01.898510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceac7eb-15f5-4a55-a381-a6baded8ee13 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:25:01.980425 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:01.990490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede058b1-6f5b-4ccd-b23a-b02e0b935719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:25:01.991163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede058b1-6f5b-4ccd-b23a-b02e0b935719 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:01.991445 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede058b1-6f5b-4ccd-b23a-b02e0b935719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:01.991717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede058b1-6f5b-4ccd-b23a-b02e0b935719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:01.992445 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede058b1-6f5b-4ccd-b23a-b02e0b935719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:25:01.993498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: WARNING py.warnings [None req-ede058b1-6f5b-4ccd-b23a-b02e0b935719 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:25:01.993498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: warnings.warn(msg) Jul 12 16:25:01.993498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: Jul 12 16:25:01.994374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede058b1-6f5b-4ccd-b23a-b02e0b935719 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:25:02.007069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 763/1499] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:25:02.011184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9192f0-c6cf-466a-8755-98342436ce08 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:25:02.012697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1e9192f0-c6cf-466a-8755-98342436ce08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:02.024636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9192f0-c6cf-466a-8755-98342436ce08 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:25:02.049141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:02.119472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb69749-3574-462d-ac9b-cf54d69f5246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:25:02.120146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb69749-3574-462d-ac9b-cf54d69f5246 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:02.120429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb69749-3574-462d-ac9b-cf54d69f5246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:02.120707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb69749-3574-462d-ac9b-cf54d69f5246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:02.121477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb69749-3574-462d-ac9b-cf54d69f5246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:25:02.122482 dv-cinder-797608-56-smb devstack@keystone.service[80379]: WARNING py.warnings [None req-ddb69749-3574-462d-ac9b-cf54d69f5246 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:25:02.122482 dv-cinder-797608-56-smb devstack@keystone.service[80379]: warnings.warn(msg) Jul 12 16:25:02.122482 dv-cinder-797608-56-smb devstack@keystone.service[80379]: Jul 12 16:25:02.123388 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb69749-3574-462d-ac9b-cf54d69f5246 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:25:02.136100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 737/1500] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:25:02.140924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede058b1-6f5b-4ccd-b23a-b02e0b935719 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:25:02.142479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ede058b1-6f5b-4ccd-b23a-b02e0b935719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:02.174967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede058b1-6f5b-4ccd-b23a-b02e0b935719 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:25:02.267885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592f282-9fbe-4c57-a8b5-365e2f662e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:25:02.268697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592f282-9fbe-4c57-a8b5-365e2f662e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:02.268988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592f282-9fbe-4c57-a8b5-365e2f662e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:02.269297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592f282-9fbe-4c57-a8b5-365e2f662e03 admin admin] PATH_INFO: `/v3/projects/3ab074aebb1c4f75ad9729c8566e6a33/users/5b77b02eda254e35b2b7955918092cde/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:02.292081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592f282-9fbe-4c57-a8b5-365e2f662e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ab074aebb1c4f75ad9729c8566e6a33, user_id=5b77b02eda254e35b2b7955918092cde, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:25:02.293138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: WARNING py.warnings [None req-f592f282-9fbe-4c57-a8b5-365e2f662e03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:25:02.293138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: warnings.warn(msg) Jul 12 16:25:02.293138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: Jul 12 16:25:02.295090 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592f282-9fbe-4c57-a8b5-365e2f662e03 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:25:02.387541 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 764/1501] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:25:02 2022] PUT /identity/v3/projects/3ab074aebb1c4f75ad9729c8566e6a33/users/5b77b02eda254e35b2b7955918092cde/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:25:02.399899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676fc40-fe83-4f4b-82db-395a4c634dfa None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:02.400198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676fc40-fe83-4f4b-82db-395a4c634dfa None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:02.400482 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676fc40-fe83-4f4b-82db-395a4c634dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:02.457761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-b676fc40-fe83-4f4b-82db-395a4c634dfa None None] MFA Rules not processed for user `5b77b02eda254e35b2b7955918092cde`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:25:02.458991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b676fc40-fe83-4f4b-82db-395a4c634dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:02.534638 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 738/1502] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:25:02.548144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116132-2562-478a-b397-7d674df8b164 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:02.548435 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116132-2562-478a-b397-7d674df8b164 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:02.548713 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116132-2562-478a-b397-7d674df8b164 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:02.550385 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 765/1503] 10.222.0.26 () {54 vars in 963 bytes} [Tue Jul 12 16:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:25:02.555117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d47df-84a7-4249-b319-3fbfae914d6b None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:02.555463 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d47df-84a7-4249-b319-3fbfae914d6b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:02.555774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d47df-84a7-4249-b319-3fbfae914d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:02.591157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:02.630242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-2e6d47df-84a7-4249-b319-3fbfae914d6b None None] MFA Rules not processed for user `835679599bc74ed5b1b481e9be4700c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:25:02.631425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2e6d47df-84a7-4249-b319-3fbfae914d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:02.705044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 739/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Tue Jul 12 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:25:02.712790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7116132-2562-478a-b397-7d674df8b164 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:25:02.714345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e7116132-2562-478a-b397-7d674df8b164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:02.765154 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:02.818155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7116132-2562-478a-b397-7d674df8b164 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:25:02.891308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd64ae-edd5-45d0-ba65-89240e2a4e34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:25:02.891955 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd64ae-edd5-45d0-ba65-89240e2a4e34 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:02.892266 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd64ae-edd5-45d0-ba65-89240e2a4e34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:02.892539 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd64ae-edd5-45d0-ba65-89240e2a4e34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:02.894224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-39fd64ae-edd5-45d0-ba65-89240e2a4e34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:02.992609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd64ae-edd5-45d0-ba65-89240e2a4e34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:25:02.994080 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd64ae-edd5-45d0-ba65-89240e2a4e34 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:25:02.997593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:03.011918 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 766/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:25:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:25:03.055782 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcf188-df31-472b-9ee9-53b5813ea673 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:03.056183 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcf188-df31-472b-9ee9-53b5813ea673 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:03.056341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcf188-df31-472b-9ee9-53b5813ea673 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:03.057670 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 740/1506] 10.222.0.26 () {52 vars in 829 bytes} [Tue Jul 12 16:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:25:03.061255 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd64ae-edd5-45d0-ba65-89240e2a4e34 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:25:03.062512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-39fd64ae-edd5-45d0-ba65-89240e2a4e34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:03.161059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd64ae-edd5-45d0-ba65-89240e2a4e34 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:25:03.254048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:25:03.254922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:03.255206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:03.255482 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] PATH_INFO: `/v3/users/5b77b02eda254e35b2b7955918092cde` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:03.267577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b77b02eda254e35b2b7955918092cde)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:25:03.268613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: WARNING py.warnings [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:25:03.268613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: warnings.warn(msg) Jul 12 16:25:03.268613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: Jul 12 16:25:03.269914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:25:03.280606 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:03.490279 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b77b02eda254e35b2b7955918092cde'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:25:03.563155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b77b02eda254e35b2b7955918092cde'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:25:03.563585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b77b02eda254e35b2b7955918092cde'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:25:03.581578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b77b02eda254e35b2b7955918092cde'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:25:03.595750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b77b02eda254e35b2b7955918092cde'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:25:03.601427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 767/1507] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:25:03 2022] DELETE /identity/v3/users/5b77b02eda254e35b2b7955918092cde => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:25:03.605804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684b9ec-49e3-4bed-9a24-93e2945027cd None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:03.606091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684b9ec-49e3-4bed-9a24-93e2945027cd None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:03.606365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684b9ec-49e3-4bed-9a24-93e2945027cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:03.660556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-6684b9ec-49e3-4bed-9a24-93e2945027cd None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:25:03.661770 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6684b9ec-49e3-4bed-9a24-93e2945027cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:03.737984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:03.750145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 741/1508] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:25:03.759630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:25:03.760837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:03.859213 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a3ec1-892e-4a88-99e6-462bb1e63102 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:25:03.912426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:03.931500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00126122-2356-4f6b-9279-2f9a9ce19a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:25:03.932185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00126122-2356-4f6b-9279-2f9a9ce19a50 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:03.932470 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00126122-2356-4f6b-9279-2f9a9ce19a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:03.932746 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00126122-2356-4f6b-9279-2f9a9ce19a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:03.934429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-00126122-2356-4f6b-9279-2f9a9ce19a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:04.041525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00126122-2356-4f6b-9279-2f9a9ce19a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:25:04.042895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00126122-2356-4f6b-9279-2f9a9ce19a50 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:25:04.061490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 768/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:25:04.611632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684b9ec-49e3-4bed-9a24-93e2945027cd None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:25:04.612874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6684b9ec-49e3-4bed-9a24-93e2945027cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:25:04.625424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684b9ec-49e3-4bed-9a24-93e2945027cd None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:25:04.718159 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40b005-65a3-4e05-bb32-8780345bdfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:25:04.719038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40b005-65a3-4e05-bb32-8780345bdfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:25:04.719315 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40b005-65a3-4e05-bb32-8780345bdfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:25:04.719582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40b005-65a3-4e05-bb32-8780345bdfbf admin admin] PATH_INFO: `/v3/projects/3ab074aebb1c4f75ad9729c8566e6a33` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:25:04.729161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40b005-65a3-4e05-bb32-8780345bdfbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ab074aebb1c4f75ad9729c8566e6a33)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:25:04.730178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: WARNING py.warnings [None req-ca40b005-65a3-4e05-bb32-8780345bdfbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:25:04.730178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: warnings.warn(msg) Jul 12 16:25:04.730178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: Jul 12 16:25:04.731373 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40b005-65a3-4e05-bb32-8780345bdfbf admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:25:04.830099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ca40b005-65a3-4e05-bb32-8780345bdfbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ab074aebb1c4f75ad9729c8566e6a33', 'request_id': 'req-ca40b005-65a3-4e05-bb32-8780345bdfbf'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:25:04.872250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ca40b005-65a3-4e05-bb32-8780345bdfbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ab074aebb1c4f75ad9729c8566e6a33', 'request_id': 'req-ca40b005-65a3-4e05-bb32-8780345bdfbf'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:25:04.887646 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ca40b005-65a3-4e05-bb32-8780345bdfbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ab074aebb1c4f75ad9729c8566e6a33', 'request_id': 'req-ca40b005-65a3-4e05-bb32-8780345bdfbf'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:25:04.911612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ca40b005-65a3-4e05-bb32-8780345bdfbf admin admin] The token cache is being invalidate because project 3ab074aebb1c4f75ad9729c8566e6a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:25:04.911905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ca40b005-65a3-4e05-bb32-8780345bdfbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:25:04.912396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ca40b005-65a3-4e05-bb32-8780345bdfbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:25:04.914403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 742/1510] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:25:04 2022] DELETE /identity/v3/projects/3ab074aebb1c4f75ad9729c8566e6a33 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:25:14.059092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=62 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:25:14.909581 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:51.741623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814950-4b46-4ef8-ad22-295c3e5610a5 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:26:51.742187 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814950-4b46-4ef8-ad22-295c3e5610a5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:26:51.742187 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814950-4b46-4ef8-ad22-295c3e5610a5 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:26:51.743612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 769/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 16:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:26:51.748737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e794e-80ae-4135-92c8-1676751be7e1 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:26:51.749215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e794e-80ae-4135-92c8-1676751be7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:26:51.749330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e794e-80ae-4135-92c8-1676751be7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:26:51.827850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-259e794e-80ae-4135-92c8-1676751be7e1 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:26:51.829078 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-259e794e-80ae-4135-92c8-1676751be7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:26:51.935159 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 743/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 16:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:26:52.087426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e814950-4b46-4ef8-ad22-295c3e5610a5 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:26:52.089603 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0e814950-4b46-4ef8-ad22-295c3e5610a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:26:52.208822 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e814950-4b46-4ef8-ad22-295c3e5610a5 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:26:52.214390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758e7a2-5316-41d6-a766-7e6dcd35907a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:26:52.215040 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758e7a2-5316-41d6-a766-7e6dcd35907a service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:26:52.215329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758e7a2-5316-41d6-a766-7e6dcd35907a service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:26:52.215616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758e7a2-5316-41d6-a766-7e6dcd35907a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:26:52.224386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758e7a2-5316-41d6-a766-7e6dcd35907a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:26:52.229245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758e7a2-5316-41d6-a766-7e6dcd35907a service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:26:52.236104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 770/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:26:53.063684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30ab36-2192-4f29-8fc4-6aa8566efe43 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:26:53.064296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30ab36-2192-4f29-8fc4-6aa8566efe43 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:26:53.064406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30ab36-2192-4f29-8fc4-6aa8566efe43 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:26:53.065766 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 16:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:26:53.070533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0e40b-2cab-47b3-b51d-17488ffdb894 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:26:53.070945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0e40b-2cab-47b3-b51d-17488ffdb894 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:26:53.071099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0e40b-2cab-47b3-b51d-17488ffdb894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:26:53.088768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-96d0e40b-2cab-47b3-b51d-17488ffdb894 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:26:53.090018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-96d0e40b-2cab-47b3-b51d-17488ffdb894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:26:53.098399 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 16:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:26:53.250437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30ab36-2192-4f29-8fc4-6aa8566efe43 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:26:53.265632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30ab36-2192-4f29-8fc4-6aa8566efe43 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:26:53.272537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b39f24-d9cc-4064-8d58-2a3e03d4b8db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:26:53.273203 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b39f24-d9cc-4064-8d58-2a3e03d4b8db service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:26:53.273495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b39f24-d9cc-4064-8d58-2a3e03d4b8db service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:26:53.273778 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b39f24-d9cc-4064-8d58-2a3e03d4b8db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:26:53.281904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b39f24-d9cc-4064-8d58-2a3e03d4b8db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:26:53.284100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b39f24-d9cc-4064-8d58-2a3e03d4b8db service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:26:53.293546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 745/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:26:53.832209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfe25b-85ee-4dd2-9ed7-67196d5156ac None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:26:53.832501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfe25b-85ee-4dd2-9ed7-67196d5156ac None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:26:53.832782 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfe25b-85ee-4dd2-9ed7-67196d5156ac None None] PATH_INFO: `/v3` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:26:53.834127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 772/1517] 10.222.0.61 () {54 vars in 925 bytes} [Tue Jul 12 16:26:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:26:53.847388 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545aabb-f2b6-4911-95c3-9f2c4258063e None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:26:53.847704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545aabb-f2b6-4911-95c3-9f2c4258063e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:26:53.847982 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545aabb-f2b6-4911-95c3-9f2c4258063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:26:53.904049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-5545aabb-f2b6-4911-95c3-9f2c4258063e None None] MFA Rules not processed for user `b62795a6111a4c05a24e69efc7a0faba`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:26:53.905266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5545aabb-f2b6-4911-95c3-9f2c4258063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:26:53.921173 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:26:53.974205 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 746/1518] 10.222.0.61 () {58 vars in 1015 bytes} [Tue Jul 12 16:26:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:26:58.045215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c361c9-2f0c-45f5-8a21-b6d361a2985e None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:26:58.045690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c361c9-2f0c-45f5-8a21-b6d361a2985e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:26:58.045796 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c361c9-2f0c-45f5-8a21-b6d361a2985e None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:26:58.047087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 773/1519] 10.222.0.26 () {54 vars in 960 bytes} [Tue Jul 12 16:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:26:58.052739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21b332-1697-40a9-8cdb-5098da653228 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:26:58.053192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21b332-1697-40a9-8cdb-5098da653228 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:26:58.053329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21b332-1697-40a9-8cdb-5098da653228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:26:58.072307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-6c21b332-1697-40a9-8cdb-5098da653228 None None] MFA Rules not processed for user `b62795a6111a4c05a24e69efc7a0faba`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:26:58.073523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6c21b332-1697-40a9-8cdb-5098da653228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:26:58.082019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 747/1520] 10.222.0.26 () {58 vars in 1057 bytes} [Tue Jul 12 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:26:58.089106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c361c9-2f0c-45f5-8a21-b6d361a2985e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:26:58.102998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c361c9-2f0c-45f5-8a21-b6d361a2985e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:26:58.108061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fde6d0-54cf-467f-975a-9ec4ef597997 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b62795a6111a4c05a24e69efc7a0faba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:26:58.108670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fde6d0-54cf-467f-975a-9ec4ef597997 service placement] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:26:58.108957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fde6d0-54cf-467f-975a-9ec4ef597997 service placement] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:26:58.109266 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fde6d0-54cf-467f-975a-9ec4ef597997 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:26:58.118744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fde6d0-54cf-467f-975a-9ec4ef597997 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:26:58.120346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fde6d0-54cf-467f-975a-9ec4ef597997 service placement] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:26:58.130027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 774/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:26:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:27:04.533418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e438b5-4f22-4815-9ba0-d435f4b9f932 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:04.533951 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e438b5-4f22-4815-9ba0-d435f4b9f932 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:04.533951 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e438b5-4f22-4815-9ba0-d435f4b9f932 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:04.535376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 748/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 16:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:27:04.540098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85add0-8ce6-4301-87f6-0e8c42709c38 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:04.540492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85add0-8ce6-4301-87f6-0e8c42709c38 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:04.540662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85add0-8ce6-4301-87f6-0e8c42709c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:04.560671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-3a85add0-8ce6-4301-87f6-0e8c42709c38 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:27:04.561910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3a85add0-8ce6-4301-87f6-0e8c42709c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:27:04.570292 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 775/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 16:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:27:04.723531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e438b5-4f22-4815-9ba0-d435f4b9f932 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:27:04.738331 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e438b5-4f22-4815-9ba0-d435f4b9f932 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:27:04.743817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3645ba-c641-4f00-8ff1-beafa85edf48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:27:04.744454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3645ba-c641-4f00-8ff1-beafa85edf48 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:04.744742 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3645ba-c641-4f00-8ff1-beafa85edf48 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:04.745022 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3645ba-c641-4f00-8ff1-beafa85edf48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:04.753163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3645ba-c641-4f00-8ff1-beafa85edf48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:27:04.754883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3645ba-c641-4f00-8ff1-beafa85edf48 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:27:04.764232 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 749/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:27:05.587201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492413d6-a697-4ad2-ad36-562f1fa8c825 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:05.587750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492413d6-a697-4ad2-ad36-562f1fa8c825 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:05.587750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492413d6-a697-4ad2-ad36-562f1fa8c825 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:05.589153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 776/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 16:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:27:05.594230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48bfd-53b7-4e44-9a44-bf67a278067d None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:05.594671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48bfd-53b7-4e44-9a44-bf67a278067d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:05.594822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48bfd-53b7-4e44-9a44-bf67a278067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:05.732205 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e9c48bfd-53b7-4e44-9a44-bf67a278067d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:27:05.733356 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e9c48bfd-53b7-4e44-9a44-bf67a278067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:27:05.741232 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 750/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 16:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:27:05.893058 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492413d6-a697-4ad2-ad36-562f1fa8c825 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:27:05.906914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492413d6-a697-4ad2-ad36-562f1fa8c825 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:27:05.912398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6752aa3-10ff-4ea4-90f7-24f57e2d1b49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:27:05.913028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6752aa3-10ff-4ea4-90f7-24f57e2d1b49 service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:05.913347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6752aa3-10ff-4ea4-90f7-24f57e2d1b49 service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:05.913623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6752aa3-10ff-4ea4-90f7-24f57e2d1b49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:05.921558 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6752aa3-10ff-4ea4-90f7-24f57e2d1b49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:27:05.923403 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6752aa3-10ff-4ea4-90f7-24f57e2d1b49 service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:27:05.933170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 777/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:27:09.828298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f86f6-e924-495c-aca2-0267f4dc4931 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:09.828861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f86f6-e924-495c-aca2-0267f4dc4931 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:09.828861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f86f6-e924-495c-aca2-0267f4dc4931 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:09.830376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 751/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:27:09.836190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede1c31-c34d-4da9-b287-e6ace1447aa0 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:09.836649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede1c31-c34d-4da9-b287-e6ace1447aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:09.836750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede1c31-c34d-4da9-b287-e6ace1447aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:09.855219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-6ede1c31-c34d-4da9-b287-e6ace1447aa0 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:27:09.856417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-6ede1c31-c34d-4da9-b287-e6ace1447aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:27:09.864330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 778/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:27:09.936209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f86f6-e924-495c-aca2-0267f4dc4931 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:27:09.937920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-006f86f6-e924-495c-aca2-0267f4dc4931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:27:10.014375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f86f6-e924-495c-aca2-0267f4dc4931 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:27:10.017928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f18a8a-06f9-4c22-a88c-146601973a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:27:10.018571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f18a8a-06f9-4c22-a88c-146601973a4b service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:10.019556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f18a8a-06f9-4c22-a88c-146601973a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:10.019835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f18a8a-06f9-4c22-a88c-146601973a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:10.028590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f18a8a-06f9-4c22-a88c-146601973a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:27:10.030059 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f18a8a-06f9-4c22-a88c-146601973a4b service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:27:10.039558 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 752/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:27:12.053093 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842962c3-dd5b-4379-ac38-c60a815323cf None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:12.053712 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842962c3-dd5b-4379-ac38-c60a815323cf None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:12.053712 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842962c3-dd5b-4379-ac38-c60a815323cf None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:12.055116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 779/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:27:12.060148 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c06a-9403-4473-ad41-50b2a293f382 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:12.060525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c06a-9403-4473-ad41-50b2a293f382 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:12.060702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c06a-9403-4473-ad41-50b2a293f382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:12.078886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-b665c06a-9403-4473-ad41-50b2a293f382 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:27:12.080078 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b665c06a-9403-4473-ad41-50b2a293f382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:27:12.087781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 753/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:27:12.122802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842962c3-dd5b-4379-ac38-c60a815323cf None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:27:12.134017 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842962c3-dd5b-4379-ac38-c60a815323cf None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:27:12.137759 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af577c3-785f-48ba-b955-81a303f1375e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:27:12.138339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af577c3-785f-48ba-b955-81a303f1375e service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:12.138624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af577c3-785f-48ba-b955-81a303f1375e service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:12.138901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af577c3-785f-48ba-b955-81a303f1375e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:12.147670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af577c3-785f-48ba-b955-81a303f1375e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:27:12.149100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af577c3-785f-48ba-b955-81a303f1375e service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:27:12.158547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 780/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:27:15.652947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708223e-5412-4c8a-bbc6-b1d071104f6e None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:15.653600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708223e-5412-4c8a-bbc6-b1d071104f6e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:15.653600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708223e-5412-4c8a-bbc6-b1d071104f6e None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:15.654960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 754/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:27:15.660553 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe96c6-6fa8-428c-af8f-1245907aebe9 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:15.661008 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe96c6-6fa8-428c-af8f-1245907aebe9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:15.661140 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe96c6-6fa8-428c-af8f-1245907aebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:15.667520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=81 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:15.679604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-1fbe96c6-6fa8-428c-af8f-1245907aebe9 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:27:15.680808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1fbe96c6-6fa8-428c-af8f-1245907aebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:27:15.688779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 781/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:27:15.992306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708223e-5412-4c8a-bbc6-b1d071104f6e None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:27:15.994038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c708223e-5412-4c8a-bbc6-b1d071104f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:27:16.057945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:16.070648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708223e-5412-4c8a-bbc6-b1d071104f6e None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:27:16.074210 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec6161-27d0-4553-80c0-09b4aeb93923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:27:16.074852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec6161-27d0-4553-80c0-09b4aeb93923 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:16.075135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec6161-27d0-4553-80c0-09b4aeb93923 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:16.075410 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec6161-27d0-4553-80c0-09b4aeb93923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:16.084213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec6161-27d0-4553-80c0-09b4aeb93923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:27:16.085671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec6161-27d0-4553-80c0-09b4aeb93923 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:27:16.095483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 755/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:27:18.144694 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f428-eec7-4e7a-a410-168c42858489 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:18.145247 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f428-eec7-4e7a-a410-168c42858489 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:18.145247 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f428-eec7-4e7a-a410-168c42858489 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:18.146585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 782/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 16:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:27:18.151715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ee660-1708-455a-a629-c5ab16a001f8 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:18.152169 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ee660-1708-455a-a629-c5ab16a001f8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:18.152279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ee660-1708-455a-a629-c5ab16a001f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:18.170261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-261ee660-1708-455a-a629-c5ab16a001f8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:27:18.171470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-261ee660-1708-455a-a629-c5ab16a001f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:27:18.179512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 756/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:27:18.478710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8f428-eec7-4e7a-a410-168c42858489 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:27:18.480367 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-03b8f428-eec7-4e7a-a410-168c42858489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:27:18.494116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8f428-eec7-4e7a-a410-168c42858489 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:27:18.497533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169fc16-faff-445a-9e5d-386259a3f54d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:27:18.498165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169fc16-faff-445a-9e5d-386259a3f54d service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:27:18.498444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169fc16-faff-445a-9e5d-386259a3f54d service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:27:18.498715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169fc16-faff-445a-9e5d-386259a3f54d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:27:18.508474 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169fc16-faff-445a-9e5d-386259a3f54d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:27:18.509942 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169fc16-faff-445a-9e5d-386259a3f54d service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:27:18.519957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 783/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:27:28.165562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=11 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:27:28.515048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=8 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:52.723524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae63a6e-81b5-48f8-addb-dc0a59b5ba47 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:52.724138 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae63a6e-81b5-48f8-addb-dc0a59b5ba47 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:52.724138 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae63a6e-81b5-48f8-addb-dc0a59b5ba47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:52.743427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-5ae63a6e-81b5-48f8-addb-dc0a59b5ba47 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:52.744623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5ae63a6e-81b5-48f8-addb-dc0a59b5ba47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:52.755964 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 757/1540] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:52.764391 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023cd05-b020-4108-b03f-c02dc58c942d None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:52.765899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023cd05-b020-4108-b03f-c02dc58c942d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:52.765899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023cd05-b020-4108-b03f-c02dc58c942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:52.792966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e023cd05-b020-4108-b03f-c02dc58c942d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:52.794611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e023cd05-b020-4108-b03f-c02dc58c942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:52.810137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 784/1541] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:52.815248 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae63a6e-81b5-48f8-addb-dc0a59b5ba47 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:52.829323 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae63a6e-81b5-48f8-addb-dc0a59b5ba47 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:52.834596 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723d550-7b78-4aa3-9997-54643d21560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:52.835285 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723d550-7b78-4aa3-9997-54643d21560a admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:52.835571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723d550-7b78-4aa3-9997-54643d21560a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:52.835847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723d550-7b78-4aa3-9997-54643d21560a admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:52.836589 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723d550-7b78-4aa3-9997-54643d21560a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:28:52.836896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723d550-7b78-4aa3-9997-54643d21560a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:52.842899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723d550-7b78-4aa3-9997-54643d21560a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:52.859977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 758/1542] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:28:52.861919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd759b-d084-4826-a337-0867df7885e8 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:52.863018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd759b-d084-4826-a337-0867df7885e8 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:52.863526 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd759b-d084-4826-a337-0867df7885e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:52.893150 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723d550-7b78-4aa3-9997-54643d21560a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:52.894589 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-5ffd759b-d084-4826-a337-0867df7885e8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:52.896070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-5ffd759b-d084-4826-a337-0867df7885e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:52.905543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 785/1543] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:52.905758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723d550-7b78-4aa3-9997-54643d21560a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:52.911208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03111767-5985-4401-9b7a-d64ca6d619b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:52.911883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03111767-5985-4401-9b7a-d64ca6d619b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:52.912172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03111767-5985-4401-9b7a-d64ca6d619b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:52.912445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03111767-5985-4401-9b7a-d64ca6d619b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:52.913503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03111767-5985-4401-9b7a-d64ca6d619b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:52.914864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: WARNING py.warnings [None req-03111767-5985-4401-9b7a-d64ca6d619b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:28:52.914864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: warnings.warn(msg) Jul 12 16:28:52.914864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: Jul 12 16:28:52.915461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74923b0c-a864-4418-a33c-1eaf8c445515 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:52.916013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74923b0c-a864-4418-a33c-1eaf8c445515 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:52.916133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03111767-5985-4401-9b7a-d64ca6d619b6 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:52.916616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74923b0c-a864-4418-a33c-1eaf8c445515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:52.951373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-74923b0c-a864-4418-a33c-1eaf8c445515 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:52.953106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-74923b0c-a864-4418-a33c-1eaf8c445515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:52.969568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 786/1544] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:28:52.975529 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74923b0c-a864-4418-a33c-1eaf8c445515 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:52.990991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74923b0c-a864-4418-a33c-1eaf8c445515 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:52.999627 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7730de-be08-44e7-a174-c1a22eb972bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:53.008674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7730de-be08-44e7-a174-c1a22eb972bc admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.008674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7730de-be08-44e7-a174-c1a22eb972bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.008674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7730de-be08-44e7-a174-c1a22eb972bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.008674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7730de-be08-44e7-a174-c1a22eb972bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:28:53.008674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7730de-be08-44e7-a174-c1a22eb972bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:53.009198 dv-cinder-797608-56-smb devstack@keystone.service[80380]: WARNING py.warnings [None req-fc7730de-be08-44e7-a174-c1a22eb972bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:28:53.009198 dv-cinder-797608-56-smb devstack@keystone.service[80380]: warnings.warn(msg) Jul 12 16:28:53.009198 dv-cinder-797608-56-smb devstack@keystone.service[80380]: Jul 12 16:28:53.009198 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7730de-be08-44e7-a174-c1a22eb972bc admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:53.029712 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 787/1545] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:28:53.032917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7730de-be08-44e7-a174-c1a22eb972bc admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.048379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7730de-be08-44e7-a174-c1a22eb972bc admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.054053 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7157d9-b400-49ff-82a4-96a7e306b9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:53.055046 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7157d9-b400-49ff-82a4-96a7e306b9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.055671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7157d9-b400-49ff-82a4-96a7e306b9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.056197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7157d9-b400-49ff-82a4-96a7e306b9a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.057238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7157d9-b400-49ff-82a4-96a7e306b9a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:53.059509 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7157d9-b400-49ff-82a4-96a7e306b9a3 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:53.070924 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 759/1546] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:28:52 2022] POST /identity/v3/projects => generated 405 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:53.086289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03111767-5985-4401-9b7a-d64ca6d619b6 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.182591 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03111767-5985-4401-9b7a-d64ca6d619b6 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.187641 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 788/1547] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:28:53.188090 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81537047-c6af-4461-b0e3-a0dcdb332960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:53.188786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81537047-c6af-4461-b0e3-a0dcdb332960 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.189200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81537047-c6af-4461-b0e3-a0dcdb332960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.189489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81537047-c6af-4461-b0e3-a0dcdb332960 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.190554 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81537047-c6af-4461-b0e3-a0dcdb332960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:53.191705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7157d9-b400-49ff-82a4-96a7e306b9a3 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.192726 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81537047-c6af-4461-b0e3-a0dcdb332960 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:53.288192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 760/1548] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/users => generated 303 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:53.290380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7157d9-b400-49ff-82a4-96a7e306b9a3 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.293142 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81537047-c6af-4461-b0e3-a0dcdb332960 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.298926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117d9d0-c614-4f9c-a15b-d5c7ae13dfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:53.299866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117d9d0-c614-4f9c-a15b-d5c7ae13dfd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.300151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117d9d0-c614-4f9c-a15b-d5c7ae13dfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.300472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117d9d0-c614-4f9c-a15b-d5c7ae13dfd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.301200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117d9d0-c614-4f9c-a15b-d5c7ae13dfd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:53.302235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: WARNING py.warnings [None req-f117d9d0-c614-4f9c-a15b-d5c7ae13dfd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:28:53.302235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: warnings.warn(msg) Jul 12 16:28:53.302235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: Jul 12 16:28:53.303498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117d9d0-c614-4f9c-a15b-d5c7ae13dfd0 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:53.310427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81537047-c6af-4461-b0e3-a0dcdb332960 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.315725 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91d288-93ea-4c06-8c66-840a8f85ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:53.320444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91d288-93ea-4c06-8c66-840a8f85ff2d admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.320444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91d288-93ea-4c06-8c66-840a8f85ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.320444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91d288-93ea-4c06-8c66-840a8f85ff2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.321593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91d288-93ea-4c06-8c66-840a8f85ff2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:53.323503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91d288-93ea-4c06-8c66-840a8f85ff2d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:53.338593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 761/1549] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:28:53.339902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813022-8318-4ae8-9ad5-c57a53e22357 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.340193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813022-8318-4ae8-9ad5-c57a53e22357 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.340474 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813022-8318-4ae8-9ad5-c57a53e22357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.367301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-98813022-8318-4ae8-9ad5-c57a53e22357 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:53.368522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-98813022-8318-4ae8-9ad5-c57a53e22357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:53.382046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 762/1550] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:53.383619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0933e36-7114-4c20-948d-df56748ca682 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.383914 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0933e36-7114-4c20-948d-df56748ca682 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.384310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0933e36-7114-4c20-948d-df56748ca682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.405056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-b0933e36-7114-4c20-948d-df56748ca682 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:53.406332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b0933e36-7114-4c20-948d-df56748ca682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:53.415889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 763/1551] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:53.416682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0933e36-7114-4c20-948d-df56748ca682 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.429931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0933e36-7114-4c20-948d-df56748ca682 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.432269 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 789/1552] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/users => generated 281 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:53.435336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94558425-a413-4dc5-b5a1-672f8774d583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:53.436114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94558425-a413-4dc5-b5a1-672f8774d583 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.436404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94558425-a413-4dc5-b5a1-672f8774d583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.436684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94558425-a413-4dc5-b5a1-672f8774d583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.437445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94558425-a413-4dc5-b5a1-672f8774d583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:53.437921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db0d2c-d6b5-497d-a435-5f9f2463d0d8 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.438220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db0d2c-d6b5-497d-a435-5f9f2463d0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.438505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db0d2c-d6b5-497d-a435-5f9f2463d0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.439045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94558425-a413-4dc5-b5a1-672f8774d583 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:53.453225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 764/1553] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:53.454931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e631c6c-f92a-4dea-88f3-4d8a99116ff6 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.455438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e631c6c-f92a-4dea-88f3-4d8a99116ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.456510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e631c6c-f92a-4dea-88f3-4d8a99116ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.468939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-92db0d2c-d6b5-497d-a435-5f9f2463d0d8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:53.470175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-92db0d2c-d6b5-497d-a435-5f9f2463d0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:53.479025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 790/1554] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:53.480274 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43319fa8-36ae-40c9-ba64-e2384d8901af None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.480559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43319fa8-36ae-40c9-ba64-e2384d8901af None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.480832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43319fa8-36ae-40c9-ba64-e2384d8901af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.481676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-1e631c6c-f92a-4dea-88f3-4d8a99116ff6 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:53.482878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1e631c6c-f92a-4dea-88f3-4d8a99116ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:53.493454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 765/1555] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:53.494299 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e631c6c-f92a-4dea-88f3-4d8a99116ff6 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.506755 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e631c6c-f92a-4dea-88f3-4d8a99116ff6 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.507485 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-43319fa8-36ae-40c9-ba64-e2384d8901af None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:53.508920 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-43319fa8-36ae-40c9-ba64-e2384d8901af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:53.512123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9b982-e0e7-4357-b10f-3b3e83df6861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:53.512787 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9b982-e0e7-4357-b10f-3b3e83df6861 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.513074 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9b982-e0e7-4357-b10f-3b3e83df6861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.513399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9b982-e0e7-4357-b10f-3b3e83df6861 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.514129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9b982-e0e7-4357-b10f-3b3e83df6861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:53.515998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9b982-e0e7-4357-b10f-3b3e83df6861 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:53.525203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 791/1556] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:53.526785 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb79cd5-3a1d-46da-94d2-ad613b09b271 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.527305 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb79cd5-3a1d-46da-94d2-ad613b09b271 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.527806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb79cd5-3a1d-46da-94d2-ad613b09b271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.528647 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 766/1557] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:53.529555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9b982-e0e7-4357-b10f-3b3e83df6861 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.540610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9b982-e0e7-4357-b10f-3b3e83df6861 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.546288 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3a4a8-b219-4ef2-b516-5945406fa401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:53.547185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3a4a8-b219-4ef2-b516-5945406fa401 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.547500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3a4a8-b219-4ef2-b516-5945406fa401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.547752 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3a4a8-b219-4ef2-b516-5945406fa401 admin admin] PATH_INFO: `/v3/projects/a639bbb688d84c838315e95d0a8d70d2/users/9dec2a352065481d839e085571e403e1/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.548403 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ccb79cd5-3a1d-46da-94d2-ad613b09b271 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:53.549713 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ccb79cd5-3a1d-46da-94d2-ad613b09b271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:53.560995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 792/1558] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:53.562278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0ba5f-46f3-4dc2-84cf-4aa012b99e4a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.562956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0ba5f-46f3-4dc2-84cf-4aa012b99e4a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.563074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0ba5f-46f3-4dc2-84cf-4aa012b99e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.566767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3a4a8-b219-4ef2-b516-5945406fa401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a639bbb688d84c838315e95d0a8d70d2, user_id=9dec2a352065481d839e085571e403e1, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:53.567810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: WARNING py.warnings [None req-1dd3a4a8-b219-4ef2-b516-5945406fa401 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:28:53.567810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: warnings.warn(msg) Jul 12 16:28:53.567810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: Jul 12 16:28:53.569793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3a4a8-b219-4ef2-b516-5945406fa401 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:53.582457 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-c4e0ba5f-46f3-4dc2-84cf-4aa012b99e4a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:53.583681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c4e0ba5f-46f3-4dc2-84cf-4aa012b99e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:53.591482 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 793/1559] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:53.592301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0ba5f-46f3-4dc2-84cf-4aa012b99e4a None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.601159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0ba5f-46f3-4dc2-84cf-4aa012b99e4a None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.605592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e8efa-f0e7-4db2-a35c-b5599be376b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:53.606209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8efa-f0e7-4db2-a35c-b5599be376b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.606489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8efa-f0e7-4db2-a35c-b5599be376b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.606760 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8efa-f0e7-4db2-a35c-b5599be376b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.607466 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e8efa-f0e7-4db2-a35c-b5599be376b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:28:53.607770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e8efa-f0e7-4db2-a35c-b5599be376b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:53.609742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e8efa-f0e7-4db2-a35c-b5599be376b6 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:53.620547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 794/1560] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:28:53.621804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec46cb-d1ba-4d98-9f25-81ac00fa25a0 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.622089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec46cb-d1ba-4d98-9f25-81ac00fa25a0 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.622364 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec46cb-d1ba-4d98-9f25-81ac00fa25a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.640350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-f0ec46cb-d1ba-4d98-9f25-81ac00fa25a0 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:53.641704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f0ec46cb-d1ba-4d98-9f25-81ac00fa25a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:53.650486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 795/1561] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:53.651257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec46cb-d1ba-4d98-9f25-81ac00fa25a0 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.660330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec46cb-d1ba-4d98-9f25-81ac00fa25a0 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.664871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b623e-7a8d-429e-b26b-a0237c27b726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:53.665572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b623e-7a8d-429e-b26b-a0237c27b726 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.665859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b623e-7a8d-429e-b26b-a0237c27b726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.666137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b623e-7a8d-429e-b26b-a0237c27b726 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.666858 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b623e-7a8d-429e-b26b-a0237c27b726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:28:53.667265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b623e-7a8d-429e-b26b-a0237c27b726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:53.668874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b623e-7a8d-429e-b26b-a0237c27b726 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:53.687788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 796/1562] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:28:53.687788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b623e-7a8d-429e-b26b-a0237c27b726 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.696331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b623e-7a8d-429e-b26b-a0237c27b726 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.696486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 767/1563] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:28:53 2022] PUT /identity/v3/projects/a639bbb688d84c838315e95d0a8d70d2/users/9dec2a352065481d839e085571e403e1/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:53.696486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376e035-0bb2-43e4-87a0-061e8cb37d46 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.696486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376e035-0bb2-43e4-87a0-061e8cb37d46 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.696486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376e035-0bb2-43e4-87a0-061e8cb37d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.712788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-9376e035-0bb2-43e4-87a0-061e8cb37d46 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:53.714014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9376e035-0bb2-43e4-87a0-061e8cb37d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:53.725172 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:53.731954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:53.749719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c422375-1a7e-4f00-94dd-b8239f01144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:53.750394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c422375-1a7e-4f00-94dd-b8239f01144a admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.750705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c422375-1a7e-4f00-94dd-b8239f01144a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.750981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c422375-1a7e-4f00-94dd-b8239f01144a admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.751707 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c422375-1a7e-4f00-94dd-b8239f01144a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:53.753902 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c422375-1a7e-4f00-94dd-b8239f01144a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:53.764394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 797/1564] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:53.766521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1541ea8-97cf-4566-bbd3-bd50054138fb None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.767166 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1541ea8-97cf-4566-bbd3-bd50054138fb None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.767166 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1541ea8-97cf-4566-bbd3-bd50054138fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.774847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 768/1565] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:53.775819 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376e035-0bb2-43e4-87a0-061e8cb37d46 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.784987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e1541ea8-97cf-4566-bbd3-bd50054138fb None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:53.788255 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e1541ea8-97cf-4566-bbd3-bd50054138fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:53.788382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376e035-0bb2-43e4-87a0-061e8cb37d46 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.791537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492cbac-5942-4454-9cc6-c53ffdc08632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:53.792196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492cbac-5942-4454-9cc6-c53ffdc08632 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.792527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492cbac-5942-4454-9cc6-c53ffdc08632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.792900 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492cbac-5942-4454-9cc6-c53ffdc08632 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.793672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492cbac-5942-4454-9cc6-c53ffdc08632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:28:53.793982 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492cbac-5942-4454-9cc6-c53ffdc08632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:53.795247 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 798/1566] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:53.796342 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1541ea8-97cf-4566-bbd3-bd50054138fb None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.797780 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492cbac-5942-4454-9cc6-c53ffdc08632 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:53.806220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1541ea8-97cf-4566-bbd3-bd50054138fb None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.810598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 769/1567] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:28:53.810932 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb833a-b5e4-475f-9e2e-2d43c0d7397b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:53.811660 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb833a-b5e4-475f-9e2e-2d43c0d7397b admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.811888 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb833a-b5e4-475f-9e2e-2d43c0d7397b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.812023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea0c24-10fb-47c4-92c4-a6529b3e1d51 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.812120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb833a-b5e4-475f-9e2e-2d43c0d7397b admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.812220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea0c24-10fb-47c4-92c4-a6529b3e1d51 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.812500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea0c24-10fb-47c4-92c4-a6529b3e1d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.812810 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb833a-b5e4-475f-9e2e-2d43c0d7397b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:53.814900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb833a-b5e4-475f-9e2e-2d43c0d7397b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:53.830681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-31ea0c24-10fb-47c4-92c4-a6529b3e1d51 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:53.831904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-31ea0c24-10fb-47c4-92c4-a6529b3e1d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:53.840629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 770/1568] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:53.842198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ccab5-0905-46bc-85a8-dd485ddbbbdb None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:53.842495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ccab5-0905-46bc-85a8-dd485ddbbbdb None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:53.842777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ccab5-0905-46bc-85a8-dd485ddbbbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:53.868448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-737ccab5-0905-46bc-85a8-dd485ddbbbdb None None] MFA Rules not processed for user `9dec2a352065481d839e085571e403e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:53.869808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-737ccab5-0905-46bc-85a8-dd485ddbbbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:53.927272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 799/1569] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:53.927272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb833a-b5e4-475f-9e2e-2d43c0d7397b admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.933485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 771/1570] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:53.934299 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ccab5-0905-46bc-85a8-dd485ddbbbdb None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:53.944140 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ccab5-0905-46bc-85a8-dd485ddbbbdb None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.995378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb833a-b5e4-475f-9e2e-2d43c0d7397b admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:53.999988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538da45-cc03-4267-883d-9a70b18c532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.000652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538da45-cc03-4267-883d-9a70b18c532e admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.000936 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538da45-cc03-4267-883d-9a70b18c532e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.001249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538da45-cc03-4267-883d-9a70b18c532e admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.001945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538da45-cc03-4267-883d-9a70b18c532e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.002992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb40d6-eb93-4089-953d-94a1fca33e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.003878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb40d6-eb93-4089-953d-94a1fca33e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.003995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538da45-cc03-4267-883d-9a70b18c532e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.004154 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb40d6-eb93-4089-953d-94a1fca33e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.004422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb40d6-eb93-4089-953d-94a1fca33e26 admin admin] PATH_INFO: `/v3/projects/8dd59cd3e1fd4a95912d1e59bcc66170/users/84ee7a2c1656445590cfddb96225224a/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.019478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb40d6-eb93-4089-953d-94a1fca33e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd59cd3e1fd4a95912d1e59bcc66170, user_id=84ee7a2c1656445590cfddb96225224a, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.022187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb40d6-eb93-4089-953d-94a1fca33e26 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.088676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 800/1571] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:28:53 2022] POST /identity/v3/projects => generated 403 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:54.088676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace814f9-d3e6-466a-9cb6-3dade52989ca None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.088676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace814f9-d3e6-466a-9cb6-3dade52989ca None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.088676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace814f9-d3e6-466a-9cb6-3dade52989ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.105486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ace814f9-d3e6-466a-9cb6-3dade52989ca None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:54.110256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ace814f9-d3e6-466a-9cb6-3dade52989ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:54.112571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 772/1572] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:28:53 2022] PUT /identity/v3/projects/8dd59cd3e1fd4a95912d1e59bcc66170/users/84ee7a2c1656445590cfddb96225224a/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:54.113503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb40d6-eb93-4089-953d-94a1fca33e26 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.131982 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:54.175724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 801/1573] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:54.177356 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb40d6-eb93-4089-953d-94a1fca33e26 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.177949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace814f9-d3e6-466a-9cb6-3dade52989ca None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.182257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2b68c-8cc8-482b-89c3-6704d7acab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.183000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2b68c-8cc8-482b-89c3-6704d7acab03 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.183365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2b68c-8cc8-482b-89c3-6704d7acab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.183724 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2b68c-8cc8-482b-89c3-6704d7acab03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.184463 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2b68c-8cc8-482b-89c3-6704d7acab03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:28:54.184780 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2b68c-8cc8-482b-89c3-6704d7acab03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.186889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2b68c-8cc8-482b-89c3-6704d7acab03 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.187699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace814f9-d3e6-466a-9cb6-3dade52989ca None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.193007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694a3c9-85da-4540-ab91-a6bd2e100a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.193716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a3c9-85da-4540-ab91-a6bd2e100a9d admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.193997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a3c9-85da-4540-ab91-a6bd2e100a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.194278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a3c9-85da-4540-ab91-a6bd2e100a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.195088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694a3c9-85da-4540-ab91-a6bd2e100a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.196961 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694a3c9-85da-4540-ab91-a6bd2e100a9d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.199691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 773/1574] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:28:54.199691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2b68c-8cc8-482b-89c3-6704d7acab03 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.217933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2b68c-8cc8-482b-89c3-6704d7acab03 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.222552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cb6fc-161e-4fbe-b191-e27a23eaed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.223228 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cb6fc-161e-4fbe-b191-e27a23eaed51 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.224934 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cb6fc-161e-4fbe-b191-e27a23eaed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.224934 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cb6fc-161e-4fbe-b191-e27a23eaed51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.224934 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cb6fc-161e-4fbe-b191-e27a23eaed51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:28:54.224934 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cb6fc-161e-4fbe-b191-e27a23eaed51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.226404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cb6fc-161e-4fbe-b191-e27a23eaed51 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.238198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 774/1575] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:28:54.239102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cb6fc-161e-4fbe-b191-e27a23eaed51 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.248364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cb6fc-161e-4fbe-b191-e27a23eaed51 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.253501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4807f82-c3ef-4bf3-8829-9d70db65d0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.254129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4807f82-c3ef-4bf3-8829-9d70db65d0aa admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.254410 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4807f82-c3ef-4bf3-8829-9d70db65d0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.254685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4807f82-c3ef-4bf3-8829-9d70db65d0aa admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.255357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4807f82-c3ef-4bf3-8829-9d70db65d0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.257241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4807f82-c3ef-4bf3-8829-9d70db65d0aa admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.275199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 802/1576] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:54.276031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694a3c9-85da-4540-ab91-a6bd2e100a9d admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.284384 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:54.337995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694a3c9-85da-4540-ab91-a6bd2e100a9d admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.342598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f86f7-0495-468a-9bfa-c03ae5668aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.343309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f86f7-0495-468a-9bfa-c03ae5668aba admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.343596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f86f7-0495-468a-9bfa-c03ae5668aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.343873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f86f7-0495-468a-9bfa-c03ae5668aba admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.344561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f86f7-0495-468a-9bfa-c03ae5668aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.346555 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f86f7-0495-468a-9bfa-c03ae5668aba admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.356291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 775/1577] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:54.357347 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4807f82-c3ef-4bf3-8829-9d70db65d0aa admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.367669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4807f82-c3ef-4bf3-8829-9d70db65d0aa admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.372310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d16963-0893-4f0c-81dd-1e2201952cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.372965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16963-0893-4f0c-81dd-1e2201952cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.373303 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16963-0893-4f0c-81dd-1e2201952cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.373570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16963-0893-4f0c-81dd-1e2201952cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.374262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d16963-0893-4f0c-81dd-1e2201952cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.376171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d16963-0893-4f0c-81dd-1e2201952cf2 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.437777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 803/1578] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/projects => generated 401 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:54.439220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83260773-0b38-4a04-a433-664ef2c1ee00 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.439519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83260773-0b38-4a04-a433-664ef2c1ee00 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.439801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83260773-0b38-4a04-a433-664ef2c1ee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.464765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 776/1579] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/users => generated 302 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:54.465762 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d16963-0893-4f0c-81dd-1e2201952cf2 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.471177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-83260773-0b38-4a04-a433-664ef2c1ee00 None None] MFA Rules not processed for user `84ee7a2c1656445590cfddb96225224a`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:54.473044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-83260773-0b38-4a04-a433-664ef2c1ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:54.475552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d16963-0893-4f0c-81dd-1e2201952cf2 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.532530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a88bc-f755-44f5-bdf0-82f913544c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.533140 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a88bc-f755-44f5-bdf0-82f913544c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.533427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a88bc-f755-44f5-bdf0-82f913544c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.533705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a88bc-f755-44f5-bdf0-82f913544c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.534435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a88bc-f755-44f5-bdf0-82f913544c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:28:54.534747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a88bc-f755-44f5-bdf0-82f913544c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.536358 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a88bc-f755-44f5-bdf0-82f913544c1c admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.538329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 804/1580] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:54.539146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83260773-0b38-4a04-a433-664ef2c1ee00 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.556513 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 777/1581] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:28:54.556724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83260773-0b38-4a04-a433-664ef2c1ee00 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.556816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a88bc-f755-44f5-bdf0-82f913544c1c admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.556895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583f21e-af88-4b22-b429-674976dbb36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.556895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f21e-af88-4b22-b429-674976dbb36f admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.556895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f21e-af88-4b22-b429-674976dbb36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.556895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f21e-af88-4b22-b429-674976dbb36f admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.557250 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583f21e-af88-4b22-b429-674976dbb36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.558810 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583f21e-af88-4b22-b429-674976dbb36f admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.560278 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a88bc-f755-44f5-bdf0-82f913544c1c admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.564858 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3681134-d292-4918-a946-bded0ff2ece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.566075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3681134-d292-4918-a946-bded0ff2ece4 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.566367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3681134-d292-4918-a946-bded0ff2ece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.566647 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3681134-d292-4918-a946-bded0ff2ece4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.567329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3681134-d292-4918-a946-bded0ff2ece4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.569256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3681134-d292-4918-a946-bded0ff2ece4 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.639423 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 805/1582] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:54.640378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583f21e-af88-4b22-b429-674976dbb36f admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.669441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 778/1583] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:54.669441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3681134-d292-4918-a946-bded0ff2ece4 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.703655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583f21e-af88-4b22-b429-674976dbb36f admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.704722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:54.707285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:54.732842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3681134-d292-4918-a946-bded0ff2ece4 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.738716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0273653-0c1d-4e5b-9256-42eff2bbfc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.739512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0273653-0c1d-4e5b-9256-42eff2bbfc3a admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.739824 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0273653-0c1d-4e5b-9256-42eff2bbfc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.740076 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0273653-0c1d-4e5b-9256-42eff2bbfc3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.740807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0273653-0c1d-4e5b-9256-42eff2bbfc3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.742448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0273653-0c1d-4e5b-9256-42eff2bbfc3a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.755983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 779/1584] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:54.755983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0273653-0c1d-4e5b-9256-42eff2bbfc3a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.766003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0273653-0c1d-4e5b-9256-42eff2bbfc3a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.770826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89451ac9-88aa-411e-8d63-ad2d2ce19745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.771361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d7d59-1772-4d8c-a22d-b30bb6e265b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.774483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89451ac9-88aa-411e-8d63-ad2d2ce19745 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.774624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d7d59-1772-4d8c-a22d-b30bb6e265b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.774719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89451ac9-88aa-411e-8d63-ad2d2ce19745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.774824 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d7d59-1772-4d8c-a22d-b30bb6e265b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.774915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89451ac9-88aa-411e-8d63-ad2d2ce19745 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.774993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d7d59-1772-4d8c-a22d-b30bb6e265b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.775085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89451ac9-88aa-411e-8d63-ad2d2ce19745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.775174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d7d59-1772-4d8c-a22d-b30bb6e265b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.775174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d7d59-1772-4d8c-a22d-b30bb6e265b0 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.775313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89451ac9-88aa-411e-8d63-ad2d2ce19745 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.854925 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 780/1585] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/users => generated 307 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:54.856434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d7d59-1772-4d8c-a22d-b30bb6e265b0 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.866965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d7d59-1772-4d8c-a22d-b30bb6e265b0 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.868563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 806/1586] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:54.869315 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89451ac9-88aa-411e-8d63-ad2d2ce19745 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.872390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f66e9-7eac-448e-aa61-a3c6693256b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.873041 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f66e9-7eac-448e-aa61-a3c6693256b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.873352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f66e9-7eac-448e-aa61-a3c6693256b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.873625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f66e9-7eac-448e-aa61-a3c6693256b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.874351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f66e9-7eac-448e-aa61-a3c6693256b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.875930 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f66e9-7eac-448e-aa61-a3c6693256b8 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.880175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89451ac9-88aa-411e-8d63-ad2d2ce19745 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.884911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc421c-15d7-4f07-bea8-55d7ca8fd24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.885593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc421c-15d7-4f07-bea8-55d7ca8fd24c admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.885882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc421c-15d7-4f07-bea8-55d7ca8fd24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.886161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc421c-15d7-4f07-bea8-55d7ca8fd24c admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.886856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc421c-15d7-4f07-bea8-55d7ca8fd24c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.886999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 781/1587] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:54.888885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc421c-15d7-4f07-bea8-55d7ca8fd24c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.890804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f66e9-7eac-448e-aa61-a3c6693256b8 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.900272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f66e9-7eac-448e-aa61-a3c6693256b8 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:54.904911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b857c-752c-4da9-a924-5bc22e596ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:54.905581 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b857c-752c-4da9-a924-5bc22e596ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:54.905860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b857c-752c-4da9-a924-5bc22e596ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:54.906207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b857c-752c-4da9-a924-5bc22e596ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:54.906907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b857c-752c-4da9-a924-5bc22e596ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:54.908767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b857c-752c-4da9-a924-5bc22e596ce7 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:54.988865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 807/1588] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:54.989789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc421c-15d7-4f07-bea8-55d7ca8fd24c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:54.999429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 782/1589] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:55.000107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b857c-752c-4da9-a924-5bc22e596ce7 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.054898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc421c-15d7-4f07-bea8-55d7ca8fd24c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.059753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf8f14-3c88-4642-bf44-697dbb2a42b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.060890 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b857c-752c-4da9-a924-5bc22e596ce7 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.061602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf8f14-3c88-4642-bf44-697dbb2a42b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.061922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf8f14-3c88-4642-bf44-697dbb2a42b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.062199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf8f14-3c88-4642-bf44-697dbb2a42b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.062900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf8f14-3c88-4642-bf44-697dbb2a42b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.064818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf8f14-3c88-4642-bf44-697dbb2a42b9 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.065787 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff6c93-5a9e-4db5-985c-0e4c1d0e0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.066457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff6c93-5a9e-4db5-985c-0e4c1d0e0ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.066744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff6c93-5a9e-4db5-985c-0e4c1d0e0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.067170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff6c93-5a9e-4db5-985c-0e4c1d0e0ae7 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.067858 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff6c93-5a9e-4db5-985c-0e4c1d0e0ae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.069831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff6c93-5a9e-4db5-985c-0e4c1d0e0ae7 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.170783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 808/1590] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:55.170783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf8f14-3c88-4642-bf44-697dbb2a42b9 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.178845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf8f14-3c88-4642-bf44-697dbb2a42b9 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.183042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 783/1591] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:28:54 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:55.183042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff6c93-5a9e-4db5-985c-0e4c1d0e0ae7 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.183649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad34084-05f7-47f7-a101-bf197ad83c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.184299 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad34084-05f7-47f7-a101-bf197ad83c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.184585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad34084-05f7-47f7-a101-bf197ad83c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.184854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad34084-05f7-47f7-a101-bf197ad83c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.185616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad34084-05f7-47f7-a101-bf197ad83c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.187196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad34084-05f7-47f7-a101-bf197ad83c87 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.192527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff6c93-5a9e-4db5-985c-0e4c1d0e0ae7 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.197412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579f403-90cc-43e1-88b4-a8a498fc4eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.197586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 809/1592] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:55.197846 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579f403-90cc-43e1-88b4-a8a498fc4eec admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.198198 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad34084-05f7-47f7-a101-bf197ad83c87 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.198326 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579f403-90cc-43e1-88b4-a8a498fc4eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.198557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579f403-90cc-43e1-88b4-a8a498fc4eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.199201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579f403-90cc-43e1-88b4-a8a498fc4eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.200797 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579f403-90cc-43e1-88b4-a8a498fc4eec admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.209011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad34084-05f7-47f7-a101-bf197ad83c87 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.213899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 784/1593] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:55.213899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579f403-90cc-43e1-88b4-a8a498fc4eec admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.215790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7c9e1-cae8-4104-8d44-fbf1fe18563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.216446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7c9e1-cae8-4104-8d44-fbf1fe18563e admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.216727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7c9e1-cae8-4104-8d44-fbf1fe18563e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.216999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7c9e1-cae8-4104-8d44-fbf1fe18563e admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.217741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7c9e1-cae8-4104-8d44-fbf1fe18563e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.222575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7c9e1-cae8-4104-8d44-fbf1fe18563e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.222748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579f403-90cc-43e1-88b4-a8a498fc4eec admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.227244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5f094-e89a-491c-bb87-d3b748b8eb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.227875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5f094-e89a-491c-bb87-d3b748b8eb8f admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.228164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5f094-e89a-491c-bb87-d3b748b8eb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.228447 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5f094-e89a-491c-bb87-d3b748b8eb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.229239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5f094-e89a-491c-bb87-d3b748b8eb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.230583 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 810/1594] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:55.230806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5f094-e89a-491c-bb87-d3b748b8eb8f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.231326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7c9e1-cae8-4104-8d44-fbf1fe18563e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.241353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7c9e1-cae8-4104-8d44-fbf1fe18563e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.246825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 785/1595] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:55.246825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5f094-e89a-491c-bb87-d3b748b8eb8f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.247126 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78cdd2-11e2-4ccc-aa7f-a322e7f00bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.247126 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78cdd2-11e2-4ccc-aa7f-a322e7f00bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.247126 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78cdd2-11e2-4ccc-aa7f-a322e7f00bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.247126 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78cdd2-11e2-4ccc-aa7f-a322e7f00bcf admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.247909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78cdd2-11e2-4ccc-aa7f-a322e7f00bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.249811 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78cdd2-11e2-4ccc-aa7f-a322e7f00bcf admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.254060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5f094-e89a-491c-bb87-d3b748b8eb8f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.258768 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22529ec-9fce-4129-924c-3f67a7751387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.259423 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22529ec-9fce-4129-924c-3f67a7751387 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.259697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22529ec-9fce-4129-924c-3f67a7751387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.259976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22529ec-9fce-4129-924c-3f67a7751387 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.260701 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22529ec-9fce-4129-924c-3f67a7751387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.262644 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22529ec-9fce-4129-924c-3f67a7751387 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.339020 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 811/1596] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:28:55 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:55.339850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78cdd2-11e2-4ccc-aa7f-a322e7f00bcf admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.349750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78cdd2-11e2-4ccc-aa7f-a322e7f00bcf admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.354264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85c1ab-9e44-4200-a795-734998052c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.354953 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85c1ab-9e44-4200-a795-734998052c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.355279 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85c1ab-9e44-4200-a795-734998052c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.355564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85c1ab-9e44-4200-a795-734998052c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.356278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85c1ab-9e44-4200-a795-734998052c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.357904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85c1ab-9e44-4200-a795-734998052c9f admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.370539 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 786/1597] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:28:55 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:55.370745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 812/1598] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:55.370854 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22529ec-9fce-4129-924c-3f67a7751387 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.370947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85c1ab-9e44-4200-a795-734998052c9f admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.379159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85c1ab-9e44-4200-a795-734998052c9f admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.380716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22529ec-9fce-4129-924c-3f67a7751387 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.383899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da564a7-a9d0-49a8-895d-5b4a36008ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.384776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da564a7-a9d0-49a8-895d-5b4a36008ced admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.385066 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da564a7-a9d0-49a8-895d-5b4a36008ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.385294 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4354a4-ef20-4817-8cea-2c7f278cca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.385424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da564a7-a9d0-49a8-895d-5b4a36008ced admin admin] PATH_INFO: `/v3/projects/aef6f97ca62943b6b66f919f9b19f78a/users/93b8205e9a894cbd8296f145291cd999/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.385979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4354a4-ef20-4817-8cea-2c7f278cca1c admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.386251 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4354a4-ef20-4817-8cea-2c7f278cca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.386645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4354a4-ef20-4817-8cea-2c7f278cca1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.387366 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4354a4-ef20-4817-8cea-2c7f278cca1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.388946 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4354a4-ef20-4817-8cea-2c7f278cca1c admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.397692 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:55.399546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 787/1599] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:55.402696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4354a4-ef20-4817-8cea-2c7f278cca1c admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.404680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da564a7-a9d0-49a8-895d-5b4a36008ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef6f97ca62943b6b66f919f9b19f78a, user_id=93b8205e9a894cbd8296f145291cd999, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.407414 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da564a7-a9d0-49a8-895d-5b4a36008ced admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.410613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4354a4-ef20-4817-8cea-2c7f278cca1c admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.415371 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c716a2b-df01-4ce0-aaa4-b8e5777c7548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.416244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716a2b-df01-4ce0-aaa4-b8e5777c7548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.416526 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716a2b-df01-4ce0-aaa4-b8e5777c7548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.416803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716a2b-df01-4ce0-aaa4-b8e5777c7548 admin admin] PATH_INFO: `/v3/projects/6b02eddfc4444894af81c07ad8bd10a4/users/c12e441338544bf38df74a54af4a6127/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.431841 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c716a2b-df01-4ce0-aaa4-b8e5777c7548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b02eddfc4444894af81c07ad8bd10a4, user_id=c12e441338544bf38df74a54af4a6127, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.434428 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c716a2b-df01-4ce0-aaa4-b8e5777c7548 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.436575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:55.510436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 813/1600] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:28:55 2022] PUT /identity/v3/projects/aef6f97ca62943b6b66f919f9b19f78a/users/93b8205e9a894cbd8296f145291cd999/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:55.511266 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da564a7-a9d0-49a8-895d-5b4a36008ced admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.556792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 788/1601] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:28:55 2022] PUT /identity/v3/projects/6b02eddfc4444894af81c07ad8bd10a4/users/c12e441338544bf38df74a54af4a6127/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:55.557861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c716a2b-df01-4ce0-aaa4-b8e5777c7548 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.572704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da564a7-a9d0-49a8-895d-5b4a36008ced admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.618062 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c716a2b-df01-4ce0-aaa4-b8e5777c7548 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.622895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea8ed8-c714-47e6-9ea1-944ad9aec7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.623785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea8ed8-c714-47e6-9ea1-944ad9aec7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.624069 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea8ed8-c714-47e6-9ea1-944ad9aec7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.624391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea8ed8-c714-47e6-9ea1-944ad9aec7d4 admin admin] PATH_INFO: `/v3/projects/7280c20512cc4d4cb60cbf5a11df3a7d/users/890cc1a893c8454992c4f70245ed7af5/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.630064 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5869a81-2d4d-4b59-9aa8-d8f0829c404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.630738 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5869a81-2d4d-4b59-9aa8-d8f0829c404f admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.631026 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5869a81-2d4d-4b59-9aa8-d8f0829c404f admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.631306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5869a81-2d4d-4b59-9aa8-d8f0829c404f admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.632034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5869a81-2d4d-4b59-9aa8-d8f0829c404f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.633701 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5869a81-2d4d-4b59-9aa8-d8f0829c404f admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.639823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea8ed8-c714-47e6-9ea1-944ad9aec7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7280c20512cc4d4cb60cbf5a11df3a7d, user_id=890cc1a893c8454992c4f70245ed7af5, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.642499 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea8ed8-c714-47e6-9ea1-944ad9aec7d4 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.644126 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 814/1602] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:55.644916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5869a81-2d4d-4b59-9aa8-d8f0829c404f admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.654474 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5869a81-2d4d-4b59-9aa8-d8f0829c404f admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.659141 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108cd7c-9366-4dd5-a8d0-1ff164747665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.659778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108cd7c-9366-4dd5-a8d0-1ff164747665 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.660060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108cd7c-9366-4dd5-a8d0-1ff164747665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.662753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108cd7c-9366-4dd5-a8d0-1ff164747665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.662753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108cd7c-9366-4dd5-a8d0-1ff164747665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.662753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108cd7c-9366-4dd5-a8d0-1ff164747665 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.672433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 815/1603] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:55.673240 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108cd7c-9366-4dd5-a8d0-1ff164747665 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.682967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108cd7c-9366-4dd5-a8d0-1ff164747665 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.687547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c116c-61a1-4ef4-9ccf-a8642070cc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.688194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c116c-61a1-4ef4-9ccf-a8642070cc75 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.688487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c116c-61a1-4ef4-9ccf-a8642070cc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.688769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c116c-61a1-4ef4-9ccf-a8642070cc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.689527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c116c-61a1-4ef4-9ccf-a8642070cc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.691620 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c116c-61a1-4ef4-9ccf-a8642070cc75 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.702057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 816/1604] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:55.702985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c116c-61a1-4ef4-9ccf-a8642070cc75 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.713138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c116c-61a1-4ef4-9ccf-a8642070cc75 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.717679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1721a-a92a-4f2a-ba2e-bacdc8bb5772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.718298 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1721a-a92a-4f2a-ba2e-bacdc8bb5772 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.718586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1721a-a92a-4f2a-ba2e-bacdc8bb5772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.718855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1721a-a92a-4f2a-ba2e-bacdc8bb5772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.719553 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1721a-a92a-4f2a-ba2e-bacdc8bb5772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.721174 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1721a-a92a-4f2a-ba2e-bacdc8bb5772 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.723939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 789/1605] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:28:55 2022] PUT /identity/v3/projects/7280c20512cc4d4cb60cbf5a11df3a7d/users/890cc1a893c8454992c4f70245ed7af5/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:55.724650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea8ed8-c714-47e6-9ea1-944ad9aec7d4 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.736524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 817/1606] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:55.736524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52509dcd-2b18-4b6d-b916-a189834c756d None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.736524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52509dcd-2b18-4b6d-b916-a189834c756d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.736524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52509dcd-2b18-4b6d-b916-a189834c756d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.766205 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-52509dcd-2b18-4b6d-b916-a189834c756d None None] MFA Rules not processed for user `93b8205e9a894cbd8296f145291cd999`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:55.767423 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-52509dcd-2b18-4b6d-b916-a189834c756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:55.788847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea8ed8-c714-47e6-9ea1-944ad9aec7d4 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.793755 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd715e-f391-4dd5-ac4e-8999cadcf037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.794555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd715e-f391-4dd5-ac4e-8999cadcf037 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.794874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd715e-f391-4dd5-ac4e-8999cadcf037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.795156 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd715e-f391-4dd5-ac4e-8999cadcf037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.796167 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd715e-f391-4dd5-ac4e-8999cadcf037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.797940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd715e-f391-4dd5-ac4e-8999cadcf037 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.810857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 790/1607] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:55.810857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd715e-f391-4dd5-ac4e-8999cadcf037 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.820115 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd715e-f391-4dd5-ac4e-8999cadcf037 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.825195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:55.825666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8242371-6259-435f-973e-5d81f6628e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.825666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242371-6259-435f-973e-5d81f6628e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.825882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242371-6259-435f-973e-5d81f6628e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.826002 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242371-6259-435f-973e-5d81f6628e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.826730 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8242371-6259-435f-973e-5d81f6628e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.828309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8242371-6259-435f-973e-5d81f6628e73 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.838970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 791/1608] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:55.839726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 818/1609] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:55.840024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8242371-6259-435f-973e-5d81f6628e73 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.841960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52509dcd-2b18-4b6d-b916-a189834c756d None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.852600 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52509dcd-2b18-4b6d-b916-a189834c756d None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.857127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8242371-6259-435f-973e-5d81f6628e73 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:55.857254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4f7bf-a045-4a32-b62d-b539260f57ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.857396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5241b1-0b42-4e5f-9eb1-e8f8bf54309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:55.858134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4f7bf-a045-4a32-b62d-b539260f57ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.858265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5241b1-0b42-4e5f-9eb1-e8f8bf54309e admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.858417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4f7bf-a045-4a32-b62d-b539260f57ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.858514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5241b1-0b42-4e5f-9eb1-e8f8bf54309e admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.858692 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4f7bf-a045-4a32-b62d-b539260f57ea admin admin] PATH_INFO: `/v3/projects/b683290ba0434b3c95c02e2744711f59/users/a6bff9a8679f450084c85c568753a387/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.858798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5241b1-0b42-4e5f-9eb1-e8f8bf54309e admin admin] PATH_INFO: `/v3/projects/fbe5725453a9468eb6f934078b01a862/users/ddfe9bf33946474f8ea4019d2c9e86e0/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:55.873676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4f7bf-a045-4a32-b62d-b539260f57ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b683290ba0434b3c95c02e2744711f59, user_id=a6bff9a8679f450084c85c568753a387, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.873864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5241b1-0b42-4e5f-9eb1-e8f8bf54309e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe5725453a9468eb6f934078b01a862, user_id=ddfe9bf33946474f8ea4019d2c9e86e0, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:55.876379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4f7bf-a045-4a32-b62d-b539260f57ea admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.876534 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5241b1-0b42-4e5f-9eb1-e8f8bf54309e admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:55.980891 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 819/1610] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:28:55 2022] PUT /identity/v3/projects/b683290ba0434b3c95c02e2744711f59/users/a6bff9a8679f450084c85c568753a387/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:55.988011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4f7bf-a045-4a32-b62d-b539260f57ea admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:55.988147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 792/1611] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:28:55 2022] PUT /identity/v3/projects/fbe5725453a9468eb6f934078b01a862/users/ddfe9bf33946474f8ea4019d2c9e86e0/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:55.988147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a852ecd-aeba-4def-ad0f-f42ceca60008 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:55.988147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a852ecd-aeba-4def-ad0f-f42ceca60008 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:55.988147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a852ecd-aeba-4def-ad0f-f42ceca60008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.004866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-3a852ecd-aeba-4def-ad0f-f42ceca60008 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:56.008544 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3a852ecd-aeba-4def-ad0f-f42ceca60008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:56.039326 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:56.048085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4f7bf-a045-4a32-b62d-b539260f57ea admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:56.066005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 793/1612] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:56.066986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a852ecd-aeba-4def-ad0f-f42ceca60008 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:56.080448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a852ecd-aeba-4def-ad0f-f42ceca60008 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:56.085783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb5fa3-4733-43c2-9300-ffda67419378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:56.086678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb5fa3-4733-43c2-9300-ffda67419378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.086972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb5fa3-4733-43c2-9300-ffda67419378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.087248 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb5fa3-4733-43c2-9300-ffda67419378 admin admin] PATH_INFO: `/v3/projects/0e863c4004e64e788cd32ff5cc836482/users/8a248a93038e426da3ed5ab25a65eb81/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.104014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb5fa3-4733-43c2-9300-ffda67419378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e863c4004e64e788cd32ff5cc836482, user_id=8a248a93038e426da3ed5ab25a65eb81, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:56.107514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb5fa3-4733-43c2-9300-ffda67419378 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:56.110835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0bd7f-b088-467e-bba4-e98326ef7c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:56.111795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0bd7f-b088-467e-bba4-e98326ef7c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.111795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0bd7f-b088-467e-bba4-e98326ef7c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.112047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0bd7f-b088-467e-bba4-e98326ef7c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.112891 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0bd7f-b088-467e-bba4-e98326ef7c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:56.114731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0bd7f-b088-467e-bba4-e98326ef7c3c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:56.124930 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 820/1613] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:56.125886 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0bd7f-b088-467e-bba4-e98326ef7c3c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:56.136123 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0bd7f-b088-467e-bba4-e98326ef7c3c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:56.140861 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670692fd-399f-46d8-a9bb-5751e5ba566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:56.141772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670692fd-399f-46d8-a9bb-5751e5ba566d admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.142059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670692fd-399f-46d8-a9bb-5751e5ba566d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.142526 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670692fd-399f-46d8-a9bb-5751e5ba566d admin admin] PATH_INFO: `/v3/projects/ef496aec46c24f51800a6ade4be97fc3/users/071dc15e85a849afa9b9663f7e5f428e/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.158898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670692fd-399f-46d8-a9bb-5751e5ba566d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef496aec46c24f51800a6ade4be97fc3, user_id=071dc15e85a849afa9b9663f7e5f428e, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:56.162236 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670692fd-399f-46d8-a9bb-5751e5ba566d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:56.173855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 794/1614] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:28:56 2022] PUT /identity/v3/projects/0e863c4004e64e788cd32ff5cc836482/users/8a248a93038e426da3ed5ab25a65eb81/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:56.175222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb5fa3-4733-43c2-9300-ffda67419378 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:56.235873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb5fa3-4733-43c2-9300-ffda67419378 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:56.242623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 821/1615] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:28:56 2022] PUT /identity/v3/projects/ef496aec46c24f51800a6ade4be97fc3/users/071dc15e85a849afa9b9663f7e5f428e/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:56.246222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670692fd-399f-46d8-a9bb-5751e5ba566d admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:56.290350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:56.299172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407bd47-9c82-4dcb-a48b-f7ba8988b6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:56.300554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670692fd-399f-46d8-a9bb-5751e5ba566d admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:56.300716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407bd47-9c82-4dcb-a48b-f7ba8988b6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.301001 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407bd47-9c82-4dcb-a48b-f7ba8988b6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.301362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407bd47-9c82-4dcb-a48b-f7ba8988b6f5 admin admin] PATH_INFO: `/v3/projects/6b02eddfc4444894af81c07ad8bd10a4/users/c12e441338544bf38df74a54af4a6127/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.303433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407bd47-9c82-4dcb-a48b-f7ba8988b6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b02eddfc4444894af81c07ad8bd10a4, user_id=c12e441338544bf38df74a54af4a6127, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:56.304709 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3b7a5-92bb-494f-95f9-45a24788143e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:56.305406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3b7a5-92bb-494f-95f9-45a24788143e service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.305696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3b7a5-92bb-494f-95f9-45a24788143e service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.305976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3b7a5-92bb-494f-95f9-45a24788143e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.306273 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407bd47-9c82-4dcb-a48b-f7ba8988b6f5 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:56.317504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 795/1616] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:28:56 2022] PUT /identity/v3/projects/6b02eddfc4444894af81c07ad8bd10a4/users/c12e441338544bf38df74a54af4a6127/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:56.318887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38437aa7-b97b-47f2-ab40-edc102e94866 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.319198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38437aa7-b97b-47f2-ab40-edc102e94866 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.319478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38437aa7-b97b-47f2-ab40-edc102e94866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.337941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-38437aa7-b97b-47f2-ab40-edc102e94866 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:56.339172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-38437aa7-b97b-47f2-ab40-edc102e94866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:56.371200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3b7a5-92bb-494f-95f9-45a24788143e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:56.372644 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3b7a5-92bb-494f-95f9-45a24788143e service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:56.382129 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 822/1617] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:28:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:28:56.384564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3b7a5-92bb-494f-95f9-45a24788143e service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:56.387278 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:56.396456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3b7a5-92bb-494f-95f9-45a24788143e service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:56.401973 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a3dfe-efb7-4c40-a9b7-0ef471871677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:56.402223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 796/1618] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:56.404687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3dfe-efb7-4c40-a9b7-0ef471871677 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.404899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38437aa7-b97b-47f2-ab40-edc102e94866 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:56.404998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3dfe-efb7-4c40-a9b7-0ef471871677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.404998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3dfe-efb7-4c40-a9b7-0ef471871677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.404998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a3dfe-efb7-4c40-a9b7-0ef471871677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:56.405266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-38437aa7-b97b-47f2-ab40-edc102e94866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:56.406132 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a3dfe-efb7-4c40-a9b7-0ef471871677 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:56.422784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 823/1619] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:28:56.422784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a3dfe-efb7-4c40-a9b7-0ef471871677 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:56.432710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a3dfe-efb7-4c40-a9b7-0ef471871677 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:56.443718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b56b6-52cf-4156-ada5-1ea03fdde1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:56.445863 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b56b6-52cf-4156-ada5-1ea03fdde1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.446329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b56b6-52cf-4156-ada5-1ea03fdde1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.447050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b56b6-52cf-4156-ada5-1ea03fdde1a0 admin admin] PATH_INFO: `/v3/projects/0bec0d73869348db900bc569664bb7b3/users/3e0ff52608ed4cd4b9b4dfadc97ce9f5/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.473373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b56b6-52cf-4156-ada5-1ea03fdde1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bec0d73869348db900bc569664bb7b3, user_id=3e0ff52608ed4cd4b9b4dfadc97ce9f5, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:56.475187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38437aa7-b97b-47f2-ab40-edc102e94866 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:56.476363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b56b6-52cf-4156-ada5-1ea03fdde1a0 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:56.480253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2bd9a-1657-417f-83f7-69445f6afca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:56.481069 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2bd9a-1657-417f-83f7-69445f6afca1 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.481502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2bd9a-1657-417f-83f7-69445f6afca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.481776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2bd9a-1657-417f-83f7-69445f6afca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.491782 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2bd9a-1657-417f-83f7-69445f6afca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:56.493352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2bd9a-1657-417f-83f7-69445f6afca1 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:56.503039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 797/1620] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:28:56.507582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a8efb-9541-433f-90b7-6048af5b4493 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.507582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a8efb-9541-433f-90b7-6048af5b4493 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.507582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a8efb-9541-433f-90b7-6048af5b4493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.525095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-4a3a8efb-9541-433f-90b7-6048af5b4493 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:56.527216 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-4a3a8efb-9541-433f-90b7-6048af5b4493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:56.536886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 798/1621] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:56.542311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184a745-a94a-4f2d-ad9e-7df6e2a43fb3 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.542311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184a745-a94a-4f2d-ad9e-7df6e2a43fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.542311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184a745-a94a-4f2d-ad9e-7df6e2a43fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.559497 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-7184a745-a94a-4f2d-ad9e-7df6e2a43fb3 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:56.560710 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7184a745-a94a-4f2d-ad9e-7df6e2a43fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:56.568880 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 824/1622] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:28:56 2022] PUT /identity/v3/projects/0bec0d73869348db900bc569664bb7b3/users/3e0ff52608ed4cd4b9b4dfadc97ce9f5/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:56.570426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca674bf6-f465-400e-9c15-3a8467611299 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.579231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca674bf6-f465-400e-9c15-3a8467611299 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.579231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca674bf6-f465-400e-9c15-3a8467611299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.602989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ca674bf6-f465-400e-9c15-3a8467611299 None None] MFA Rules not processed for user `c12e441338544bf38df74a54af4a6127`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:56.604625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ca674bf6-f465-400e-9c15-3a8467611299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:56.631458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 799/1623] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:56.631458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184a745-a94a-4f2d-ad9e-7df6e2a43fb3 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:56.699305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184a745-a94a-4f2d-ad9e-7df6e2a43fb3 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:56.700228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 825/1624] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:56.701153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca674bf6-f465-400e-9c15-3a8467611299 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:56.704645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991a409-740d-419b-ac6e-f80bfb7d9cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:56.705653 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991a409-740d-419b-ac6e-f80bfb7d9cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.710818 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991a409-740d-419b-ac6e-f80bfb7d9cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.710818 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991a409-740d-419b-ac6e-f80bfb7d9cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.712581 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca674bf6-f465-400e-9c15-3a8467611299 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:56.717295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645a9b0-f3db-4277-87b7-a5fb66e4f0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:56.718181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645a9b0-f3db-4277-87b7-a5fb66e4f0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.718326 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991a409-740d-419b-ac6e-f80bfb7d9cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:56.718462 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645a9b0-f3db-4277-87b7-a5fb66e4f0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.718735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645a9b0-f3db-4277-87b7-a5fb66e4f0ce admin admin] PATH_INFO: `/v3/projects/b683290ba0434b3c95c02e2744711f59/users/a6bff9a8679f450084c85c568753a387/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.719723 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991a409-740d-419b-ac6e-f80bfb7d9cf9 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:56.720686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645a9b0-f3db-4277-87b7-a5fb66e4f0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b683290ba0434b3c95c02e2744711f59, user_id=a6bff9a8679f450084c85c568753a387, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:56.724048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645a9b0-f3db-4277-87b7-a5fb66e4f0ce admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:56.730563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 800/1625] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:28:56.731371 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991a409-740d-419b-ac6e-f80bfb7d9cf9 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:56.736381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 826/1626] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:28:56 2022] PUT /identity/v3/projects/b683290ba0434b3c95c02e2744711f59/users/a6bff9a8679f450084c85c568753a387/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:56.739634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac47c-47a9-471d-90e5-d074800824f9 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.739634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac47c-47a9-471d-90e5-d074800824f9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.739634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac47c-47a9-471d-90e5-d074800824f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.749392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991a409-740d-419b-ac6e-f80bfb7d9cf9 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:56.758018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-cacac47c-47a9-471d-90e5-d074800824f9 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:56.759216 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-cacac47c-47a9-471d-90e5-d074800824f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:56.783991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:56.790492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:56.803944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad97ae-7506-462d-bdf4-c801b0436cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:56.804755 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad97ae-7506-462d-bdf4-c801b0436cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.805252 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad97ae-7506-462d-bdf4-c801b0436cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.805565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad97ae-7506-462d-bdf4-c801b0436cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.829306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 827/1627] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:56.832914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacac47c-47a9-471d-90e5-d074800824f9 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:56.842731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacac47c-47a9-471d-90e5-d074800824f9 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:56.847467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb69b29-f986-4eb6-8a54-129a3aa006e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:56.848131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb69b29-f986-4eb6-8a54-129a3aa006e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.848453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb69b29-f986-4eb6-8a54-129a3aa006e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.848738 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb69b29-f986-4eb6-8a54-129a3aa006e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.861977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb69b29-f986-4eb6-8a54-129a3aa006e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:56.863991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb69b29-f986-4eb6-8a54-129a3aa006e9 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:56.888942 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 828/1628] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:28:56.890219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb69b29-f986-4eb6-8a54-129a3aa006e9 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:56.901575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad97ae-7506-462d-bdf4-c801b0436cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:56.903081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad97ae-7506-462d-bdf4-c801b0436cf2 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:56.916117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 801/1629] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:28:56.919291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c90fd-0f44-4e45-9c60-a28741dd3ec7 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.919291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c90fd-0f44-4e45-9c60-a28741dd3ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.919528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c90fd-0f44-4e45-9c60-a28741dd3ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.951515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb69b29-f986-4eb6-8a54-129a3aa006e9 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:56.955571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce586890-7e35-4e22-817c-10a22bad31e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:56.956856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586890-7e35-4e22-817c-10a22bad31e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:56.957268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586890-7e35-4e22-817c-10a22bad31e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:56.957665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586890-7e35-4e22-817c-10a22bad31e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:56.968382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a48c90fd-0f44-4e45-9c60-a28741dd3ec7 None None] MFA Rules not processed for user `a6bff9a8679f450084c85c568753a387`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:56.969627 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a48c90fd-0f44-4e45-9c60-a28741dd3ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:57.028833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce586890-7e35-4e22-817c-10a22bad31e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:57.034689 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce586890-7e35-4e22-817c-10a22bad31e8 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:57.043190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 829/1630] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:28:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:28:57.044546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce586890-7e35-4e22-817c-10a22bad31e8 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:57.055467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce586890-7e35-4e22-817c-10a22bad31e8 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:57.059748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7446248-2c5a-479c-a039-ce63f710cfa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:57.063200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446248-2c5a-479c-a039-ce63f710cfa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:57.063200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446248-2c5a-479c-a039-ce63f710cfa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:57.063200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446248-2c5a-479c-a039-ce63f710cfa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:57.065418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 802/1631] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:57.081732 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7446248-2c5a-479c-a039-ce63f710cfa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:57.085306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7446248-2c5a-479c-a039-ce63f710cfa3 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:57.098180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 830/1632] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:28:57.134990 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c90fd-0f44-4e45-9c60-a28741dd3ec7 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:57.146704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c90fd-0f44-4e45-9c60-a28741dd3ec7 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:57.150806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb3b38-7d38-40c9-a500-398a0219addb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:57.151656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb3b38-7d38-40c9-a500-398a0219addb service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:57.151807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb3b38-7d38-40c9-a500-398a0219addb service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:57.152015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb3b38-7d38-40c9-a500-398a0219addb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:57.162575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb3b38-7d38-40c9-a500-398a0219addb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:57.163844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb3b38-7d38-40c9-a500-398a0219addb service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:57.174246 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 803/1633] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:28:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:28:57.591404 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7446248-2c5a-479c-a039-ce63f710cfa3 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:57.608186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7446248-2c5a-479c-a039-ce63f710cfa3 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:57.620008 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:57.620897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:57.621199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:57.621478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] PATH_INFO: `/v3/users/9dec2a352065481d839e085571e403e1` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:57.631189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dec2a352065481d839e085571e403e1)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:57.631189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:57.849451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dec2a352065481d839e085571e403e1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:28:57.963666 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dec2a352065481d839e085571e403e1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:28:57.964674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dec2a352065481d839e085571e403e1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:28:57.966210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:57.984476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dec2a352065481d839e085571e403e1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:28:57.998274 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dec2a352065481d839e085571e403e1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:28:58.007158 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 831/1634] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:28:57 2022] DELETE /identity/v3/users/9dec2a352065481d839e085571e403e1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:58.015087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5f0af-e031-4b3a-b2c8-d6d66219b657 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:58.015621 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5f0af-e031-4b3a-b2c8-d6d66219b657 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:58.015963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5f0af-e031-4b3a-b2c8-d6d66219b657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:58.046869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a9e5f0af-e031-4b3a-b2c8-d6d66219b657 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:58.049289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a9e5f0af-e031-4b3a-b2c8-d6d66219b657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:58.167130 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:58.183097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 804/1635] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:58.214908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:58.217992 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:58.354819 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2ef0c-fba0-487f-98f2-33e7b4ae7981 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:58.354819 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1e054-696e-4d28-994a-9aec84147cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:58.354819 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1e054-696e-4d28-994a-9aec84147cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:58.354819 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1e054-696e-4d28-994a-9aec84147cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:58.355160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1e054-696e-4d28-994a-9aec84147cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:58.375259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1e054-696e-4d28-994a-9aec84147cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:58.378751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1e054-696e-4d28-994a-9aec84147cc2 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:58.391116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 832/1636] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:28:58.439546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5f0af-e031-4b3a-b2c8-d6d66219b657 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:58.439546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a9e5f0af-e031-4b3a-b2c8-d6d66219b657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:58.448658 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5f0af-e031-4b3a-b2c8-d6d66219b657 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:58.460269 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3c733-8ad5-457d-8ee0-0341e78e58da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:58.461304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3c733-8ad5-457d-8ee0-0341e78e58da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:58.461583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3c733-8ad5-457d-8ee0-0341e78e58da admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:58.461852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3c733-8ad5-457d-8ee0-0341e78e58da admin admin] PATH_INFO: `/v3/users/84ee7a2c1656445590cfddb96225224a` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:58.463849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3c733-8ad5-457d-8ee0-0341e78e58da admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ee7a2c1656445590cfddb96225224a)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:58.465874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: WARNING py.warnings [None req-e4c3c733-8ad5-457d-8ee0-0341e78e58da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:28:58.465874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: warnings.warn(msg) Jul 12 16:28:58.465874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: Jul 12 16:28:58.467326 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3c733-8ad5-457d-8ee0-0341e78e58da admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:58.714058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e4c3c733-8ad5-457d-8ee0-0341e78e58da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ee7a2c1656445590cfddb96225224a'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:28:58.741701 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b0119-0540-4749-a860-d053deafbebe None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:58.741993 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b0119-0540-4749-a860-d053deafbebe None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:58.742266 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b0119-0540-4749-a860-d053deafbebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:58.781067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e4c3c733-8ad5-457d-8ee0-0341e78e58da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ee7a2c1656445590cfddb96225224a'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:28:58.788800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-058b0119-0540-4749-a860-d053deafbebe None None] MFA Rules not processed for user `890cc1a893c8454992c4f70245ed7af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:58.791217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-058b0119-0540-4749-a860-d053deafbebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:58.821377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e4c3c733-8ad5-457d-8ee0-0341e78e58da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ee7a2c1656445590cfddb96225224a'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:28:58.821377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e4c3c733-8ad5-457d-8ee0-0341e78e58da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ee7a2c1656445590cfddb96225224a'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:28:58.847433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e4c3c733-8ad5-457d-8ee0-0341e78e58da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ee7a2c1656445590cfddb96225224a'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:28:58.862998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 805/1637] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:28:58 2022] DELETE /identity/v3/users/84ee7a2c1656445590cfddb96225224a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:28:58.867771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb12023-5883-4f15-ba9c-dcdbde2c01fe None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:58.868000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb12023-5883-4f15-ba9c-dcdbde2c01fe None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:58.868422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb12023-5883-4f15-ba9c-dcdbde2c01fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:58.902161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-1bb12023-5883-4f15-ba9c-dcdbde2c01fe None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:58.903573 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1bb12023-5883-4f15-ba9c-dcdbde2c01fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:58.930214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 833/1638] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:58.933132 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1d6d7-09f6-474a-bf65-90d68fcac65e None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:58.935290 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1d6d7-09f6-474a-bf65-90d68fcac65e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:58.935810 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1d6d7-09f6-474a-bf65-90d68fcac65e None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:58.940666 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 834/1639] 10.222.0.26 () {54 vars in 961 bytes} [Tue Jul 12 16:28:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:28:58.942946 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1d6d7-09f6-474a-bf65-90d68fcac65e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:58.947612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-eeb1d6d7-09f6-474a-bf65-90d68fcac65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:59.021848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 806/1640] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:28:59.034464 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17f286-424c-4eef-9ab9-a40ffccf1033 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:59.034766 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17f286-424c-4eef-9ab9-a40ffccf1033 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:59.035391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17f286-424c-4eef-9ab9-a40ffccf1033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:59.102879 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-3b17f286-424c-4eef-9ab9-a40ffccf1033 None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:59.104317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3b17f286-424c-4eef-9ab9-a40ffccf1033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:59.109610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1d6d7-09f6-474a-bf65-90d68fcac65e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:59.115705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b9d15-1415-495d-b7a0-2af8dc735f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:59.121228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b9d15-1415-495d-b7a0-2af8dc735f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:59.121228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b9d15-1415-495d-b7a0-2af8dc735f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:59.121228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b9d15-1415-495d-b7a0-2af8dc735f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:59.121228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b9d15-1415-495d-b7a0-2af8dc735f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:59.121228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b9d15-1415-495d-b7a0-2af8dc735f22 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:59.133628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:59.178988 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:28:59.198026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 807/1641] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Jul 12 16:28:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:59.202683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17f286-424c-4eef-9ab9-a40ffccf1033 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:59.202683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3b17f286-424c-4eef-9ab9-a40ffccf1033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:59.229231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 835/1642] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:28:58 2022] POST /identity/v3/projects => generated 403 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:59.231513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9349-bcac-4903-a2a2-72280f49b000 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:59.232201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9349-bcac-4903-a2a2-72280f49b000 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:59.232820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9349-bcac-4903-a2a2-72280f49b000 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:59.236391 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 836/1643] 10.222.0.26 () {54 vars in 912 bytes} [Tue Jul 12 16:28:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:28:59.238787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9349-bcac-4903-a2a2-72280f49b000 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:59.283584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17f286-424c-4eef-9ab9-a40ffccf1033 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:59.333949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9349-bcac-4903-a2a2-72280f49b000 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:59.341465 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ce6d6-1291-44f3-8738-65c1937b54cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:59.342396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ce6d6-1291-44f3-8738-65c1937b54cc admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:59.343074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ce6d6-1291-44f3-8738-65c1937b54cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:59.343538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ce6d6-1291-44f3-8738-65c1937b54cc admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:59.344413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ce6d6-1291-44f3-8738-65c1937b54cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:59.344815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb0a44-653e-4224-8cf2-369d2c5a4f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:59.345562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb0a44-653e-4224-8cf2-369d2c5a4f5c service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:59.595828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb0a44-653e-4224-8cf2-369d2c5a4f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:59.595828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb0a44-653e-4224-8cf2-369d2c5a4f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:59.596453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ce6d6-1291-44f3-8738-65c1937b54cc admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:59.600324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb0a44-653e-4224-8cf2-369d2c5a4f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:59.600324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb0a44-653e-4224-8cf2-369d2c5a4f5c service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:59.600324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 808/1644] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:28:59.600324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1fd13-113a-4ecf-bc98-0c4ef99ec11b None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:59.600324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1fd13-113a-4ecf-bc98-0c4ef99ec11b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:59.600324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1fd13-113a-4ecf-bc98-0c4ef99ec11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:59.630273 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e0c1fd13-113a-4ecf-bc98-0c4ef99ec11b None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:28:59.630273 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e0c1fd13-113a-4ecf-bc98-0c4ef99ec11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:59.630860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 837/1645] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:28:59 2022] POST /identity/v3/users => generated 308 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:28:59.630860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ce6d6-1291-44f3-8738-65c1937b54cc admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:59.630860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ce6d6-1291-44f3-8738-65c1937b54cc admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:59.630860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c6dda-ce5c-4a61-81be-197d609146da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:59.631308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6dda-ce5c-4a61-81be-197d609146da admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:59.631308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6dda-ce5c-4a61-81be-197d609146da admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:59.631308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6dda-ce5c-4a61-81be-197d609146da admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:59.631308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c6dda-ce5c-4a61-81be-197d609146da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:59.631308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c6dda-ce5c-4a61-81be-197d609146da admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:59.631308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 838/1646] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:28:59.631896 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c6dda-ce5c-4a61-81be-197d609146da admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:59.632141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 809/1647] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:28:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:28:59.632203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c6dda-ce5c-4a61-81be-197d609146da admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:59.632263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1fd13-113a-4ecf-bc98-0c4ef99ec11b None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:59.632263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e0c1fd13-113a-4ecf-bc98-0c4ef99ec11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:59.632428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66366288-dc24-43f6-8044-927c70beb859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:59.632428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66366288-dc24-43f6-8044-927c70beb859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:59.632428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66366288-dc24-43f6-8044-927c70beb859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:59.632428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66366288-dc24-43f6-8044-927c70beb859 admin admin] PATH_INFO: `/v3/projects/e65f00d301694560987f3490dfe0cb31/users/2431b85a0f9949bb9fb321e28febea10/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:59.632685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66366288-dc24-43f6-8044-927c70beb859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65f00d301694560987f3490dfe0cb31, user_id=2431b85a0f9949bb9fb321e28febea10, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:59.632685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66366288-dc24-43f6-8044-927c70beb859 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:59.652986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1fd13-113a-4ecf-bc98-0c4ef99ec11b None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:59.657538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9fd57-37b1-4ffc-86a6-285d8b37a920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:59.658364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9fd57-37b1-4ffc-86a6-285d8b37a920 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:59.658765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9fd57-37b1-4ffc-86a6-285d8b37a920 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:59.659071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9fd57-37b1-4ffc-86a6-285d8b37a920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:59.670804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9fd57-37b1-4ffc-86a6-285d8b37a920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:59.672349 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9fd57-37b1-4ffc-86a6-285d8b37a920 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:59.684075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 810/1648] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:28:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:28:59.684740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9fd57-37b1-4ffc-86a6-285d8b37a920 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:59.686192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-54f9fd57-37b1-4ffc-86a6-285d8b37a920 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:28:59.699763 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9fd57-37b1-4ffc-86a6-285d8b37a920 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:28:59.708835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:28:59.710238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:28:59.721940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:28:59.722362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] PATH_INFO: `/v3/projects/a639bbb688d84c838315e95d0a8d70d2` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:28:59.728980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a639bbb688d84c838315e95d0a8d70d2)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:28:59.730946 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:28:59.779785 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 839/1649] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:28:59 2022] PUT /identity/v3/projects/e65f00d301694560987f3490dfe0cb31/users/2431b85a0f9949bb9fb321e28febea10/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:28:59.783593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66366288-dc24-43f6-8044-927c70beb859 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:28:59.888344 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a639bbb688d84c838315e95d0a8d70d2', 'request_id': 'req-02aee739-3889-4325-8df7-7fc69c0e4914'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:28:59.969917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66366288-dc24-43f6-8044-927c70beb859 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:00.007674 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a639bbb688d84c838315e95d0a8d70d2', 'request_id': 'req-02aee739-3889-4325-8df7-7fc69c0e4914'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:00.015149 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a639bbb688d84c838315e95d0a8d70d2', 'request_id': 'req-02aee739-3889-4325-8df7-7fc69c0e4914'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:00.040421 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] The token cache is being invalidate because project a639bbb688d84c838315e95d0a8d70d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:00.041137 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:00.042747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:00.044873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 811/1650] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:28:59 2022] DELETE /identity/v3/projects/a639bbb688d84c838315e95d0a8d70d2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:00.049243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:00.053723 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:00.125553 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a17020-d23e-4043-9707-a77069cc6733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:00.131528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a17020-d23e-4043-9707-a77069cc6733 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:00.131848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a17020-d23e-4043-9707-a77069cc6733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:00.135044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a17020-d23e-4043-9707-a77069cc6733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:00.135044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a17020-d23e-4043-9707-a77069cc6733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:00.136613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a17020-d23e-4043-9707-a77069cc6733 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:00.158993 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 840/1651] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:29:00.163720 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a17020-d23e-4043-9707-a77069cc6733 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:00.167187 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-35a17020-d23e-4043-9707-a77069cc6733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:00.202319 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a17020-d23e-4043-9707-a77069cc6733 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:00.207380 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aee739-3889-4325-8df7-7fc69c0e4914 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:00.214284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536864d-e9ba-4d75-aebe-9b58621bfd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:00.216435 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536864d-e9ba-4d75-aebe-9b58621bfd95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:00.217716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536864d-e9ba-4d75-aebe-9b58621bfd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:00.220588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536864d-e9ba-4d75-aebe-9b58621bfd95 admin admin] PATH_INFO: `/v3/projects/e65f00d301694560987f3490dfe0cb31/users/2431b85a0f9949bb9fb321e28febea10/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:00.222937 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:00.223872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:00.225918 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536864d-e9ba-4d75-aebe-9b58621bfd95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65f00d301694560987f3490dfe0cb31, user_id=2431b85a0f9949bb9fb321e28febea10, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:00.226299 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:00.226661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] PATH_INFO: `/v3/users/c12e441338544bf38df74a54af4a6127` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:00.233127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536864d-e9ba-4d75-aebe-9b58621bfd95 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:00.234072 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c12e441338544bf38df74a54af4a6127)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:00.236048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:00.249037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 841/1652] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:00 2022] PUT /identity/v3/projects/e65f00d301694560987f3490dfe0cb31/users/2431b85a0f9949bb9fb321e28febea10/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:00.514490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c12e441338544bf38df74a54af4a6127'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:00.598171 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536864d-e9ba-4d75-aebe-9b58621bfd95 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:00.602947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0536864d-e9ba-4d75-aebe-9b58621bfd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:00.624618 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c12e441338544bf38df74a54af4a6127'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:00.665403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c12e441338544bf38df74a54af4a6127'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:00.665403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c12e441338544bf38df74a54af4a6127'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:00.677574 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c12e441338544bf38df74a54af4a6127'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:00.694960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 812/1653] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:00 2022] DELETE /identity/v3/users/c12e441338544bf38df74a54af4a6127 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:00.746916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536864d-e9ba-4d75-aebe-9b58621bfd95 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:00.888067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:00.900667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:00.902582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:00.903089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:00.903912 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8 admin admin] PATH_INFO: `/v3/projects/8dd59cd3e1fd4a95912d1e59bcc66170` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:00.911024 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd59cd3e1fd4a95912d1e59bcc66170)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:00.913411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: WARNING py.warnings [None req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 16:29:00.913411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: warnings.warn(msg) Jul 12 16:29:00.913411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: Jul 12 16:29:00.919508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:01.278587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd59cd3e1fd4a95912d1e59bcc66170', 'request_id': 'req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:01.373579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd59cd3e1fd4a95912d1e59bcc66170', 'request_id': 'req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:01.386502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd59cd3e1fd4a95912d1e59bcc66170', 'request_id': 'req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:01.419685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8 admin admin] The token cache is being invalidate because project 8dd59cd3e1fd4a95912d1e59bcc66170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:01.420220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:01.421410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b01d6b81-09ef-4baa-9d5a-4c29e4b4f4d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:01.423625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 842/1654] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:00 2022] DELETE /identity/v3/projects/8dd59cd3e1fd4a95912d1e59bcc66170 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:29:01.428057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:01.434710 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:01.463366 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b42a39-fdef-4d80-acc8-914f8adc4b5a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:01.531848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751ea1b-860d-4aca-9df6-8f69f4eddfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:01.533081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751ea1b-860d-4aca-9df6-8f69f4eddfad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:01.534793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751ea1b-860d-4aca-9df6-8f69f4eddfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:01.535442 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751ea1b-860d-4aca-9df6-8f69f4eddfad admin admin] PATH_INFO: `/v3/users/a6bff9a8679f450084c85c568753a387` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:01.541249 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751ea1b-860d-4aca-9df6-8f69f4eddfad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6bff9a8679f450084c85c568753a387)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:01.544650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751ea1b-860d-4aca-9df6-8f69f4eddfad admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:01.816490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-4751ea1b-860d-4aca-9df6-8f69f4eddfad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6bff9a8679f450084c85c568753a387'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:01.935000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-4751ea1b-860d-4aca-9df6-8f69f4eddfad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6bff9a8679f450084c85c568753a387'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:01.941649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:01.957060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-4751ea1b-860d-4aca-9df6-8f69f4eddfad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6bff9a8679f450084c85c568753a387'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:01.963368 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-4751ea1b-860d-4aca-9df6-8f69f4eddfad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6bff9a8679f450084c85c568753a387'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:01.978348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-4751ea1b-860d-4aca-9df6-8f69f4eddfad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6bff9a8679f450084c85c568753a387'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:01.992634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 813/1655] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:01 2022] DELETE /identity/v3/users/a6bff9a8679f450084c85c568753a387 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:29:02.352858 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0b7c2-efd5-45c5-bc03-45351da17074 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:02.353916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0b7c2-efd5-45c5-bc03-45351da17074 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:02.354400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0b7c2-efd5-45c5-bc03-45351da17074 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:02.356207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 843/1656] 10.222.0.26 () {54 vars in 961 bytes} [Tue Jul 12 16:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:29:02.366800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f651c-d7bb-4edf-a405-fdc8f9ab7fcb None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:02.367105 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f651c-d7bb-4edf-a405-fdc8f9ab7fcb None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:02.367414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f651c-d7bb-4edf-a405-fdc8f9ab7fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:02.400501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-8d1f651c-d7bb-4edf-a405-fdc8f9ab7fcb None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:02.424944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8d1f651c-d7bb-4edf-a405-fdc8f9ab7fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:02.669964 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 814/1657] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Jul 12 16:29:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:02.672804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e95fa-95b7-49e0-ac57-e72c963cf94b None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:02.674984 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e95fa-95b7-49e0-ac57-e72c963cf94b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:02.675434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e95fa-95b7-49e0-ac57-e72c963cf94b None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:02.676919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 844/1658] 10.222.0.26 () {54 vars in 912 bytes} [Tue Jul 12 16:29:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:29:02.682628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d70fa-e7fd-40de-8102-121f48ebdda8 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:02.689668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d70fa-e7fd-40de-8102-121f48ebdda8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:02.689668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d70fa-e7fd-40de-8102-121f48ebdda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:02.717867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-0f8d70fa-e7fd-40de-8102-121f48ebdda8 None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:02.725728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0f8d70fa-e7fd-40de-8102-121f48ebdda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:02.773208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 815/1659] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:29:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:02.795956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e95fa-95b7-49e0-ac57-e72c963cf94b None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:02.797709 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-557e95fa-95b7-49e0-ac57-e72c963cf94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:02.826595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d70fa-e7fd-40de-8102-121f48ebdda8 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:02.841286 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0f8d70fa-e7fd-40de-8102-121f48ebdda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:02.947607 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e95fa-95b7-49e0-ac57-e72c963cf94b None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:02.959003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9409f-00b2-43a2-8235-b2f644f925cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:02.959602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9409f-00b2-43a2-8235-b2f644f925cd service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:02.959889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9409f-00b2-43a2-8235-b2f644f925cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:02.960186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9409f-00b2-43a2-8235-b2f644f925cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:02.986164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d70fa-e7fd-40de-8102-121f48ebdda8 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:02.997161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:02.997831 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9409f-00b2-43a2-8235-b2f644f925cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:02.998345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:02.998700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:02.999175 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] PATH_INFO: `/v3/projects/6b02eddfc4444894af81c07ad8bd10a4` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:02.999358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9409f-00b2-43a2-8235-b2f644f925cd service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:03.001031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b02eddfc4444894af81c07ad8bd10a4)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:03.009148 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:03.042705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:03.059894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 845/1660] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:03.099826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:03.180296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b02eddfc4444894af81c07ad8bd10a4', 'request_id': 'req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:03.283852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b02eddfc4444894af81c07ad8bd10a4', 'request_id': 'req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:03.291998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b02eddfc4444894af81c07ad8bd10a4', 'request_id': 'req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:03.321176 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] The token cache is being invalidate because project 6b02eddfc4444894af81c07ad8bd10a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:03.324697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:03.324697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:03.327835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 816/1661] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:02 2022] DELETE /identity/v3/projects/6b02eddfc4444894af81c07ad8bd10a4 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:03.333795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9994f-e564-408e-95ce-d8008d2ab96d None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:03.334599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9994f-e564-408e-95ce-d8008d2ab96d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:03.335028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9994f-e564-408e-95ce-d8008d2ab96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:03.380894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-b2f9994f-e564-408e-95ce-d8008d2ab96d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:03.383208 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b2f9994f-e564-408e-95ce-d8008d2ab96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:03.491297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:03.494210 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:03.560943 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 846/1662] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:03.569555 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7124c-57fb-4fbf-a110-5a90fc70a635 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:03.576195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7124c-57fb-4fbf-a110-5a90fc70a635 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:03.576195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7124c-57fb-4fbf-a110-5a90fc70a635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:03.611032 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-c8e7124c-57fb-4fbf-a110-5a90fc70a635 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:03.612967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c8e7124c-57fb-4fbf-a110-5a90fc70a635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:03.618812 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa6c31-8105-43a2-985b-8f56fa4c70d3 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:03.626807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e86be-bc60-4e2c-b296-005b22f769c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:03.628413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e86be-bc60-4e2c-b296-005b22f769c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:03.628761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e86be-bc60-4e2c-b296-005b22f769c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:03.629039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e86be-bc60-4e2c-b296-005b22f769c1 admin admin] PATH_INFO: `/v3/projects/b683290ba0434b3c95c02e2744711f59` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:03.633705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e86be-bc60-4e2c-b296-005b22f769c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b683290ba0434b3c95c02e2744711f59)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:03.634437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e86be-bc60-4e2c-b296-005b22f769c1 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:03.644478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 847/1663] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:03.648484 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7124c-57fb-4fbf-a110-5a90fc70a635 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:03.666282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7124c-57fb-4fbf-a110-5a90fc70a635 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:03.678552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12a11a-d774-4a3c-80e2-4369d5542d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:03.679379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12a11a-d774-4a3c-80e2-4369d5542d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:03.679554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12a11a-d774-4a3c-80e2-4369d5542d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:03.679832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12a11a-d774-4a3c-80e2-4369d5542d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:03.680661 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12a11a-d774-4a3c-80e2-4369d5542d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:29:03.681469 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12a11a-d774-4a3c-80e2-4369d5542d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:03.682804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12a11a-d774-4a3c-80e2-4369d5542d1e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:03.726462 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 848/1664] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:29:03.726462 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12a11a-d774-4a3c-80e2-4369d5542d1e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:03.746986 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12a11a-d774-4a3c-80e2-4369d5542d1e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:03.755757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e8f9c-aa88-4456-bbda-0209f7a4eef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:03.756444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e8f9c-aa88-4456-bbda-0209f7a4eef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:03.757002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e8f9c-aa88-4456-bbda-0209f7a4eef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:03.757002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e8f9c-aa88-4456-bbda-0209f7a4eef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:03.757715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e8f9c-aa88-4456-bbda-0209f7a4eef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:03.759630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e8f9c-aa88-4456-bbda-0209f7a4eef5 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:03.806525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-275e86be-bc60-4e2c-b296-005b22f769c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b683290ba0434b3c95c02e2744711f59', 'request_id': 'req-275e86be-bc60-4e2c-b296-005b22f769c1'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:03.883958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-275e86be-bc60-4e2c-b296-005b22f769c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b683290ba0434b3c95c02e2744711f59', 'request_id': 'req-275e86be-bc60-4e2c-b296-005b22f769c1'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:03.893862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 849/1665] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:03 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:03.898063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e8f9c-aa88-4456-bbda-0209f7a4eef5 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:03.902918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-275e86be-bc60-4e2c-b296-005b22f769c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b683290ba0434b3c95c02e2744711f59', 'request_id': 'req-275e86be-bc60-4e2c-b296-005b22f769c1'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:03.942695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-275e86be-bc60-4e2c-b296-005b22f769c1 admin admin] The token cache is being invalidate because project b683290ba0434b3c95c02e2744711f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:03.943899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-275e86be-bc60-4e2c-b296-005b22f769c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:03.946334 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-275e86be-bc60-4e2c-b296-005b22f769c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:03.954194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 817/1666] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:03 2022] DELETE /identity/v3/projects/b683290ba0434b3c95c02e2744711f59 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:03.959350 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250be906-3cad-4e8f-8932-6b1de0c6f927 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:03.959647 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250be906-3cad-4e8f-8932-6b1de0c6f927 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:03.959930 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250be906-3cad-4e8f-8932-6b1de0c6f927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:04.031863 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-250be906-3cad-4e8f-8932-6b1de0c6f927 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:04.033102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-250be906-3cad-4e8f-8932-6b1de0c6f927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:04.077101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e8f9c-aa88-4456-bbda-0209f7a4eef5 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:04.111318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec94b4d-6e10-47f1-a27a-7588271501ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:04.114501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec94b4d-6e10-47f1-a27a-7588271501ca admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:04.114958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec94b4d-6e10-47f1-a27a-7588271501ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:04.115436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec94b4d-6e10-47f1-a27a-7588271501ca admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:04.116353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec94b4d-6e10-47f1-a27a-7588271501ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:04.122186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec94b4d-6e10-47f1-a27a-7588271501ca admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:04.221708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 818/1667] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:04.233879 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72246056-7b62-4478-87eb-e7011a3e0183 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:04.234173 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72246056-7b62-4478-87eb-e7011a3e0183 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:04.239424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72246056-7b62-4478-87eb-e7011a3e0183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:04.257841 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 850/1668] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:03 2022] POST /identity/v3/users => generated 285 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:29:04.265523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec94b4d-6e10-47f1-a27a-7588271501ca admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:04.268836 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3ec94b4d-6e10-47f1-a27a-7588271501ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:04.299215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec94b4d-6e10-47f1-a27a-7588271501ca admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:04.303661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-72246056-7b62-4478-87eb-e7011a3e0183 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:04.304978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-72246056-7b62-4478-87eb-e7011a3e0183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:04.335511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d25d5-893a-4293-85f9-7a7b12acf21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:04.345828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 819/1669] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:04.346000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d25d5-893a-4293-85f9-7a7b12acf21e admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:04.346812 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d25d5-893a-4293-85f9-7a7b12acf21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:04.347098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d25d5-893a-4293-85f9-7a7b12acf21e admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:04.347893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d25d5-893a-4293-85f9-7a7b12acf21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:04.357426 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72246056-7b62-4478-87eb-e7011a3e0183 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:04.358934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d25d5-893a-4293-85f9-7a7b12acf21e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:04.385436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 851/1670] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:04.386060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72246056-7b62-4478-87eb-e7011a3e0183 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:04.388873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d25d5-893a-4293-85f9-7a7b12acf21e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:04.408005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47a7b5-c360-4087-a304-cc03f3aeed38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:04.408607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47a7b5-c360-4087-a304-cc03f3aeed38 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:04.409488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47a7b5-c360-4087-a304-cc03f3aeed38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:04.409769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47a7b5-c360-4087-a304-cc03f3aeed38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:04.410513 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47a7b5-c360-4087-a304-cc03f3aeed38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:29:04.410821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47a7b5-c360-4087-a304-cc03f3aeed38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:04.415131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d25d5-893a-4293-85f9-7a7b12acf21e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:04.422270 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47a7b5-c360-4087-a304-cc03f3aeed38 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:04.430923 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d681fe9-250b-4523-8905-7d5114308204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:04.435371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d681fe9-250b-4523-8905-7d5114308204 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:04.435371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d681fe9-250b-4523-8905-7d5114308204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:04.435371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d681fe9-250b-4523-8905-7d5114308204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:04.436498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d681fe9-250b-4523-8905-7d5114308204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:04.439800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d681fe9-250b-4523-8905-7d5114308204 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:04.473501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 852/1671] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:04.476365 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d681fe9-250b-4523-8905-7d5114308204 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:04.476510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 820/1672] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:29:04.477860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47a7b5-c360-4087-a304-cc03f3aeed38 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:04.492497 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47a7b5-c360-4087-a304-cc03f3aeed38 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:04.497882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d681fe9-250b-4523-8905-7d5114308204 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:04.514673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe73ff9-24b6-4d9e-8a35-5a56066cc276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:04.515276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe73ff9-24b6-4d9e-8a35-5a56066cc276 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:04.515573 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe73ff9-24b6-4d9e-8a35-5a56066cc276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:04.515859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe73ff9-24b6-4d9e-8a35-5a56066cc276 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:04.516634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe73ff9-24b6-4d9e-8a35-5a56066cc276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:04.522602 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe73ff9-24b6-4d9e-8a35-5a56066cc276 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:04.523504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e8c99-b94a-498f-bd1c-63e23028f4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:04.524415 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e8c99-b94a-498f-bd1c-63e23028f4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:04.525030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e8c99-b94a-498f-bd1c-63e23028f4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:04.525354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e8c99-b94a-498f-bd1c-63e23028f4fe admin admin] PATH_INFO: `/v3/projects/c0054e32fab740a7830116d3c45b7d8a/users/6095f4d0145148ad8d23403c80b276a0/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:04.549083 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e8c99-b94a-498f-bd1c-63e23028f4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0054e32fab740a7830116d3c45b7d8a, user_id=6095f4d0145148ad8d23403c80b276a0, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:04.552242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e8c99-b94a-498f-bd1c-63e23028f4fe admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:04.680999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 821/1674] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:04 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:04.693390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a099-3c7a-4fea-b24e-e3ddb11b9f5e None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:04.693684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a099-3c7a-4fea-b24e-e3ddb11b9f5e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:04.694133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a099-3c7a-4fea-b24e-e3ddb11b9f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:04.695241 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 853/1674] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:04 2022] PUT /identity/v3/projects/c0054e32fab740a7830116d3c45b7d8a/users/6095f4d0145148ad8d23403c80b276a0/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:04.696360 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e8c99-b94a-498f-bd1c-63e23028f4fe admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:04.753027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-68d4a099-3c7a-4fea-b24e-e3ddb11b9f5e None None] MFA Rules not processed for user `6095f4d0145148ad8d23403c80b276a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:04.753227 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-68d4a099-3c7a-4fea-b24e-e3ddb11b9f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:04.828190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e8c99-b94a-498f-bd1c-63e23028f4fe admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:04.872644 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 822/1675] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:04.887379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4a099-3c7a-4fea-b24e-e3ddb11b9f5e None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:04.902531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258fe25-b55f-4238-b4bd-9cd85df7dd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:04.903239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258fe25-b55f-4238-b4bd-9cd85df7dd58 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:04.903522 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258fe25-b55f-4238-b4bd-9cd85df7dd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:04.903794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258fe25-b55f-4238-b4bd-9cd85df7dd58 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:04.904510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258fe25-b55f-4238-b4bd-9cd85df7dd58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:04.907711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258fe25-b55f-4238-b4bd-9cd85df7dd58 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:04.996835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 854/1676] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:04 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:05.000671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258fe25-b55f-4238-b4bd-9cd85df7dd58 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:05.035369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258fe25-b55f-4238-b4bd-9cd85df7dd58 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:05.036084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4a099-3c7a-4fea-b24e-e3ddb11b9f5e None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:05.047475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22687e-c59c-4138-93c5-b0291a385eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:05.051054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22687e-c59c-4138-93c5-b0291a385eee admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:05.051500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22687e-c59c-4138-93c5-b0291a385eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:05.051925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22687e-c59c-4138-93c5-b0291a385eee admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:05.054281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22687e-c59c-4138-93c5-b0291a385eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:05.059582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f976-013e-414a-8d35-612154113dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:05.062390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f976-013e-414a-8d35-612154113dee admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:05.063995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f976-013e-414a-8d35-612154113dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:05.064379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22687e-c59c-4138-93c5-b0291a385eee admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:05.064675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f976-013e-414a-8d35-612154113dee admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:05.067403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5f976-013e-414a-8d35-612154113dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:05.078830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5f976-013e-414a-8d35-612154113dee admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:05.105588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 855/1677] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:05.106522 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22687e-c59c-4138-93c5-b0291a385eee admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:05.134477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22687e-c59c-4138-93c5-b0291a385eee admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:05.141532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b648fde-b7c5-40d0-860a-cc2e6847598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:05.143092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b648fde-b7c5-40d0-860a-cc2e6847598f admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:05.143385 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b648fde-b7c5-40d0-860a-cc2e6847598f admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:05.144524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b648fde-b7c5-40d0-860a-cc2e6847598f admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:05.145996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b648fde-b7c5-40d0-860a-cc2e6847598f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:05.147734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b648fde-b7c5-40d0-860a-cc2e6847598f admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:05.165630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 856/1678] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:05.170804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b648fde-b7c5-40d0-860a-cc2e6847598f admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:05.192690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b648fde-b7c5-40d0-860a-cc2e6847598f admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:05.200333 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884556b-774b-4fb7-9192-0ef41bd797ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:05.201325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884556b-774b-4fb7-9192-0ef41bd797ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:05.201654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884556b-774b-4fb7-9192-0ef41bd797ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:05.201932 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884556b-774b-4fb7-9192-0ef41bd797ef admin admin] PATH_INFO: `/v3/projects/748dc77e57314a35857eeac8cd29210b/users/e080b25e25de45559babadc8c5bf4f18/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:05.238076 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 823/1679] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:04 2022] POST /identity/v3/projects => generated 367 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:05.239451 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f976-013e-414a-8d35-612154113dee admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:05.243073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884556b-774b-4fb7-9192-0ef41bd797ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=748dc77e57314a35857eeac8cd29210b, user_id=e080b25e25de45559babadc8c5bf4f18, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:05.254269 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884556b-774b-4fb7-9192-0ef41bd797ef admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:05.404211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 857/1680] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:05 2022] PUT /identity/v3/projects/748dc77e57314a35857eeac8cd29210b/users/e080b25e25de45559babadc8c5bf4f18/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:05.406834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f976-013e-414a-8d35-612154113dee admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:05.416680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b73a55-e9bf-41df-96f5-a621df4c7936 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:05.416983 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b73a55-e9bf-41df-96f5-a621df4c7936 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:05.417588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b73a55-e9bf-41df-96f5-a621df4c7936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:05.452251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:05.501296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-36b73a55-e9bf-41df-96f5-a621df4c7936 None None] MFA Rules not processed for user `e080b25e25de45559babadc8c5bf4f18`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:05.504716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-36b73a55-e9bf-41df-96f5-a621df4c7936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:05.533013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeaa7f-616e-4eb5-abb5-23aae55a5f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:05.535673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeaa7f-616e-4eb5-abb5-23aae55a5f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:05.535673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeaa7f-616e-4eb5-abb5-23aae55a5f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:05.535925 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeaa7f-616e-4eb5-abb5-23aae55a5f19 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:05.541295 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeeaa7f-616e-4eb5-abb5-23aae55a5f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:05.543587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeeaa7f-616e-4eb5-abb5-23aae55a5f19 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:05.604448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:05.676357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 824/1681] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:05 2022] POST /identity/v3/users => generated 290 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:29:05.677850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeaa7f-616e-4eb5-abb5-23aae55a5f19 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:05.681492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 858/1682] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:05.686100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b73a55-e9bf-41df-96f5-a621df4c7936 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:05.718177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeaa7f-616e-4eb5-abb5-23aae55a5f19 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:05.729317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b73a55-e9bf-41df-96f5-a621df4c7936 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:05.730748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547472b9-563c-4a2a-bdb4-b3a3b17a7201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:05.731204 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547472b9-563c-4a2a-bdb4-b3a3b17a7201 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:05.733531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547472b9-563c-4a2a-bdb4-b3a3b17a7201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:05.733824 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547472b9-563c-4a2a-bdb4-b3a3b17a7201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:05.735754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547472b9-563c-4a2a-bdb4-b3a3b17a7201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:05.741294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a67ede-3b13-422a-85ef-42ed90398114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:05.742639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a67ede-3b13-422a-85ef-42ed90398114 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:05.742639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a67ede-3b13-422a-85ef-42ed90398114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:05.742639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a67ede-3b13-422a-85ef-42ed90398114 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:05.743271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a67ede-3b13-422a-85ef-42ed90398114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:05.747799 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a67ede-3b13-422a-85ef-42ed90398114 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:05.753835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547472b9-563c-4a2a-bdb4-b3a3b17a7201 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:05.794400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 825/1683] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:05.795586 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547472b9-563c-4a2a-bdb4-b3a3b17a7201 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:05.817807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547472b9-563c-4a2a-bdb4-b3a3b17a7201 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:05.831747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10dceb6-ff8e-4167-98f9-76cd29404689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:05.832721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dceb6-ff8e-4167-98f9-76cd29404689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:05.833007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dceb6-ff8e-4167-98f9-76cd29404689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:05.833370 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dceb6-ff8e-4167-98f9-76cd29404689 admin admin] PATH_INFO: `/v3/projects/13b87c08fa3d42c8af6c9ac85699baa3/users/3d33dc16e6f34ff6858a5de640348824/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:05.882454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 859/1684] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:05 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:05.885974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10dceb6-ff8e-4167-98f9-76cd29404689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b87c08fa3d42c8af6c9ac85699baa3, user_id=3d33dc16e6f34ff6858a5de640348824, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:05.887705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a67ede-3b13-422a-85ef-42ed90398114 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:05.889132 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10dceb6-ff8e-4167-98f9-76cd29404689 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:05.984767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a67ede-3b13-422a-85ef-42ed90398114 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:05.989778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392003-b8d6-4e2f-98ee-8fb736bf598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:05.990462 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392003-b8d6-4e2f-98ee-8fb736bf598a admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:05.990743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392003-b8d6-4e2f-98ee-8fb736bf598a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:05.991018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392003-b8d6-4e2f-98ee-8fb736bf598a admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:05.991782 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9392003-b8d6-4e2f-98ee-8fb736bf598a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:05.994493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9392003-b8d6-4e2f-98ee-8fb736bf598a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:06.020143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 826/1685] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:05 2022] PUT /identity/v3/projects/13b87c08fa3d42c8af6c9ac85699baa3/users/3d33dc16e6f34ff6858a5de640348824/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:06.021938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013f1c-dc55-4f0d-b9a5-8eaab9a2de6a None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:06.022407 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013f1c-dc55-4f0d-b9a5-8eaab9a2de6a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:06.022827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013f1c-dc55-4f0d-b9a5-8eaab9a2de6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:06.104157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-87013f1c-dc55-4f0d-b9a5-8eaab9a2de6a None None] MFA Rules not processed for user `2431b85a0f9949bb9fb321e28febea10`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:06.106608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-87013f1c-dc55-4f0d-b9a5-8eaab9a2de6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:06.137420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 860/1686] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:05 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:06.137420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392003-b8d6-4e2f-98ee-8fb736bf598a admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:06.168770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392003-b8d6-4e2f-98ee-8fb736bf598a admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:06.292620 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee1662-3f76-44af-91cb-c8ad75bddd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:06.294267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee1662-3f76-44af-91cb-c8ad75bddd9c admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:06.297579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee1662-3f76-44af-91cb-c8ad75bddd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:06.297806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee1662-3f76-44af-91cb-c8ad75bddd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:06.298505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 827/1687] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:06 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:06.299568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87013f1c-dc55-4f0d-b9a5-8eaab9a2de6a None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:06.303781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee1662-3f76-44af-91cb-c8ad75bddd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:06.309706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:06.310943 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee1662-3f76-44af-91cb-c8ad75bddd9c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:06.326550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87013f1c-dc55-4f0d-b9a5-8eaab9a2de6a None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:06.336010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 861/1688] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:06.340246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee1662-3f76-44af-91cb-c8ad75bddd9c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:06.340831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71c80d-980e-4d1e-ad26-7b226311b565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:06.348146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71c80d-980e-4d1e-ad26-7b226311b565 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:06.348146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71c80d-980e-4d1e-ad26-7b226311b565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:06.348146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71c80d-980e-4d1e-ad26-7b226311b565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:06.348146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71c80d-980e-4d1e-ad26-7b226311b565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:06.355297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71c80d-980e-4d1e-ad26-7b226311b565 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:06.371072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee1662-3f76-44af-91cb-c8ad75bddd9c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:06.385916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 828/1689] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:06.389729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71c80d-980e-4d1e-ad26-7b226311b565 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:06.390801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a125e-2a59-4056-ac15-d6572c71fd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:06.391066 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a125e-2a59-4056-ac15-d6572c71fd85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:06.391398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a125e-2a59-4056-ac15-d6572c71fd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:06.391674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a125e-2a59-4056-ac15-d6572c71fd85 admin admin] PATH_INFO: `/v3/projects/13b87c08fa3d42c8af6c9ac85699baa3/users/3d33dc16e6f34ff6858a5de640348824/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:06.395731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a125e-2a59-4056-ac15-d6572c71fd85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b87c08fa3d42c8af6c9ac85699baa3, user_id=3d33dc16e6f34ff6858a5de640348824, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:06.399673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a125e-2a59-4056-ac15-d6572c71fd85 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:06.402544 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71c80d-980e-4d1e-ad26-7b226311b565 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:06.408363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910b379-7f80-4c03-bf7a-efab70fb6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:06.410236 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910b379-7f80-4c03-bf7a-efab70fb6745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:06.410634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910b379-7f80-4c03-bf7a-efab70fb6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:06.410980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910b379-7f80-4c03-bf7a-efab70fb6745 admin admin] PATH_INFO: `/v3/projects/73a49af43e364ab29d6eb715fccf85cb/users/c0b021bd70dd4f08bbe003affb516300/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:06.441697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910b379-7f80-4c03-bf7a-efab70fb6745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a49af43e364ab29d6eb715fccf85cb, user_id=c0b021bd70dd4f08bbe003affb516300, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:06.444380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 862/1690] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:06 2022] PUT /identity/v3/projects/13b87c08fa3d42c8af6c9ac85699baa3/users/3d33dc16e6f34ff6858a5de640348824/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:06.444910 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910b379-7f80-4c03-bf7a-efab70fb6745 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:06.461173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374903f2-5e60-4db2-9d40-72a13bb1a766 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:06.461173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374903f2-5e60-4db2-9d40-72a13bb1a766 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:06.461173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374903f2-5e60-4db2-9d40-72a13bb1a766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:06.524925 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 829/1691] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:06 2022] PUT /identity/v3/projects/73a49af43e364ab29d6eb715fccf85cb/users/c0b021bd70dd4f08bbe003affb516300/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:29:06.528776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910b379-7f80-4c03-bf7a-efab70fb6745 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:06.531477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-374903f2-5e60-4db2-9d40-72a13bb1a766 None None] MFA Rules not processed for user `3d33dc16e6f34ff6858a5de640348824`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:06.534502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-374903f2-5e60-4db2-9d40-72a13bb1a766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:06.690993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910b379-7f80-4c03-bf7a-efab70fb6745 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:06.707651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f662fee-887d-4c58-abbd-1aa89824417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:06.708488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f662fee-887d-4c58-abbd-1aa89824417a admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:06.708781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f662fee-887d-4c58-abbd-1aa89824417a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:06.709055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f662fee-887d-4c58-abbd-1aa89824417a admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:06.709814 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f662fee-887d-4c58-abbd-1aa89824417a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:06.711494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f662fee-887d-4c58-abbd-1aa89824417a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:06.716690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 863/1692] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:06.727811 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374903f2-5e60-4db2-9d40-72a13bb1a766 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:06.729413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-374903f2-5e60-4db2-9d40-72a13bb1a766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:06.735679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 830/1693] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:29:06.740572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f662fee-887d-4c58-abbd-1aa89824417a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:06.763720 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f662fee-887d-4c58-abbd-1aa89824417a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:06.772472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e56a5-aa34-4541-a330-fa0be5af540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:06.773666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e56a5-aa34-4541-a330-fa0be5af540f admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:06.773891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e56a5-aa34-4541-a330-fa0be5af540f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:06.774122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e56a5-aa34-4541-a330-fa0be5af540f admin admin] PATH_INFO: `/v3/projects/73a49af43e364ab29d6eb715fccf85cb/users/c0b021bd70dd4f08bbe003affb516300/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:06.776142 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e56a5-aa34-4541-a330-fa0be5af540f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a49af43e364ab29d6eb715fccf85cb, user_id=c0b021bd70dd4f08bbe003affb516300, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:06.778832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e56a5-aa34-4541-a330-fa0be5af540f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:06.783275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:06.805445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 831/1694] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:06 2022] PUT /identity/v3/projects/73a49af43e364ab29d6eb715fccf85cb/users/c0b021bd70dd4f08bbe003affb516300/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:29:06.816208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e780fa6-6e84-44f8-bf7e-244f5a3730e5 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:06.816500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e780fa6-6e84-44f8-bf7e-244f5a3730e5 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:06.816739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e780fa6-6e84-44f8-bf7e-244f5a3730e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:06.879580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-3e780fa6-6e84-44f8-bf7e-244f5a3730e5 None None] MFA Rules not processed for user `c0b021bd70dd4f08bbe003affb516300`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:06.880889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3e780fa6-6e84-44f8-bf7e-244f5a3730e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:06.910352 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374903f2-5e60-4db2-9d40-72a13bb1a766 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:07.019603 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:07.035730 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 832/1695] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:07.090758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b6a42-63fc-4103-87c7-e37aab68bf25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:07.091535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b6a42-63fc-4103-87c7-e37aab68bf25 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:07.091826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b6a42-63fc-4103-87c7-e37aab68bf25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:07.092113 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b6a42-63fc-4103-87c7-e37aab68bf25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:07.169906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e780fa6-6e84-44f8-bf7e-244f5a3730e5 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:07.171602 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3e780fa6-6e84-44f8-bf7e-244f5a3730e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:07.195016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e780fa6-6e84-44f8-bf7e-244f5a3730e5 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:07.209974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881baf84-191d-4fea-ac39-7ee0f1a953e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:07.210653 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881baf84-191d-4fea-ac39-7ee0f1a953e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:07.210944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881baf84-191d-4fea-ac39-7ee0f1a953e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:07.211221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881baf84-191d-4fea-ac39-7ee0f1a953e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:07.268679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b6a42-63fc-4103-87c7-e37aab68bf25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:07.270718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b6a42-63fc-4103-87c7-e37aab68bf25 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:07.294173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 864/1696] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:29:07.327644 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881baf84-191d-4fea-ac39-7ee0f1a953e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:07.329143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881baf84-191d-4fea-ac39-7ee0f1a953e4 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:07.348951 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 833/1697] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:29:07.945672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:08.312461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:09.391366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04168f-c0b9-45bd-8dbc-7fd1ea68edaa None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:09.396681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04168f-c0b9-45bd-8dbc-7fd1ea68edaa None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:09.400001 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04168f-c0b9-45bd-8dbc-7fd1ea68edaa None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:09.411058 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 865/1698] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:29:09 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:29:09.511220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8abcf3-5c6a-4440-93d0-f929e8b12190 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:09.511220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8abcf3-5c6a-4440-93d0-f929e8b12190 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:09.511220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8abcf3-5c6a-4440-93d0-f929e8b12190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:09.551960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-fe8abcf3-5c6a-4440-93d0-f929e8b12190 None None] MFA Rules not processed for user `b62795a6111a4c05a24e69efc7a0faba`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:09.559166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-fe8abcf3-5c6a-4440-93d0-f929e8b12190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:09.764162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 834/1699] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:09.868754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b23ee-a2ad-4beb-8e41-20fc8ed5f227 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:09.869234 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b23ee-a2ad-4beb-8e41-20fc8ed5f227 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:09.869684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b23ee-a2ad-4beb-8e41-20fc8ed5f227 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:09.871793 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 866/1700] 10.222.0.26 () {54 vars in 960 bytes} [Tue Jul 12 16:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:29:09.878818 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0419c85-a08b-4b74-8a0d-6b93e3da3f5e None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:09.879254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0419c85-a08b-4b74-8a0d-6b93e3da3f5e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:09.879646 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0419c85-a08b-4b74-8a0d-6b93e3da3f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:09.916002 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-c0419c85-a08b-4b74-8a0d-6b93e3da3f5e None None] MFA Rules not processed for user `b62795a6111a4c05a24e69efc7a0faba`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:09.923154 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c0419c85-a08b-4b74-8a0d-6b93e3da3f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:09.948656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 835/1701] 10.222.0.26 () {58 vars in 1057 bytes} [Tue Jul 12 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:09.958299 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b23ee-a2ad-4beb-8e41-20fc8ed5f227 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:09.984720 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b23ee-a2ad-4beb-8e41-20fc8ed5f227 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:10.002328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93af084-4405-4a83-9684-264d9741e72c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b62795a6111a4c05a24e69efc7a0faba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:10.005546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93af084-4405-4a83-9684-264d9741e72c service placement] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:10.006072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93af084-4405-4a83-9684-264d9741e72c service placement] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:10.006461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93af084-4405-4a83-9684-264d9741e72c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:10.042800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93af084-4405-4a83-9684-264d9741e72c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:10.044767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93af084-4405-4a83-9684-264d9741e72c service placement] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:10.069223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 867/1702] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:11.147969 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:11.802048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41b14-6301-4a0a-b7ea-1aa6c0361eb8 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:11.802574 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41b14-6301-4a0a-b7ea-1aa6c0361eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:11.802986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41b14-6301-4a0a-b7ea-1aa6c0361eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:11.862215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-7ed41b14-6301-4a0a-b7ea-1aa6c0361eb8 None None] MFA Rules not processed for user `ddfe9bf33946474f8ea4019d2c9e86e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:11.864634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7ed41b14-6301-4a0a-b7ea-1aa6c0361eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:12.064514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 836/1703] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:12.081720 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93af084-4405-4a83-9684-264d9741e72c service placement] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:12.083639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f93af084-4405-4a83-9684-264d9741e72c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:12.113261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed41b14-6301-4a0a-b7ea-1aa6c0361eb8 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:12.131088 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed41b14-6301-4a0a-b7ea-1aa6c0361eb8 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:12.142186 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42ffe6-97a1-4e2c-b71b-40c495e82b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:12.142910 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42ffe6-97a1-4e2c-b71b-40c495e82b83 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:12.143714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42ffe6-97a1-4e2c-b71b-40c495e82b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:12.143981 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42ffe6-97a1-4e2c-b71b-40c495e82b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:12.175944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42ffe6-97a1-4e2c-b71b-40c495e82b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:12.177429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42ffe6-97a1-4e2c-b71b-40c495e82b83 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:12.201460 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 837/1704] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:12.295056 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93af084-4405-4a83-9684-264d9741e72c service placement] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:12.310342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:12.314084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f71bc4-c43a-4b80-ac22-39a1895c86c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:12.316616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f71bc4-c43a-4b80-ac22-39a1895c86c2 service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:12.319777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f71bc4-c43a-4b80-ac22-39a1895c86c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:12.321777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f71bc4-c43a-4b80-ac22-39a1895c86c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:12.366775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f71bc4-c43a-4b80-ac22-39a1895c86c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:12.369508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f71bc4-c43a-4b80-ac22-39a1895c86c2 service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:12.398729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 868/1705] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:12.543309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42ffe6-97a1-4e2c-b71b-40c495e82b83 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:12.547240 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2e42ffe6-97a1-4e2c-b71b-40c495e82b83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:12.813538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d97e13-ada1-4714-afd1-588c453ec136 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:12.815515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d97e13-ada1-4714-afd1-588c453ec136 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:12.817511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d97e13-ada1-4714-afd1-588c453ec136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:12.843373 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42ffe6-97a1-4e2c-b71b-40c495e82b83 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:12.862659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:12.864408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:12.864697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:12.864973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] PATH_INFO: `/v3/users/93b8205e9a894cbd8296f145291cd999` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:12.866954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b8205e9a894cbd8296f145291cd999)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:12.876536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:12.905011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-29d97e13-ada1-4714-afd1-588c453ec136 None None] MFA Rules not processed for user `8a248a93038e426da3ed5ab25a65eb81`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:12.906544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-29d97e13-ada1-4714-afd1-588c453ec136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:13.076827 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 869/1706] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:13.088441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d97e13-ada1-4714-afd1-588c453ec136 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:13.091167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-29d97e13-ada1-4714-afd1-588c453ec136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:13.192835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d97e13-ada1-4714-afd1-588c453ec136 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:13.199317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84c486-cd0b-49c9-8568-88337ab6349b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:13.200765 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84c486-cd0b-49c9-8568-88337ab6349b service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:13.201250 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84c486-cd0b-49c9-8568-88337ab6349b service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:13.202022 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84c486-cd0b-49c9-8568-88337ab6349b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:13.204645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b8205e9a894cbd8296f145291cd999'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:13.225867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84c486-cd0b-49c9-8568-88337ab6349b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:13.229818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84c486-cd0b-49c9-8568-88337ab6349b service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:13.241847 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 870/1707] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:29:13.308082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b8205e9a894cbd8296f145291cd999'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:13.329909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b8205e9a894cbd8296f145291cd999'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:13.332813 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b8205e9a894cbd8296f145291cd999'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:13.371131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b8205e9a894cbd8296f145291cd999'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:13.401417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 838/1708] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:12 2022] DELETE /identity/v3/users/93b8205e9a894cbd8296f145291cd999 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:13.407136 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e0f3b-28d7-4337-852d-9239ecbe1299 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:13.407659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e0f3b-28d7-4337-852d-9239ecbe1299 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:13.410548 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e0f3b-28d7-4337-852d-9239ecbe1299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:13.477309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-cc4e0f3b-28d7-4337-852d-9239ecbe1299 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:13.477309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-cc4e0f3b-28d7-4337-852d-9239ecbe1299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:13.575590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:13.576464 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:13.578042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:13.598898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:13.666012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 871/1709] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:13.684069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e0f3b-28d7-4337-852d-9239ecbe1299 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:13.687704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-cc4e0f3b-28d7-4337-852d-9239ecbe1299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:13.704167 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc61495-3572-4142-9939-4fab0e974f71 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:13.710917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa03cb-ae74-4002-bcf5-97b61c398eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:13.711824 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa03cb-ae74-4002-bcf5-97b61c398eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:13.712285 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa03cb-ae74-4002-bcf5-97b61c398eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:13.713306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa03cb-ae74-4002-bcf5-97b61c398eae admin admin] PATH_INFO: `/v3/users/6095f4d0145148ad8d23403c80b276a0` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:13.715943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa03cb-ae74-4002-bcf5-97b61c398eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6095f4d0145148ad8d23403c80b276a0)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:13.718454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa03cb-ae74-4002-bcf5-97b61c398eae admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:13.820593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e0f3b-28d7-4337-852d-9239ecbe1299 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:13.828931 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0382db-e122-43f0-b116-836a11b9b55a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:13.831668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0382db-e122-43f0-b116-836a11b9b55a service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:13.831668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0382db-e122-43f0-b116-836a11b9b55a service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:13.835408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0382db-e122-43f0-b116-836a11b9b55a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:13.857686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0382db-e122-43f0-b116-836a11b9b55a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:13.859284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0382db-e122-43f0-b116-836a11b9b55a service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:13.881088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 872/1710] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:13.882158 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0382db-e122-43f0-b116-836a11b9b55a service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:13.885827 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ef0382db-e122-43f0-b116-836a11b9b55a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:13.913981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0382db-e122-43f0-b116-836a11b9b55a service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:13.925199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:13.926109 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:13.926396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:13.927949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] PATH_INFO: `/v3/users/890cc1a893c8454992c4f70245ed7af5` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:13.931424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=890cc1a893c8454992c4f70245ed7af5)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:13.940350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:14.016094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-08fa03cb-ae74-4002-bcf5-97b61c398eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6095f4d0145148ad8d23403c80b276a0'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:14.118271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-08fa03cb-ae74-4002-bcf5-97b61c398eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6095f4d0145148ad8d23403c80b276a0'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:14.152798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-08fa03cb-ae74-4002-bcf5-97b61c398eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6095f4d0145148ad8d23403c80b276a0'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:14.155275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-08fa03cb-ae74-4002-bcf5-97b61c398eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6095f4d0145148ad8d23403c80b276a0'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:14.180999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-08fa03cb-ae74-4002-bcf5-97b61c398eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6095f4d0145148ad8d23403c80b276a0'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:14.206140 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 839/1711] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:13 2022] DELETE /identity/v3/users/6095f4d0145148ad8d23403c80b276a0 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:14.210261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b6957-052f-4005-a298-4ae809b5f485 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:14.215097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b6957-052f-4005-a298-4ae809b5f485 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:14.215097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b6957-052f-4005-a298-4ae809b5f485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:14.221992 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890cc1a893c8454992c4f70245ed7af5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:14.273808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-219b6957-052f-4005-a298-4ae809b5f485 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:14.275063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-219b6957-052f-4005-a298-4ae809b5f485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:14.339402 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890cc1a893c8454992c4f70245ed7af5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:14.344538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890cc1a893c8454992c4f70245ed7af5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:14.381655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890cc1a893c8454992c4f70245ed7af5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:14.398320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890cc1a893c8454992c4f70245ed7af5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:14.399412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:14.440740 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 873/1712] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:13 2022] DELETE /identity/v3/users/890cc1a893c8454992c4f70245ed7af5 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:14.473288 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 840/1713] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:14.504855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:14.504855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:14.663381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:14.693894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11901541-7663-4c5b-8e5e-967eead723c6 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:14.701953 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365627e-ddf6-4415-985c-2181db23b14d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:14.705633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365627e-ddf6-4415-985c-2181db23b14d service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:14.706159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365627e-ddf6-4415-985c-2181db23b14d service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:14.706656 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365627e-ddf6-4415-985c-2181db23b14d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:14.874253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365627e-ddf6-4415-985c-2181db23b14d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:14.882089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365627e-ddf6-4415-985c-2181db23b14d service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:14.898389 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 874/1714] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:15.135523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b6957-052f-4005-a298-4ae809b5f485 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:15.137598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-219b6957-052f-4005-a298-4ae809b5f485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:15.157534 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b6957-052f-4005-a298-4ae809b5f485 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:15.168678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:15.169620 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:15.169966 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:15.171079 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd admin admin] PATH_INFO: `/v3/projects/7280c20512cc4d4cb60cbf5a11df3a7d` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:15.172556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7280c20512cc4d4cb60cbf5a11df3a7d)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:15.175200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:15.206615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365627e-ddf6-4415-985c-2181db23b14d service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:15.208859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f365627e-ddf6-4415-985c-2181db23b14d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:15.238121 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365627e-ddf6-4415-985c-2181db23b14d service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:15.250013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:15.251981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:15.254372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:15.254900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] PATH_INFO: `/v3/projects/aef6f97ca62943b6b66f919f9b19f78a` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:15.257347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef6f97ca62943b6b66f919f9b19f78a)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:15.260239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:15.401528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7280c20512cc4d4cb60cbf5a11df3a7d', 'request_id': 'req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:15.472142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef6f97ca62943b6b66f919f9b19f78a', 'request_id': 'req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:15.557019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7280c20512cc4d4cb60cbf5a11df3a7d', 'request_id': 'req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:15.587940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7280c20512cc4d4cb60cbf5a11df3a7d', 'request_id': 'req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:15.629298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd admin admin] The token cache is being invalidate because project 7280c20512cc4d4cb60cbf5a11df3a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:15.630687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:15.634129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9c7d0cb1-d051-49ca-a465-3c3ed95702bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:15.638537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 841/1715] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:15 2022] DELETE /identity/v3/projects/7280c20512cc4d4cb60cbf5a11df3a7d => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:15.647189 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe7450-ca49-4061-b62f-bdf25a062b45 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:15.647762 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe7450-ca49-4061-b62f-bdf25a062b45 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:15.648880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe7450-ca49-4061-b62f-bdf25a062b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:15.657184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef6f97ca62943b6b66f919f9b19f78a', 'request_id': 'req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:15.673162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef6f97ca62943b6b66f919f9b19f78a', 'request_id': 'req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:15.699860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] The token cache is being invalidate because project aef6f97ca62943b6b66f919f9b19f78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:15.700158 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:15.700837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:15.703524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 875/1716] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:15 2022] DELETE /identity/v3/projects/aef6f97ca62943b6b66f919f9b19f78a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:15.704443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:15.709379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:15.751659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-55fe7450-ca49-4061-b62f-bdf25a062b45 None None] MFA Rules not processed for user `3e0ff52608ed4cd4b9b4dfadc97ce9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:15.753073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-55fe7450-ca49-4061-b62f-bdf25a062b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:15.838651 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93959e-8a44-400b-b8c3-aa5f1cc4f3d2 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:15.848282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:15.849528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:15.850104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:15.850104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] PATH_INFO: `/v3/users/2431b85a0f9949bb9fb321e28febea10` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:15.855673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2431b85a0f9949bb9fb321e28febea10)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:15.861789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:15.902637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 842/1717] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:15.903957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048f31e-9ebf-4a4e-9964-35e378b35ce0 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:15.904252 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048f31e-9ebf-4a4e-9964-35e378b35ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:15.904528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048f31e-9ebf-4a4e-9964-35e378b35ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:15.942271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-7048f31e-9ebf-4a4e-9964-35e378b35ce0 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:15.943496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7048f31e-9ebf-4a4e-9964-35e378b35ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:15.972679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 843/1718] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:15.980183 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2809aed-c84e-4b8a-8424-d5d5e448c18e None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:15.980488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2809aed-c84e-4b8a-8424-d5d5e448c18e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:15.980747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2809aed-c84e-4b8a-8424-d5d5e448c18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:16.017408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-f2809aed-c84e-4b8a-8424-d5d5e448c18e None None] MFA Rules not processed for user `3e0ff52608ed4cd4b9b4dfadc97ce9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:16.019246 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f2809aed-c84e-4b8a-8424-d5d5e448c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:16.047147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 844/1719] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:16.049729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695a34b-d7ef-4dee-988d-9b77d6704736 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:16.050019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695a34b-d7ef-4dee-988d-9b77d6704736 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:16.054866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695a34b-d7ef-4dee-988d-9b77d6704736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:16.096975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-1695a34b-d7ef-4dee-988d-9b77d6704736 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:16.098173 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1695a34b-d7ef-4dee-988d-9b77d6704736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:16.119307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 845/1720] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:16.126369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec78a3-0760-4aa0-80f1-65cfc1340fb9 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:16.126369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec78a3-0760-4aa0-80f1-65cfc1340fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:16.126369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec78a3-0760-4aa0-80f1-65cfc1340fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:16.198435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-57ec78a3-0760-4aa0-80f1-65cfc1340fb9 None None] MFA Rules not processed for user `071dc15e85a849afa9b9663f7e5f428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:16.198521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2431b85a0f9949bb9fb321e28febea10'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:16.200881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-57ec78a3-0760-4aa0-80f1-65cfc1340fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:16.298565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2431b85a0f9949bb9fb321e28febea10'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:16.300352 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2431b85a0f9949bb9fb321e28febea10'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:16.325073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2431b85a0f9949bb9fb321e28febea10'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:16.342777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2431b85a0f9949bb9fb321e28febea10'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:16.350408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:16.354941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 876/1721] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:15 2022] DELETE /identity/v3/users/2431b85a0f9949bb9fb321e28febea10 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:16.358889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:16.360492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:16.380268 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 846/1722] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:16.381305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec78a3-0760-4aa0-80f1-65cfc1340fb9 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:16.389256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-57ec78a3-0760-4aa0-80f1-65cfc1340fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:16.444102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec78a3-0760-4aa0-80f1-65cfc1340fb9 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:16.530005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:16.558460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb8cd9-4d89-4a05-a126-96126d8fde2f admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:16.589533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4ab76-8db4-4db9-9057-4bfec1efc241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:16.590265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4ab76-8db4-4db9-9057-4bfec1efc241 service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:16.590553 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4ab76-8db4-4db9-9057-4bfec1efc241 service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:16.590829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4ab76-8db4-4db9-9057-4bfec1efc241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:16.604082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-dfa4ab76-8db4-4db9-9057-4bfec1efc241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:16.645760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ab853-425a-4d17-b522-475cf5df5c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:16.646825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ab853-425a-4d17-b522-475cf5df5c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:16.647323 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ab853-425a-4d17-b522-475cf5df5c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:16.647800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ab853-425a-4d17-b522-475cf5df5c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:16.648749 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ab853-425a-4d17-b522-475cf5df5c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:29:16.649300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ab853-425a-4d17-b522-475cf5df5c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:16.658158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ab853-425a-4d17-b522-475cf5df5c49 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:16.697236 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 847/1723] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:29:16.697236 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c390f0-453f-4615-a396-fc125dec4061 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:16.697236 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c390f0-453f-4615-a396-fc125dec4061 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:16.697236 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c390f0-453f-4615-a396-fc125dec4061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:16.733567 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4ab76-8db4-4db9-9057-4bfec1efc241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:16.735410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4ab76-8db4-4db9-9057-4bfec1efc241 service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:16.747068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 877/1724] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:16.748203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4ab76-8db4-4db9-9057-4bfec1efc241 service nova] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:16.749883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-dfa4ab76-8db4-4db9-9057-4bfec1efc241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:16.763951 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-43c390f0-453f-4615-a396-fc125dec4061 None None] MFA Rules not processed for user `071dc15e85a849afa9b9663f7e5f428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:16.766144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-43c390f0-453f-4615-a396-fc125dec4061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:16.766332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4ab76-8db4-4db9-9057-4bfec1efc241 service nova] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:16.772400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:16.774747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:16.774747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:16.774747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] PATH_INFO: `/v3/projects/c0054e32fab740a7830116d3c45b7d8a` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:16.776770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0054e32fab740a7830116d3c45b7d8a)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:16.779121 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:16.907349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0054e32fab740a7830116d3c45b7d8a', 'request_id': 'req-f5f7a7ad-43d4-4f65-91ea-801f8227e094'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:16.927736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 848/1725] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:16.929206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c390f0-453f-4615-a396-fc125dec4061 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:16.963122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c390f0-453f-4615-a396-fc125dec4061 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:17.083631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0054e32fab740a7830116d3c45b7d8a', 'request_id': 'req-f5f7a7ad-43d4-4f65-91ea-801f8227e094'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:17.091299 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0054e32fab740a7830116d3c45b7d8a', 'request_id': 'req-f5f7a7ad-43d4-4f65-91ea-801f8227e094'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:17.099722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a850a66-5e4b-4c46-a52e-39a17b2e63fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:17.100389 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a850a66-5e4b-4c46-a52e-39a17b2e63fa admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:17.100676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a850a66-5e4b-4c46-a52e-39a17b2e63fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:17.100956 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a850a66-5e4b-4c46-a52e-39a17b2e63fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:17.101699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a850a66-5e4b-4c46-a52e-39a17b2e63fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:17.103629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a850a66-5e4b-4c46-a52e-39a17b2e63fa admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:17.163116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] The token cache is being invalidate because project c0054e32fab740a7830116d3c45b7d8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:17.167456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:17.170824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:17.173698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 878/1726] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:16 2022] DELETE /identity/v3/projects/c0054e32fab740a7830116d3c45b7d8a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:17.176681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:17.183388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:17.260970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 849/1727] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:16 2022] POST /identity/v3/projects => generated 373 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:17.261887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a850a66-5e4b-4c46-a52e-39a17b2e63fa admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:17.268748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7a850a66-5e4b-4c46-a52e-39a17b2e63fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:17.312925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7a7ad-43d4-4f65-91ea-801f8227e094 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:17.418871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a850a66-5e4b-4c46-a52e-39a17b2e63fa admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:17.419294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124d6df-601a-426e-83d0-d9bc9376a593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:17.420942 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124d6df-601a-426e-83d0-d9bc9376a593 service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:17.421394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124d6df-601a-426e-83d0-d9bc9376a593 service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:17.421908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124d6df-601a-426e-83d0-d9bc9376a593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:17.426018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a124d6df-601a-426e-83d0-d9bc9376a593 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:17.432329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:17.433657 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:17.434156 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:17.434640 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] PATH_INFO: `/v3/users/3d33dc16e6f34ff6858a5de640348824` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:17.436598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d33dc16e6f34ff6858a5de640348824)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:17.443888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:17.542934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124d6df-601a-426e-83d0-d9bc9376a593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:17.544776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124d6df-601a-426e-83d0-d9bc9376a593 service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:17.562474 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 879/1728] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:17.563662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124d6df-601a-426e-83d0-d9bc9376a593 service nova] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:17.565422 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a124d6df-601a-426e-83d0-d9bc9376a593 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:17.599820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124d6df-601a-426e-83d0-d9bc9376a593 service nova] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:17.616280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:17.617227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:17.622668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:17.622668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f admin admin] PATH_INFO: `/v3/projects/e65f00d301694560987f3490dfe0cb31` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:17.622668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65f00d301694560987f3490dfe0cb31)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:17.622668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:17.749833 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d33dc16e6f34ff6858a5de640348824'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:17.813695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65f00d301694560987f3490dfe0cb31', 'request_id': 'req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:17.867292 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d33dc16e6f34ff6858a5de640348824'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:17.898295 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d33dc16e6f34ff6858a5de640348824'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:17.899673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d33dc16e6f34ff6858a5de640348824'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:17.922129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d33dc16e6f34ff6858a5de640348824'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:17.936153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 850/1729] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:17 2022] DELETE /identity/v3/users/3d33dc16e6f34ff6858a5de640348824 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:17.938072 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:17.943137 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:17.963196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65f00d301694560987f3490dfe0cb31', 'request_id': 'req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:17.972254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65f00d301694560987f3490dfe0cb31', 'request_id': 'req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:18.003845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f admin admin] The token cache is being invalidate because project e65f00d301694560987f3490dfe0cb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:18.004180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:18.006365 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6f09e8d3-e714-4a63-b3fa-35801b0a9d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:18.014229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 880/1730] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:17 2022] DELETE /identity/v3/projects/e65f00d301694560987f3490dfe0cb31 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:18.015779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebd2a2-a75d-4492-92a7-921e63715a31 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.016101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebd2a2-a75d-4492-92a7-921e63715a31 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.016346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebd2a2-a75d-4492-92a7-921e63715a31 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.025270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 881/1731] 10.222.0.26 () {54 vars in 912 bytes} [Tue Jul 12 16:29:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:29:18.026674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12015bd-5a14-4e83-b0a3-05855745780d None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.029068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12015bd-5a14-4e83-b0a3-05855745780d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.029068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12015bd-5a14-4e83-b0a3-05855745780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.077456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-f12015bd-5a14-4e83-b0a3-05855745780d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:18.078680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f12015bd-5a14-4e83-b0a3-05855745780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:18.114164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a23048-9299-440d-b48e-0b6c9599928d admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:18.122640 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e2df9-7347-4d46-86c8-b943ce6d7621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:18.123687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e2df9-7347-4d46-86c8-b943ce6d7621 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.124210 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e2df9-7347-4d46-86c8-b943ce6d7621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.124628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e2df9-7347-4d46-86c8-b943ce6d7621 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.126094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e2df9-7347-4d46-86c8-b943ce6d7621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:18.129159 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e2df9-7347-4d46-86c8-b943ce6d7621 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:18.198191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 882/1732] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:18.198191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb13af-5ac5-40ff-b32b-63220e34f019 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.198191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb13af-5ac5-40ff-b32b-63220e34f019 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.198191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb13af-5ac5-40ff-b32b-63220e34f019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.234585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 851/1733] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:17 2022] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:18.235909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefa8fc-61c6-484e-9ed9-540e9aa9a94b None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.244729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefa8fc-61c6-484e-9ed9-540e9aa9a94b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.245343 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefa8fc-61c6-484e-9ed9-540e9aa9a94b None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.247455 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 852/1734] 10.222.0.26 () {54 vars in 912 bytes} [Tue Jul 12 16:29:18 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:29:18.249638 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2d3e1-0acf-4274-8d3f-82b8ee39c69b None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.252950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2d3e1-0acf-4274-8d3f-82b8ee39c69b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.253713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2d3e1-0acf-4274-8d3f-82b8ee39c69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.272604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-c9bb13af-5ac5-40ff-b32b-63220e34f019 None None] MFA Rules not processed for user `f6a4da4c1dca40f5bb5d158a6f33d9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:18.275080 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c9bb13af-5ac5-40ff-b32b-63220e34f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:18.302506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-9fb2d3e1-0acf-4274-8d3f-82b8ee39c69b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:18.307452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9fb2d3e1-0acf-4274-8d3f-82b8ee39c69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:18.340271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 853/1735] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:18.341545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2d3e1-0acf-4274-8d3f-82b8ee39c69b None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:18.343221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9fb2d3e1-0acf-4274-8d3f-82b8ee39c69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:18.387661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2d3e1-0acf-4274-8d3f-82b8ee39c69b None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:18.397760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a5f55-9030-4b96-b62d-3207cb6eb18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:18.398690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a5f55-9030-4b96-b62d-3207cb6eb18a admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.399279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a5f55-9030-4b96-b62d-3207cb6eb18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.399783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a5f55-9030-4b96-b62d-3207cb6eb18a admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.400467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a5f55-9030-4b96-b62d-3207cb6eb18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:18.419007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a5f55-9030-4b96-b62d-3207cb6eb18a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:18.457760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 854/1736] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:18.465058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f9bb2-0823-4b46-8c4f-c9d280a916e2 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.465356 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f9bb2-0823-4b46-8c4f-c9d280a916e2 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.465675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f9bb2-0823-4b46-8c4f-c9d280a916e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.474668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 883/1737] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:29:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:18.480640 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb13af-5ac5-40ff-b32b-63220e34f019 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:18.532564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb13af-5ac5-40ff-b32b-63220e34f019 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:18.538130 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-b72f9bb2-0823-4b46-8c4f-c9d280a916e2 None None] MFA Rules not processed for user `f6a4da4c1dca40f5bb5d158a6f33d9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:18.545570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b72f9bb2-0823-4b46-8c4f-c9d280a916e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:18.567757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c85aec-2bd9-4ea5-945d-8dbc484c681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:18.568496 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c85aec-2bd9-4ea5-945d-8dbc484c681c admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.568781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c85aec-2bd9-4ea5-945d-8dbc484c681c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.569059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c85aec-2bd9-4ea5-945d-8dbc484c681c admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.569904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c85aec-2bd9-4ea5-945d-8dbc484c681c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:29:18.570215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c85aec-2bd9-4ea5-945d-8dbc484c681c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:18.571915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c85aec-2bd9-4ea5-945d-8dbc484c681c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:18.579994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 855/1738] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:29:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:18.580959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f9bb2-0823-4b46-8c4f-c9d280a916e2 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:18.614626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f9bb2-0823-4b46-8c4f-c9d280a916e2 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:18.629375 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 884/1739] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:29:18.630368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c85aec-2bd9-4ea5-945d-8dbc484c681c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:18.633283 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f7c85aec-2bd9-4ea5-945d-8dbc484c681c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:18.637718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f9a64-1415-4e54-a7b0-50957da8e051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:18.638469 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f9a64-1415-4e54-a7b0-50957da8e051 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.638750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f9a64-1415-4e54-a7b0-50957da8e051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.639027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f9a64-1415-4e54-a7b0-50957da8e051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.639817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f9a64-1415-4e54-a7b0-50957da8e051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:18.641454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f9a64-1415-4e54-a7b0-50957da8e051 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:18.656226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c85aec-2bd9-4ea5-945d-8dbc484c681c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:18.668258 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca2441-6e16-4f66-b958-975f1e9bb74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:18.669143 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca2441-6e16-4f66-b958-975f1e9bb74b service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.669387 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca2441-6e16-4f66-b958-975f1e9bb74b service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.669720 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca2441-6e16-4f66-b958-975f1e9bb74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.691007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 856/1740] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:18.691413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:18.693247 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f415c09-d311-4683-bc9c-dccc07d162be None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.693538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f415c09-d311-4683-bc9c-dccc07d162be None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.696278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca2441-6e16-4f66-b958-975f1e9bb74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:18.697837 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f415c09-d311-4683-bc9c-dccc07d162be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.699373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca2441-6e16-4f66-b958-975f1e9bb74b service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:18.727877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 885/1741] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:18.729283 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca2441-6e16-4f66-b958-975f1e9bb74b service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:18.751309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca2441-6e16-4f66-b958-975f1e9bb74b service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:18.754759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-6f415c09-d311-4683-bc9c-dccc07d162be None None] MFA Rules not processed for user `ddfe9bf33946474f8ea4019d2c9e86e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:18.756631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6f415c09-d311-4683-bc9c-dccc07d162be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:18.763223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fceb8-3d80-486a-93af-81b1399e76c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:18.763956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fceb8-3d80-486a-93af-81b1399e76c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.764242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fceb8-3d80-486a-93af-81b1399e76c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.764695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fceb8-3d80-486a-93af-81b1399e76c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.802449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fceb8-3d80-486a-93af-81b1399e76c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:18.807550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fceb8-3d80-486a-93af-81b1399e76c8 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:18.828331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 886/1742] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:18.829235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fceb8-3d80-486a-93af-81b1399e76c8 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:18.849974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fceb8-3d80-486a-93af-81b1399e76c8 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:18.855333 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005e48f-5f19-4359-8351-3d366a4d9d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:18.865007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005e48f-5f19-4359-8351-3d366a4d9d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:18.865007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005e48f-5f19-4359-8351-3d366a4d9d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:18.865007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005e48f-5f19-4359-8351-3d366a4d9d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:18.865007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005e48f-5f19-4359-8351-3d366a4d9d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:18.865007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005e48f-5f19-4359-8351-3d366a4d9d14 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:18.894039 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:18.930704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 857/1743] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:18.931581 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f415c09-d311-4683-bc9c-dccc07d162be None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:18.944170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 887/1744] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:18 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:18.947972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005e48f-5f19-4359-8351-3d366a4d9d14 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:18.963297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f415c09-d311-4683-bc9c-dccc07d162be None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:19.077313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9ed56-a481-4546-9788-27cd9f4a310d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:19.078281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9ed56-a481-4546-9788-27cd9f4a310d admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:19.078562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9ed56-a481-4546-9788-27cd9f4a310d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:19.078839 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9ed56-a481-4546-9788-27cd9f4a310d admin admin] PATH_INFO: `/v3/projects/cef9bf8203fa4effac8cdbce7e07d038/users/87e20ccfb0364cfb93148b6bf72a6154/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:19.116054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9ed56-a481-4546-9788-27cd9f4a310d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef9bf8203fa4effac8cdbce7e07d038, user_id=87e20ccfb0364cfb93148b6bf72a6154, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:19.119184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9ed56-a481-4546-9788-27cd9f4a310d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:19.125856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005e48f-5f19-4359-8351-3d366a4d9d14 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:19.137628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371a2e6-4739-443d-b1b3-dda296e6a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:19.138337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a2e6-4739-443d-b1b3-dda296e6a962 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:19.138663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a2e6-4739-443d-b1b3-dda296e6a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:19.138949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a2e6-4739-443d-b1b3-dda296e6a962 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:19.139661 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371a2e6-4739-443d-b1b3-dda296e6a962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:19.141676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371a2e6-4739-443d-b1b3-dda296e6a962 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:19.226873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 858/1745] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:18 2022] PUT /identity/v3/projects/cef9bf8203fa4effac8cdbce7e07d038/users/87e20ccfb0364cfb93148b6bf72a6154/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:19.228424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea67e1e-721a-4e42-88e3-5f5643931c68 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:19.228918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea67e1e-721a-4e42-88e3-5f5643931c68 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:19.229423 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea67e1e-721a-4e42-88e3-5f5643931c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:19.259444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 888/1746] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:18 2022] POST /identity/v3/users => generated 282 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:19.259444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e10e6-54b4-45e1-a569-141d03e6b1a7 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:19.259444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e10e6-54b4-45e1-a569-141d03e6b1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:19.264530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e10e6-54b4-45e1-a569-141d03e6b1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:19.271224 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-7ea67e1e-721a-4e42-88e3-5f5643931c68 None None] MFA Rules not processed for user `8a248a93038e426da3ed5ab25a65eb81`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:19.274729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7ea67e1e-721a-4e42-88e3-5f5643931c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:19.327810 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-f49e10e6-54b4-45e1-a569-141d03e6b1a7 None None] MFA Rules not processed for user `87e20ccfb0364cfb93148b6bf72a6154`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:19.329152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f49e10e6-54b4-45e1-a569-141d03e6b1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:19.355047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 859/1747] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:19.356251 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea67e1e-721a-4e42-88e3-5f5643931c68 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:19.434699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea67e1e-721a-4e42-88e3-5f5643931c68 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:19.444019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c69c1-716c-4c6a-9407-af6671d83ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:19.444973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c69c1-716c-4c6a-9407-af6671d83ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:19.445452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c69c1-716c-4c6a-9407-af6671d83ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:19.445866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c69c1-716c-4c6a-9407-af6671d83ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:19.446770 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c69c1-716c-4c6a-9407-af6671d83ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:19.448936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c69c1-716c-4c6a-9407-af6671d83ce5 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:19.472106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 860/1748] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:19.473315 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c69c1-716c-4c6a-9407-af6671d83ce5 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:19.487960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 889/1749] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:19.494973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c69c1-716c-4c6a-9407-af6671d83ce5 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:19.501870 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e10e6-54b4-45e1-a569-141d03e6b1a7 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:19.503258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302493e-8f95-456e-ab8e-a5038a4e8991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:19.504087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f49e10e6-54b4-45e1-a569-141d03e6b1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:19.504200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302493e-8f95-456e-ab8e-a5038a4e8991 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:19.504641 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302493e-8f95-456e-ab8e-a5038a4e8991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:19.504992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302493e-8f95-456e-ab8e-a5038a4e8991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:19.506377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302493e-8f95-456e-ab8e-a5038a4e8991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:19.508643 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302493e-8f95-456e-ab8e-a5038a4e8991 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:19.533528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 861/1750] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:19.535172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302493e-8f95-456e-ab8e-a5038a4e8991 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:19.552635 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302493e-8f95-456e-ab8e-a5038a4e8991 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:19.559317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048c440-a455-4fdf-ad11-f44c040e3fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:19.561245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048c440-a455-4fdf-ad11-f44c040e3fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:19.561245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048c440-a455-4fdf-ad11-f44c040e3fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:19.561634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048c440-a455-4fdf-ad11-f44c040e3fcd admin admin] PATH_INFO: `/v3/projects/557b325041f140889e2f7b0104595489/users/629c74b87b494fa3ad20d4bdee9164b1/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:19.599189 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048c440-a455-4fdf-ad11-f44c040e3fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=557b325041f140889e2f7b0104595489, user_id=629c74b87b494fa3ad20d4bdee9164b1, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:19.603318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048c440-a455-4fdf-ad11-f44c040e3fcd admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:19.609315 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e10e6-54b4-45e1-a569-141d03e6b1a7 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:19.615685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51da764-ea78-4581-89b1-5f6de2897082 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:19.617197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51da764-ea78-4581-89b1-5f6de2897082 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:19.617197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51da764-ea78-4581-89b1-5f6de2897082 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:19.617197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51da764-ea78-4581-89b1-5f6de2897082 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:19.632805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51da764-ea78-4581-89b1-5f6de2897082 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:19.634337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51da764-ea78-4581-89b1-5f6de2897082 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:19.653237 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 890/1751] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:29:19.671719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51da764-ea78-4581-89b1-5f6de2897082 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:19.676470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 862/1752] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:19 2022] PUT /identity/v3/projects/557b325041f140889e2f7b0104595489/users/629c74b87b494fa3ad20d4bdee9164b1/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:19.690654 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a699c68-bb9d-40e6-9926-41a6555faf4d None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:19.692534 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a699c68-bb9d-40e6-9926-41a6555faf4d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:19.694335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a699c68-bb9d-40e6-9926-41a6555faf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:19.713936 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51da764-ea78-4581-89b1-5f6de2897082 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:19.757838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-1a699c68-bb9d-40e6-9926-41a6555faf4d None None] MFA Rules not processed for user `629c74b87b494fa3ad20d4bdee9164b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:19.758443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1a699c68-bb9d-40e6-9926-41a6555faf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:19.915270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:19.919235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:19.919538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:19.920657 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] PATH_INFO: `/v3/users/87e20ccfb0364cfb93148b6bf72a6154` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:19.928199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e20ccfb0364cfb93148b6bf72a6154)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:19.930184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:19.931718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 863/1753] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:19 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:19.932682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a699c68-bb9d-40e6-9926-41a6555faf4d None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:19.937054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1a699c68-bb9d-40e6-9926-41a6555faf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:19.981054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a699c68-bb9d-40e6-9926-41a6555faf4d None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:20.005238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:20.005238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:20.005238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:20.005238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] PATH_INFO: `/v3/projects/13b87c08fa3d42c8af6c9ac85699baa3` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:20.011980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b87c08fa3d42c8af6c9ac85699baa3)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:20.013967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:20.253679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e20ccfb0364cfb93148b6bf72a6154'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:20.269930 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b87c08fa3d42c8af6c9ac85699baa3', 'request_id': 'req-566d80af-9fa5-4b19-9793-95fda6630650'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:20.366520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e20ccfb0364cfb93148b6bf72a6154'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:20.367454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e20ccfb0364cfb93148b6bf72a6154'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:20.411624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e20ccfb0364cfb93148b6bf72a6154'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:20.424581 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b87c08fa3d42c8af6c9ac85699baa3', 'request_id': 'req-566d80af-9fa5-4b19-9793-95fda6630650'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:20.426001 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e20ccfb0364cfb93148b6bf72a6154'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:20.432566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b87c08fa3d42c8af6c9ac85699baa3', 'request_id': 'req-566d80af-9fa5-4b19-9793-95fda6630650'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:20.453746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] The token cache is being invalidate because project 13b87c08fa3d42c8af6c9ac85699baa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:20.454264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:20.455389 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:20.458508 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 864/1755] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:19 2022] DELETE /identity/v3/projects/13b87c08fa3d42c8af6c9ac85699baa3 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:20.458852 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 891/1755] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:19 2022] DELETE /identity/v3/users/87e20ccfb0364cfb93148b6bf72a6154 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:20.459676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:20.459826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:20.466814 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:20.467025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:20.586163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:20.644481 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d80af-9fa5-4b19-9793-95fda6630650 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:20.657893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763d85e-a337-4f99-b075-588f8edd9efe admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:20.670282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7b009-8aff-41f3-be26-73b20e07f415 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b62795a6111a4c05a24e69efc7a0faba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:20.670985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7b009-8aff-41f3-be26-73b20e07f415 service placement] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:20.671322 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7b009-8aff-41f3-be26-73b20e07f415 service placement] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:20.671604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7b009-8aff-41f3-be26-73b20e07f415 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:20.686773 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-5fb7b009-8aff-41f3-be26-73b20e07f415 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:20.717032 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7b009-8aff-41f3-be26-73b20e07f415 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:20.717032 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7b009-8aff-41f3-be26-73b20e07f415 service placement] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:20.742693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 892/1756] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:20.753441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7b009-8aff-41f3-be26-73b20e07f415 service placement] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:20.759847 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-5fb7b009-8aff-41f3-be26-73b20e07f415 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:20.766578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4661d25-869e-4d44-8150-b5cd08268267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:20.768883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4661d25-869e-4d44-8150-b5cd08268267 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:20.769367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4661d25-869e-4d44-8150-b5cd08268267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:20.769699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4661d25-869e-4d44-8150-b5cd08268267 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:20.770610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4661d25-869e-4d44-8150-b5cd08268267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:20.773029 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4661d25-869e-4d44-8150-b5cd08268267 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:20.804033 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:20.809137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7b009-8aff-41f3-be26-73b20e07f415 service placement] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:20.833984 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23305b9d-7ed5-44a1-a21d-d52388b0417f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b62795a6111a4c05a24e69efc7a0faba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:20.837019 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23305b9d-7ed5-44a1-a21d-d52388b0417f service placement] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:20.837347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23305b9d-7ed5-44a1-a21d-d52388b0417f service placement] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:20.837637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23305b9d-7ed5-44a1-a21d-d52388b0417f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:20.862971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23305b9d-7ed5-44a1-a21d-d52388b0417f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:20.864701 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23305b9d-7ed5-44a1-a21d-d52388b0417f service placement] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:20.899886 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 893/1757] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:20.905566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 865/1758] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:20 2022] POST /identity/v3/projects => generated 365 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:20.905722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59656d8-d00d-4aae-8a29-b22e5da8f9ce None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:20.905801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9603e4c-3437-4e36-9049-ddd8ce65f662 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:20.905870 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59656d8-d00d-4aae-8a29-b22e5da8f9ce None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:20.905966 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9603e4c-3437-4e36-9049-ddd8ce65f662 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:20.906038 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59656d8-d00d-4aae-8a29-b22e5da8f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:20.906105 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9603e4c-3437-4e36-9049-ddd8ce65f662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:20.946230 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e59656d8-d00d-4aae-8a29-b22e5da8f9ce None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:20.947387 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e59656d8-d00d-4aae-8a29-b22e5da8f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:20.950271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e9603e4c-3437-4e36-9049-ddd8ce65f662 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:20.951909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e9603e4c-3437-4e36-9049-ddd8ce65f662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:21.126080 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 894/1759] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:21.127449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59656d8-d00d-4aae-8a29-b22e5da8f9ce None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:21.158272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59656d8-d00d-4aae-8a29-b22e5da8f9ce None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:21.177338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f2763-ec75-41b6-8e65-b7ba7bbbd7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:21.182171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 866/1760] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:21.183127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f2763-ec75-41b6-8e65-b7ba7bbbd7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:21.183578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f2763-ec75-41b6-8e65-b7ba7bbbd7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:21.184545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9603e4c-3437-4e36-9049-ddd8ce65f662 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:21.184662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f2763-ec75-41b6-8e65-b7ba7bbbd7d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:21.185786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f2763-ec75-41b6-8e65-b7ba7bbbd7d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:21.188394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f2763-ec75-41b6-8e65-b7ba7bbbd7d3 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:21.188641 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e9603e4c-3437-4e36-9049-ddd8ce65f662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:21.337388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 895/1761] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:21 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:21.338722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db397f-5b36-4341-9f92-32430faa2c10 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:21.339019 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db397f-5b36-4341-9f92-32430faa2c10 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:21.340188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db397f-5b36-4341-9f92-32430faa2c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:21.369905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9603e4c-3437-4e36-9049-ddd8ce65f662 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:21.384967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc11eae-028a-420f-9337-895a6d06c2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:21.385659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e4db397f-5b36-4341-9f92-32430faa2c10 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:21.385779 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc11eae-028a-420f-9337-895a6d06c2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:21.385986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc11eae-028a-420f-9337-895a6d06c2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:21.386290 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc11eae-028a-420f-9337-895a6d06c2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:21.386897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e4db397f-5b36-4341-9f92-32430faa2c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:21.405278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 896/1762] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:21.406502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db397f-5b36-4341-9f92-32430faa2c10 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:21.419734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db397f-5b36-4341-9f92-32430faa2c10 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:21.426535 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc11eae-028a-420f-9337-895a6d06c2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:21.426808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef476662-917b-4ecc-a985-1ca9a9dbaf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:21.427977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef476662-917b-4ecc-a985-1ca9a9dbaf19 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:21.428083 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc11eae-028a-420f-9337-895a6d06c2a3 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:21.428484 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef476662-917b-4ecc-a985-1ca9a9dbaf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:21.429048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef476662-917b-4ecc-a985-1ca9a9dbaf19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:21.430383 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef476662-917b-4ecc-a985-1ca9a9dbaf19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:21.433492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef476662-917b-4ecc-a985-1ca9a9dbaf19 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:21.465596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 897/1764] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:21.466392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef476662-917b-4ecc-a985-1ca9a9dbaf19 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:21.469908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 867/1764] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:21.472603 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc11eae-028a-420f-9337-895a6d06c2a3 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:21.479855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef476662-917b-4ecc-a985-1ca9a9dbaf19 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:21.492552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ded3f-e9b2-4897-bd6c-39387c5c1361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:21.494236 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ded3f-e9b2-4897-bd6c-39387c5c1361 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:21.494236 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ded3f-e9b2-4897-bd6c-39387c5c1361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:21.494236 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ded3f-e9b2-4897-bd6c-39387c5c1361 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:21.495097 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ded3f-e9b2-4897-bd6c-39387c5c1361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:29:21.495545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ded3f-e9b2-4897-bd6c-39387c5c1361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:21.496482 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc11eae-028a-420f-9337-895a6d06c2a3 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:21.497560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ded3f-e9b2-4897-bd6c-39387c5c1361 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:21.508376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e78f7-265d-47b5-a4db-98aa50623729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:21.509317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e78f7-265d-47b5-a4db-98aa50623729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:21.509740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e78f7-265d-47b5-a4db-98aa50623729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:21.510028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e78f7-265d-47b5-a4db-98aa50623729 admin admin] PATH_INFO: `/v3/projects/f3ab1c6752b04dd1b4ad6d24118edf74/users/96b157ffa2904f09827f30be37ac1cda/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:21.517182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 898/1765] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:29:21.521464 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ded3f-e9b2-4897-bd6c-39387c5c1361 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:21.544143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e78f7-265d-47b5-a4db-98aa50623729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ab1c6752b04dd1b4ad6d24118edf74, user_id=96b157ffa2904f09827f30be37ac1cda, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:21.546912 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ded3f-e9b2-4897-bd6c-39387c5c1361 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:21.549789 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e78f7-265d-47b5-a4db-98aa50623729 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:21.554601 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f211b5-daae-47b1-a5c6-85e064f0de59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:21.555679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f211b5-daae-47b1-a5c6-85e064f0de59 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:21.556100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f211b5-daae-47b1-a5c6-85e064f0de59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:21.556524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f211b5-daae-47b1-a5c6-85e064f0de59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:21.557377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f211b5-daae-47b1-a5c6-85e064f0de59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:21.559321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f211b5-daae-47b1-a5c6-85e064f0de59 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:21.644775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 868/1766] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:21 2022] PUT /identity/v3/projects/f3ab1c6752b04dd1b4ad6d24118edf74/users/96b157ffa2904f09827f30be37ac1cda/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:21.649845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e78f7-265d-47b5-a4db-98aa50623729 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:21.693464 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 899/1767] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:21 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:21.697586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f211b5-daae-47b1-a5c6-85e064f0de59 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:21.915448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e78f7-265d-47b5-a4db-98aa50623729 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:21.983474 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f211b5-daae-47b1-a5c6-85e064f0de59 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:21.996974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f2052-1661-4c0c-a55f-e437c32e8965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:21.997687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f2052-1661-4c0c-a55f-e437c32e8965 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:21.997976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f2052-1661-4c0c-a55f-e437c32e8965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:21.998252 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f2052-1661-4c0c-a55f-e437c32e8965 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:21.998957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f2052-1661-4c0c-a55f-e437c32e8965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:22.000885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f2052-1661-4c0c-a55f-e437c32e8965 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:22.058396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524087c8-4665-4dd9-929d-7f7ea1e2927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:22.059141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524087c8-4665-4dd9-929d-7f7ea1e2927c admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:22.060275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524087c8-4665-4dd9-929d-7f7ea1e2927c admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:22.060570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524087c8-4665-4dd9-929d-7f7ea1e2927c admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:22.062316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524087c8-4665-4dd9-929d-7f7ea1e2927c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:22.063958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524087c8-4665-4dd9-929d-7f7ea1e2927c admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:22.075395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 869/1768] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:29:22.079825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524087c8-4665-4dd9-929d-7f7ea1e2927c admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:22.117980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524087c8-4665-4dd9-929d-7f7ea1e2927c admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:22.125191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d43892-22d1-47b7-a77b-8d1a2fd83b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:22.126477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d43892-22d1-47b7-a77b-8d1a2fd83b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:22.126873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 900/1769] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:21 2022] POST /identity/v3/users => generated 285 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:29:22.127248 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d43892-22d1-47b7-a77b-8d1a2fd83b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:22.127544 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d43892-22d1-47b7-a77b-8d1a2fd83b94 admin admin] PATH_INFO: `/v3/projects/f3ab1c6752b04dd1b4ad6d24118edf74/users/96b157ffa2904f09827f30be37ac1cda/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:22.130177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d43892-22d1-47b7-a77b-8d1a2fd83b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ab1c6752b04dd1b4ad6d24118edf74, user_id=96b157ffa2904f09827f30be37ac1cda, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:22.131280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f2052-1661-4c0c-a55f-e437c32e8965 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:22.135163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d43892-22d1-47b7-a77b-8d1a2fd83b94 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:22.156679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:22.184167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f2052-1661-4c0c-a55f-e437c32e8965 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:22.197620 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 870/1770] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:22 2022] PUT /identity/v3/projects/f3ab1c6752b04dd1b4ad6d24118edf74/users/96b157ffa2904f09827f30be37ac1cda/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:22.198794 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d43892-22d1-47b7-a77b-8d1a2fd83b94 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:22.220338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-92d43892-22d1-47b7-a77b-8d1a2fd83b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:22.300371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d817da-a681-4bc2-9f6a-1b1f9a04bd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:22.303020 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d817da-a681-4bc2-9f6a-1b1f9a04bd6d admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:22.303319 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d817da-a681-4bc2-9f6a-1b1f9a04bd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:22.303605 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d817da-a681-4bc2-9f6a-1b1f9a04bd6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:22.307551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d817da-a681-4bc2-9f6a-1b1f9a04bd6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:22.311005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d817da-a681-4bc2-9f6a-1b1f9a04bd6d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:22.354121 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d43892-22d1-47b7-a77b-8d1a2fd83b94 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:22.359290 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801afad-705a-4421-9b29-c229b74f625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:22.360164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801afad-705a-4421-9b29-c229b74f625e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:22.360619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801afad-705a-4421-9b29-c229b74f625e admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:22.360897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801afad-705a-4421-9b29-c229b74f625e admin admin] PATH_INFO: `/v3/projects/cef9bf8203fa4effac8cdbce7e07d038` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:22.362199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801afad-705a-4421-9b29-c229b74f625e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef9bf8203fa4effac8cdbce7e07d038)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:22.364132 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801afad-705a-4421-9b29-c229b74f625e admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:22.371480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 901/1771] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:22.372930 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c913f-5b7f-4a1a-b600-96ad45fe9b52 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:22.375476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c913f-5b7f-4a1a-b600-96ad45fe9b52 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:22.376278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c913f-5b7f-4a1a-b600-96ad45fe9b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:22.442897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-518c913f-5b7f-4a1a-b600-96ad45fe9b52 None None] MFA Rules not processed for user `96b157ffa2904f09827f30be37ac1cda`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:22.444318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-518c913f-5b7f-4a1a-b600-96ad45fe9b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:22.575566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a801afad-705a-4421-9b29-c229b74f625e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef9bf8203fa4effac8cdbce7e07d038', 'request_id': 'req-a801afad-705a-4421-9b29-c229b74f625e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:22.652569 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a801afad-705a-4421-9b29-c229b74f625e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef9bf8203fa4effac8cdbce7e07d038', 'request_id': 'req-a801afad-705a-4421-9b29-c229b74f625e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:22.673509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a801afad-705a-4421-9b29-c229b74f625e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef9bf8203fa4effac8cdbce7e07d038', 'request_id': 'req-a801afad-705a-4421-9b29-c229b74f625e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:22.675062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 902/1772] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:22.676865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c913f-5b7f-4a1a-b600-96ad45fe9b52 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:22.718892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a801afad-705a-4421-9b29-c229b74f625e admin admin] The token cache is being invalidate because project cef9bf8203fa4effac8cdbce7e07d038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:22.723600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a801afad-705a-4421-9b29-c229b74f625e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:22.728172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a801afad-705a-4421-9b29-c229b74f625e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:22.733732 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 871/1773] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:22 2022] DELETE /identity/v3/projects/cef9bf8203fa4effac8cdbce7e07d038 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:22.734652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c913f-5b7f-4a1a-b600-96ad45fe9b52 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:22.753050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2bb76-ea1b-4860-ae06-897ad91000a4 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:22.753050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2bb76-ea1b-4860-ae06-897ad91000a4 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:22.753050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2bb76-ea1b-4860-ae06-897ad91000a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:22.799033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-dbc2bb76-ea1b-4860-ae06-897ad91000a4 None None] MFA Rules not processed for user `071dc15e85a849afa9b9663f7e5f428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:22.800754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-dbc2bb76-ea1b-4860-ae06-897ad91000a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:22.957996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3aa078-14b4-4c7b-b917-5c1da0b12d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:22.958737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aa078-14b4-4c7b-b917-5c1da0b12d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:22.959127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aa078-14b4-4c7b-b917-5c1da0b12d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:22.959483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aa078-14b4-4c7b-b917-5c1da0b12d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:22.960709 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3aa078-14b4-4c7b-b917-5c1da0b12d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:22.961104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 872/1774] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:22.962177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2bb76-ea1b-4860-ae06-897ad91000a4 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:22.962500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3aa078-14b4-4c7b-b917-5c1da0b12d22 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:22.963610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-dbc2bb76-ea1b-4860-ae06-897ad91000a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:22.980557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 903/1775] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:22.983111 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff7e60-9e4e-4ad0-b67b-ee71a05407fa None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:22.983883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff7e60-9e4e-4ad0-b67b-ee71a05407fa None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:22.984166 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff7e60-9e4e-4ad0-b67b-ee71a05407fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:23.020586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-3dff7e60-9e4e-4ad0-b67b-ee71a05407fa None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:23.022712 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3dff7e60-9e4e-4ad0-b67b-ee71a05407fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:23.034483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 904/1776] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:23.036158 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff7e60-9e4e-4ad0-b67b-ee71a05407fa None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:23.037788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3dff7e60-9e4e-4ad0-b67b-ee71a05407fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:23.040606 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2bb76-ea1b-4860-ae06-897ad91000a4 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:23.045582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22864dc9-7dab-402f-8ca9-276475787259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:23.046915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22864dc9-7dab-402f-8ca9-276475787259 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:23.047559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22864dc9-7dab-402f-8ca9-276475787259 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:23.047783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22864dc9-7dab-402f-8ca9-276475787259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:23.050670 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-22864dc9-7dab-402f-8ca9-276475787259 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:23.057790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff7e60-9e4e-4ad0-b67b-ee71a05407fa None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:23.070605 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d2e91-2f60-434a-abc9-0b0c216a9ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:23.072750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d2e91-2f60-434a-abc9-0b0c216a9ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:23.073034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d2e91-2f60-434a-abc9-0b0c216a9ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:23.073465 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d2e91-2f60-434a-abc9-0b0c216a9ff9 admin admin] PATH_INFO: `/v3/projects/894b923578ef45bfbdaa05fe8b1926d4/users/19ac5625ecaf491d83465bcb56a8e356/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:23.117031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d2e91-2f60-434a-abc9-0b0c216a9ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=894b923578ef45bfbdaa05fe8b1926d4, user_id=19ac5625ecaf491d83465bcb56a8e356, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:23.119787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d2e91-2f60-434a-abc9-0b0c216a9ff9 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:23.166010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:23.182985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22864dc9-7dab-402f-8ca9-276475787259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:23.186165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22864dc9-7dab-402f-8ca9-276475787259 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:23.201910 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 873/1777] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:23.204081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2f3ff-bc54-42d7-b46c-d12bbea7ddbe None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:23.204377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2f3ff-bc54-42d7-b46c-d12bbea7ddbe None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:23.204655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2f3ff-bc54-42d7-b46c-d12bbea7ddbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:23.216879 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 905/1778] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:23 2022] PUT /identity/v3/projects/894b923578ef45bfbdaa05fe8b1926d4/users/19ac5625ecaf491d83465bcb56a8e356/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:23.227611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9cd65-2ea6-4ade-b657-1c2c8c662c67 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:23.228643 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9cd65-2ea6-4ade-b657-1c2c8c662c67 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:23.229937 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9cd65-2ea6-4ade-b657-1c2c8c662c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:23.285004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-0bd2f3ff-bc54-42d7-b46c-d12bbea7ddbe None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:23.286358 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0bd2f3ff-bc54-42d7-b46c-d12bbea7ddbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:23.317995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-39c9cd65-2ea6-4ade-b657-1c2c8c662c67 None None] MFA Rules not processed for user `19ac5625ecaf491d83465bcb56a8e356`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:23.319228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-39c9cd65-2ea6-4ade-b657-1c2c8c662c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:23.408719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 906/1779] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:23.427691 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9cd65-2ea6-4ade-b657-1c2c8c662c67 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:23.441985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 874/1780] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:23.446426 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2f3ff-bc54-42d7-b46c-d12bbea7ddbe None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:23.463600 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9cd65-2ea6-4ade-b657-1c2c8c662c67 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:23.468073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2f3ff-bc54-42d7-b46c-d12bbea7ddbe None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:23.480987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ef82d-0199-4b0e-8393-418d50a15b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:23.481280 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ef82d-0199-4b0e-8393-418d50a15b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:23.484916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ef82d-0199-4b0e-8393-418d50a15b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:23.484916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ef82d-0199-4b0e-8393-418d50a15b58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:23.485147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45aa31-c833-47eb-8160-f162d454ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:23.485255 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45aa31-c833-47eb-8160-f162d454ad1a admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:23.485583 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45aa31-c833-47eb-8160-f162d454ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:23.487121 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ef82d-0199-4b0e-8393-418d50a15b58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:29:23.487573 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45aa31-c833-47eb-8160-f162d454ad1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:23.488046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ef82d-0199-4b0e-8393-418d50a15b58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:23.488431 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45aa31-c833-47eb-8160-f162d454ad1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:23.491418 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45aa31-c833-47eb-8160-f162d454ad1a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:23.491886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ef82d-0199-4b0e-8393-418d50a15b58 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:23.527331 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 875/1781] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:29:23.528404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ef82d-0199-4b0e-8393-418d50a15b58 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:23.616777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 907/1782] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:23 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:23.616777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45aa31-c833-47eb-8160-f162d454ad1a admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:23.635381 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ef82d-0199-4b0e-8393-418d50a15b58 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:23.756576 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45aa31-c833-47eb-8160-f162d454ad1a admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:23.757866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30269fc5-9b99-4be9-80d0-ccf2f8bb7097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:23.760049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30269fc5-9b99-4be9-80d0-ccf2f8bb7097 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:23.762279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30269fc5-9b99-4be9-80d0-ccf2f8bb7097 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:23.763795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30269fc5-9b99-4be9-80d0-ccf2f8bb7097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:23.768574 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-30269fc5-9b99-4be9-80d0-ccf2f8bb7097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:23.771770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed87074-5406-40d8-99ce-d00a8ca026e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:23.773213 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed87074-5406-40d8-99ce-d00a8ca026e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:23.774291 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed87074-5406-40d8-99ce-d00a8ca026e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:23.774893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed87074-5406-40d8-99ce-d00a8ca026e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:23.777441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed87074-5406-40d8-99ce-d00a8ca026e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:23.783193 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed87074-5406-40d8-99ce-d00a8ca026e2 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:23.867004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30269fc5-9b99-4be9-80d0-ccf2f8bb7097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:23.868800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30269fc5-9b99-4be9-80d0-ccf2f8bb7097 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:23.897535 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 876/1783] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:23 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:23.899125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30269fc5-9b99-4be9-80d0-ccf2f8bb7097 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:23.927400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30269fc5-9b99-4be9-80d0-ccf2f8bb7097 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:23.946131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a743f3d-a6d4-429c-8653-86924ec8aecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:23.947045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a743f3d-a6d4-429c-8653-86924ec8aecf admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:23.950011 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a743f3d-a6d4-429c-8653-86924ec8aecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:23.950310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a743f3d-a6d4-429c-8653-86924ec8aecf admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:23.951032 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a743f3d-a6d4-429c-8653-86924ec8aecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:23.956868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 908/1784] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:23 2022] POST /identity/v3/projects => generated 377 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:23.958697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a743f3d-a6d4-429c-8653-86924ec8aecf admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:23.960570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed87074-5406-40d8-99ce-d00a8ca026e2 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:24.119557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 877/1785] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:23 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:24.121971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a743f3d-a6d4-429c-8653-86924ec8aecf admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:24.129314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed87074-5406-40d8-99ce-d00a8ca026e2 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:24.138283 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc07ac8-1c2c-4837-8f3b-5ae05f548660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:24.138990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc07ac8-1c2c-4837-8f3b-5ae05f548660 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:24.139282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc07ac8-1c2c-4837-8f3b-5ae05f548660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:24.139566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc07ac8-1c2c-4837-8f3b-5ae05f548660 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:24.143268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc07ac8-1c2c-4837-8f3b-5ae05f548660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:24.143268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc07ac8-1c2c-4837-8f3b-5ae05f548660 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:24.165901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a743f3d-a6d4-429c-8653-86924ec8aecf admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:24.184165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81fb5f-df30-4cd3-af46-de240af8e05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:24.186795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81fb5f-df30-4cd3-af46-de240af8e05f admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:24.190827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81fb5f-df30-4cd3-af46-de240af8e05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:24.215940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81fb5f-df30-4cd3-af46-de240af8e05f admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:24.219145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81fb5f-df30-4cd3-af46-de240af8e05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:24.234376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81fb5f-df30-4cd3-af46-de240af8e05f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:24.292160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 878/1786] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:24.293915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81fb5f-df30-4cd3-af46-de240af8e05f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:24.305814 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81fb5f-df30-4cd3-af46-de240af8e05f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:24.313187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f53eb-b9b1-4855-9e91-ff2c770ce5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:24.313187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f53eb-b9b1-4855-9e91-ff2c770ce5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:24.313187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f53eb-b9b1-4855-9e91-ff2c770ce5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:24.313477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f53eb-b9b1-4855-9e91-ff2c770ce5fd admin admin] PATH_INFO: `/v3/projects/2221ab11be4a41a09c7091ab1c0dee0c/users/93a875f0ffb64839930dc1e831c21c6b/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:24.348415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f53eb-b9b1-4855-9e91-ff2c770ce5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2221ab11be4a41a09c7091ab1c0dee0c, user_id=93a875f0ffb64839930dc1e831c21c6b, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:24.352517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f53eb-b9b1-4855-9e91-ff2c770ce5fd admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:24.373779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 909/1787] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:23 2022] POST /identity/v3/users => generated 289 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:24.374920 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc07ac8-1c2c-4837-8f3b-5ae05f548660 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:24.395683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc07ac8-1c2c-4837-8f3b-5ae05f548660 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:24.403590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e10fd-7916-4d17-bc58-ea859c8f6e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:24.404682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e10fd-7916-4d17-bc58-ea859c8f6e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:24.405161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e10fd-7916-4d17-bc58-ea859c8f6e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:24.406080 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e10fd-7916-4d17-bc58-ea859c8f6e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:24.406736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e10fd-7916-4d17-bc58-ea859c8f6e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:24.410514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e10fd-7916-4d17-bc58-ea859c8f6e02 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:24.430286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 910/1788] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:29:24.435857 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e10fd-7916-4d17-bc58-ea859c8f6e02 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:24.484343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e10fd-7916-4d17-bc58-ea859c8f6e02 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:24.494686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494cfe7-44c6-4ee8-8240-44b85510dbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:24.495737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494cfe7-44c6-4ee8-8240-44b85510dbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:24.496166 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494cfe7-44c6-4ee8-8240-44b85510dbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:24.496638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494cfe7-44c6-4ee8-8240-44b85510dbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:24.498330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494cfe7-44c6-4ee8-8240-44b85510dbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:24.500170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494cfe7-44c6-4ee8-8240-44b85510dbf1 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:24.518911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 879/1789] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:24 2022] PUT /identity/v3/projects/2221ab11be4a41a09c7091ab1c0dee0c/users/93a875f0ffb64839930dc1e831c21c6b/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:24.522959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f53eb-b9b1-4855-9e91-ff2c770ce5fd admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:24.539129 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 911/1790] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:24.542398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494cfe7-44c6-4ee8-8240-44b85510dbf1 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:24.555926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494cfe7-44c6-4ee8-8240-44b85510dbf1 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:24.663214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f53eb-b9b1-4855-9e91-ff2c770ce5fd admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:24.700103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d9dae-96fe-4852-a3ef-e50ff823f904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:24.701366 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9dae-96fe-4852-a3ef-e50ff823f904 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:24.702009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b87858-5572-441a-9317-b1c45d612cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:24.702716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9dae-96fe-4852-a3ef-e50ff823f904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:24.703394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9dae-96fe-4852-a3ef-e50ff823f904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:24.704303 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d9dae-96fe-4852-a3ef-e50ff823f904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:24.705177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b87858-5572-441a-9317-b1c45d612cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:24.706174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d9dae-96fe-4852-a3ef-e50ff823f904 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:24.708115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b87858-5572-441a-9317-b1c45d612cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:24.709170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b87858-5572-441a-9317-b1c45d612cb8 admin admin] PATH_INFO: `/v3/projects/80b924ae92ed4b9e9ab3d43becec85bd/users/6661157880084493baf834969c9dbaf5/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:24.719133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 880/1791] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:29:24.728000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d9dae-96fe-4852-a3ef-e50ff823f904 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:24.754051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b87858-5572-441a-9317-b1c45d612cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b924ae92ed4b9e9ab3d43becec85bd, user_id=6661157880084493baf834969c9dbaf5, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:24.757319 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b87858-5572-441a-9317-b1c45d612cb8 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:24.767669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d9dae-96fe-4852-a3ef-e50ff823f904 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:24.777762 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3846d85-3e81-40b1-9e0a-ba7157abc200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:24.778680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3846d85-3e81-40b1-9e0a-ba7157abc200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:24.778963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3846d85-3e81-40b1-9e0a-ba7157abc200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:24.779238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3846d85-3e81-40b1-9e0a-ba7157abc200 admin admin] PATH_INFO: `/v3/projects/2221ab11be4a41a09c7091ab1c0dee0c/users/93a875f0ffb64839930dc1e831c21c6b/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:24.782813 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3846d85-3e81-40b1-9e0a-ba7157abc200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2221ab11be4a41a09c7091ab1c0dee0c, user_id=93a875f0ffb64839930dc1e831c21c6b, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:24.787707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3846d85-3e81-40b1-9e0a-ba7157abc200 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:24.813150 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 881/1792] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:24 2022] PUT /identity/v3/projects/2221ab11be4a41a09c7091ab1c0dee0c/users/93a875f0ffb64839930dc1e831c21c6b/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:24.825013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d248e5c-eb33-46ee-873c-c58e312bcbd2 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:24.825380 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d248e5c-eb33-46ee-873c-c58e312bcbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:24.825602 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d248e5c-eb33-46ee-873c-c58e312bcbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:24.871159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 912/1793] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:24 2022] PUT /identity/v3/projects/80b924ae92ed4b9e9ab3d43becec85bd/users/6661157880084493baf834969c9dbaf5/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:24.874632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edce7c1-d455-435d-b5c5-73804963cf78 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:24.875017 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edce7c1-d455-435d-b5c5-73804963cf78 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:24.875393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edce7c1-d455-435d-b5c5-73804963cf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:24.892055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-3d248e5c-eb33-46ee-873c-c58e312bcbd2 None None] MFA Rules not processed for user `93a875f0ffb64839930dc1e831c21c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:24.894229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3d248e5c-eb33-46ee-873c-c58e312bcbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:24.966073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-9edce7c1-d455-435d-b5c5-73804963cf78 None None] MFA Rules not processed for user `6661157880084493baf834969c9dbaf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:24.967561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9edce7c1-d455-435d-b5c5-73804963cf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:25.088279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 882/1794] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:25.098121 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d248e5c-eb33-46ee-873c-c58e312bcbd2 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:25.118753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 913/1795] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:25.137918 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edce7c1-d455-435d-b5c5-73804963cf78 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:25.139371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9edce7c1-d455-435d-b5c5-73804963cf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:25.142683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:25.215893 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d248e5c-eb33-46ee-873c-c58e312bcbd2 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:25.224954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e8dd9-6981-4e72-8879-3eb160244e74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:25.228599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e8dd9-6981-4e72-8879-3eb160244e74 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:25.228599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e8dd9-6981-4e72-8879-3eb160244e74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:25.228801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e8dd9-6981-4e72-8879-3eb160244e74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:25.262230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e8dd9-6981-4e72-8879-3eb160244e74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:25.263688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e8dd9-6981-4e72-8879-3eb160244e74 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:25.293223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 883/1796] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:25.295505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edce7c1-d455-435d-b5c5-73804963cf78 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:25.308674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de162c-2aa5-4265-a8f4-5246d253e136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:25.309392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de162c-2aa5-4265-a8f4-5246d253e136 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:25.309844 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de162c-2aa5-4265-a8f4-5246d253e136 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:25.314040 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de162c-2aa5-4265-a8f4-5246d253e136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:25.331411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de162c-2aa5-4265-a8f4-5246d253e136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:25.333044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de162c-2aa5-4265-a8f4-5246d253e136 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:25.364025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 914/1797] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:29:25.567097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e8dd9-6981-4e72-8879-3eb160244e74 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:25.578699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e8dd9-6981-4e72-8879-3eb160244e74 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:25.586316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf420b-91f3-475c-9a8d-e9cf094caf72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:25.588924 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf420b-91f3-475c-9a8d-e9cf094caf72 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:25.589252 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf420b-91f3-475c-9a8d-e9cf094caf72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:25.589542 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf420b-91f3-475c-9a8d-e9cf094caf72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:25.790327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf420b-91f3-475c-9a8d-e9cf094caf72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:25.793104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf420b-91f3-475c-9a8d-e9cf094caf72 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:25.809153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 884/1798] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:26.164009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:26.793224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f9e16-babc-4ec4-b0d2-7101c1bb060d None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:26.793535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f9e16-babc-4ec4-b0d2-7101c1bb060d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:26.793804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f9e16-babc-4ec4-b0d2-7101c1bb060d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:26.934452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-f01f9e16-babc-4ec4-b0d2-7101c1bb060d None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:26.949104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f01f9e16-babc-4ec4-b0d2-7101c1bb060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:27.119777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:27.175494 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 915/1799] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:29:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:27.498796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf420b-91f3-475c-9a8d-e9cf094caf72 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:27.500395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-efbf420b-91f3-475c-9a8d-e9cf094caf72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:27.871425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf420b-91f3-475c-9a8d-e9cf094caf72 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:27.896049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd43f8-85e8-4988-9e36-8f34cb750726 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:27.896745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd43f8-85e8-4988-9e36-8f34cb750726 service swift] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:27.897035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd43f8-85e8-4988-9e36-8f34cb750726 service swift] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:27.897346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd43f8-85e8-4988-9e36-8f34cb750726 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:27.936272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd43f8-85e8-4988-9e36-8f34cb750726 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:27.938185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd43f8-85e8-4988-9e36-8f34cb750726 service swift] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:28.010363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 885/1800] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:29:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:29:28.186897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:28.660520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fbf40-3304-424a-a33f-bc330e7c15da None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:28.660824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fbf40-3304-424a-a33f-bc330e7c15da None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:28.661146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fbf40-3304-424a-a33f-bc330e7c15da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:28.715450 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-161fbf40-3304-424a-a33f-bc330e7c15da None None] MFA Rules not processed for user `f6a4da4c1dca40f5bb5d158a6f33d9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:28.717063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-161fbf40-3304-424a-a33f-bc330e7c15da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:28.866729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 916/1801] 10.222.0.61 () {58 vars in 1015 bytes} [Tue Jul 12 16:29:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:28.917032 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd43f8-85e8-4988-9e36-8f34cb750726 service swift] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:28.918894 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5abd43f8-85e8-4988-9e36-8f34cb750726 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:28.941968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fbf40-3304-424a-a33f-bc330e7c15da None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:28.948720 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-161fbf40-3304-424a-a33f-bc330e7c15da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:28.949990 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd43f8-85e8-4988-9e36-8f34cb750726 service swift] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:28.956961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8804a-aea4-43b2-b1f0-38fd5d8a973d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:28.957832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8804a-aea4-43b2-b1f0-38fd5d8a973d service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:28.958300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8804a-aea4-43b2-b1f0-38fd5d8a973d service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:28.958907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8804a-aea4-43b2-b1f0-38fd5d8a973d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:28.963320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fbf40-3304-424a-a33f-bc330e7c15da None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:28.971460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5efe64-a6d2-4253-84f4-1edf319afbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:28.971460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5efe64-a6d2-4253-84f4-1edf319afbaf service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:28.971460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5efe64-a6d2-4253-84f4-1edf319afbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:28.971460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5efe64-a6d2-4253-84f4-1edf319afbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:28.983376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5efe64-a6d2-4253-84f4-1edf319afbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:28.985394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5efe64-a6d2-4253-84f4-1edf319afbaf service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:28.989373 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8804a-aea4-43b2-b1f0-38fd5d8a973d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:28.991232 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8804a-aea4-43b2-b1f0-38fd5d8a973d service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:29.004210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 917/1802] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:29.025540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 886/1803] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:29.592505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:30.668433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5efe64-a6d2-4253-84f4-1edf319afbaf service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:30.670370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ac5efe64-a6d2-4253-84f4-1edf319afbaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:30.882544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5efe64-a6d2-4253-84f4-1edf319afbaf service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:30.902035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:30.902968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:30.903258 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:30.903539 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] PATH_INFO: `/v3/users/629c74b87b494fa3ad20d4bdee9164b1` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:30.904881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] RBAC: Authorizing `identity:delete_user(user_id=629c74b87b494fa3ad20d4bdee9164b1)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:30.906941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:31.062776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:31.184069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629c74b87b494fa3ad20d4bdee9164b1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:31.299137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629c74b87b494fa3ad20d4bdee9164b1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:31.300006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629c74b87b494fa3ad20d4bdee9164b1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:31.319393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629c74b87b494fa3ad20d4bdee9164b1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:31.342129 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629c74b87b494fa3ad20d4bdee9164b1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:31.369784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 918/1804] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:30 2022] DELETE /identity/v3/users/629c74b87b494fa3ad20d4bdee9164b1 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:31.375192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdedba6-593c-40f2-8b20-21b5eaee4273 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:31.375697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdedba6-593c-40f2-8b20-21b5eaee4273 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:31.375792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdedba6-593c-40f2-8b20-21b5eaee4273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:31.433590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-dfdedba6-593c-40f2-8b20-21b5eaee4273 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:31.438143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-dfdedba6-593c-40f2-8b20-21b5eaee4273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:31.656425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:31.684310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 887/1805] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:31.780032 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:31.784594 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:31.911444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70f706-7657-452c-8335-76bc2b49abae admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:31.921561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4a0d1-1dff-4379-9c4d-dceffa64d367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:31.924477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4a0d1-1dff-4379-9c4d-dceffa64d367 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:31.925054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4a0d1-1dff-4379-9c4d-dceffa64d367 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:31.927731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4a0d1-1dff-4379-9c4d-dceffa64d367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:31.983256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4a0d1-1dff-4379-9c4d-dceffa64d367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:31.987419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4a0d1-1dff-4379-9c4d-dceffa64d367 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:32.008798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 919/1806] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:32.332649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:33.065336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:33.241394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b3046-0441-4df0-9e2c-df261a72aae4 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:33.241684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b3046-0441-4df0-9e2c-df261a72aae4 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:33.242300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b3046-0441-4df0-9e2c-df261a72aae4 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:33.244339 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 888/1807] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:29:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:29:33.262535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd77880-efd5-4c0c-8e8a-8d25268b275a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:33.262535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd77880-efd5-4c0c-8e8a-8d25268b275a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:33.262535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd77880-efd5-4c0c-8e8a-8d25268b275a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:33.324852 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-1bd77880-efd5-4c0c-8e8a-8d25268b275a None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:33.329748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1bd77880-efd5-4c0c-8e8a-8d25268b275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:33.535792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 920/1808] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:29:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:33.745477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa70c6d-81e6-403d-a937-6bfb3a86668d None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:33.746961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa70c6d-81e6-403d-a937-6bfb3a86668d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:33.747647 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa70c6d-81e6-403d-a937-6bfb3a86668d None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:33.753369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 889/1809] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:29:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:29:33.806113 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f84a9b-c4a6-4a99-9f82-4150ef904529 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:33.806405 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f84a9b-c4a6-4a99-9f82-4150ef904529 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:33.806684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f84a9b-c4a6-4a99-9f82-4150ef904529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:33.861424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-b6f84a9b-c4a6-4a99-9f82-4150ef904529 None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:33.862788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b6f84a9b-c4a6-4a99-9f82-4150ef904529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:33.893696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 921/1810] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:29:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:34.185623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:34.308359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa70c6d-81e6-403d-a937-6bfb3a86668d None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:34.310893 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0aa70c6d-81e6-403d-a937-6bfb3a86668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:34.342584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa70c6d-81e6-403d-a937-6bfb3a86668d None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:34.356056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53b772-9bc0-417e-a2b8-33e172382705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:34.358703 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53b772-9bc0-417e-a2b8-33e172382705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:34.359149 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53b772-9bc0-417e-a2b8-33e172382705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:34.359642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53b772-9bc0-417e-a2b8-33e172382705 admin admin] PATH_INFO: `/v3/users/e080b25e25de45559babadc8c5bf4f18` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:34.366916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53b772-9bc0-417e-a2b8-33e172382705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e080b25e25de45559babadc8c5bf4f18)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:34.366916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53b772-9bc0-417e-a2b8-33e172382705 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:34.388391 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f84a9b-c4a6-4a99-9f82-4150ef904529 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:34.389874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b6f84a9b-c4a6-4a99-9f82-4150ef904529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:34.439794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f84a9b-c4a6-4a99-9f82-4150ef904529 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:34.453768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:34.455192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:34.461039 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:34.461561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] PATH_INFO: `/v3/users/19ac5625ecaf491d83465bcb56a8e356` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:34.463098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ac5625ecaf491d83465bcb56a8e356)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:34.465530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:34.743394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ac5625ecaf491d83465bcb56a8e356'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:34.748143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fd53b772-9bc0-417e-a2b8-33e172382705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e080b25e25de45559babadc8c5bf4f18'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:34.831736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ac5625ecaf491d83465bcb56a8e356'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:34.833002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ac5625ecaf491d83465bcb56a8e356'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:34.887275 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ac5625ecaf491d83465bcb56a8e356'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:34.888880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fd53b772-9bc0-417e-a2b8-33e172382705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e080b25e25de45559babadc8c5bf4f18'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:34.916594 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ac5625ecaf491d83465bcb56a8e356'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:34.927622 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fd53b772-9bc0-417e-a2b8-33e172382705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e080b25e25de45559babadc8c5bf4f18'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:34.930105 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 922/1811] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:34 2022] DELETE /identity/v3/users/19ac5625ecaf491d83465bcb56a8e356 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:29:34.932281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:34.933737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fd53b772-9bc0-417e-a2b8-33e172382705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e080b25e25de45559babadc8c5bf4f18'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:34.935111 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:34.948681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fd53b772-9bc0-417e-a2b8-33e172382705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e080b25e25de45559babadc8c5bf4f18'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:34.965063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 890/1812] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:34 2022] DELETE /identity/v3/users/e080b25e25de45559babadc8c5bf4f18 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:34.974359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e5cb5-9e29-4a60-a54c-8927ba84908a None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:34.975097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e5cb5-9e29-4a60-a54c-8927ba84908a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:34.975592 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e5cb5-9e29-4a60-a54c-8927ba84908a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:35.028317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-980e5cb5-9e29-4a60-a54c-8927ba84908a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:35.029831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-980e5cb5-9e29-4a60-a54c-8927ba84908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:35.196493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 891/1813] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:35.198598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf1d65-2b21-46ad-afba-aa1dae047709 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:35.200220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf1d65-2b21-46ad-afba-aa1dae047709 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:35.201583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf1d65-2b21-46ad-afba-aa1dae047709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:35.242342 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382c15b-074f-4603-8d34-89bddd0aca8c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:35.251811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-6aaf1d65-2b21-46ad-afba-aa1dae047709 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:35.251811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6aaf1d65-2b21-46ad-afba-aa1dae047709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:35.280521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 892/1814] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:35.352217 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf1d65-2b21-46ad-afba-aa1dae047709 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:35.353799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6aaf1d65-2b21-46ad-afba-aa1dae047709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:35.388237 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2c81f-e85f-43b1-b4ac-3cd46c6951ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:35.389996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c81f-e85f-43b1-b4ac-3cd46c6951ce service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:35.391520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c81f-e85f-43b1-b4ac-3cd46c6951ce service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:35.391957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c81f-e85f-43b1-b4ac-3cd46c6951ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:35.419297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-dde2c81f-e85f-43b1-b4ac-3cd46c6951ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:35.431443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2c81f-e85f-43b1-b4ac-3cd46c6951ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:35.433593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2c81f-e85f-43b1-b4ac-3cd46c6951ce service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:35.449272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 923/1815] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:35.450404 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2c81f-e85f-43b1-b4ac-3cd46c6951ce service nova] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:35.452056 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-dde2c81f-e85f-43b1-b4ac-3cd46c6951ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:35.468704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2c81f-e85f-43b1-b4ac-3cd46c6951ce service nova] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:35.482586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:35.482586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:35.482586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:35.482586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] PATH_INFO: `/v3/projects/557b325041f140889e2f7b0104595489` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:35.486590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=557b325041f140889e2f7b0104595489)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:35.491529 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:35.551107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf1d65-2b21-46ad-afba-aa1dae047709 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:35.561518 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b1115-ce13-46f1-b396-b50b8c21d885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:35.567619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b1115-ce13-46f1-b396-b50b8c21d885 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:35.567619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b1115-ce13-46f1-b396-b50b8c21d885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:35.567619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b1115-ce13-46f1-b396-b50b8c21d885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:35.584057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b1115-ce13-46f1-b396-b50b8c21d885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:35.588210 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b1115-ce13-46f1-b396-b50b8c21d885 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:35.629196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 893/1816] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:29:35.631806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b1115-ce13-46f1-b396-b50b8c21d885 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:35.645756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557b325041f140889e2f7b0104595489', 'request_id': 'req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:35.652938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b1115-ce13-46f1-b396-b50b8c21d885 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:35.728595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557b325041f140889e2f7b0104595489', 'request_id': 'req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:35.732219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:35.737790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557b325041f140889e2f7b0104595489', 'request_id': 'req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:35.763063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] The token cache is being invalidate because project 557b325041f140889e2f7b0104595489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:35.763365 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:35.765170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:35.767338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 924/1817] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:35 2022] DELETE /identity/v3/projects/557b325041f140889e2f7b0104595489 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:35.768401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:35.771792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:35.776163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8084b-e5f5-47eb-91d3-b3cde5bff84a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:35.779341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8084b-e5f5-47eb-91d3-b3cde5bff84a service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:35.779842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8084b-e5f5-47eb-91d3-b3cde5bff84a service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:35.780274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8084b-e5f5-47eb-91d3-b3cde5bff84a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:35.785239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-81b8084b-e5f5-47eb-91d3-b3cde5bff84a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:35.824490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:35.937592 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8084b-e5f5-47eb-91d3-b3cde5bff84a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:35.940415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8084b-e5f5-47eb-91d3-b3cde5bff84a service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:35.947565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873f5f7-1d3c-460e-803a-b3b4cbfc3b2b admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:35.960452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fe282-3d12-40e6-8414-4b191a6b3cdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:35.963027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fe282-3d12-40e6-8414-4b191a6b3cdf service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:35.963551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fe282-3d12-40e6-8414-4b191a6b3cdf service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:35.965448 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fe282-3d12-40e6-8414-4b191a6b3cdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:35.969555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 894/1818] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:35.970843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f22fe282-3d12-40e6-8414-4b191a6b3cdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:35.972844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8084b-e5f5-47eb-91d3-b3cde5bff84a service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:35.976641 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-81b8084b-e5f5-47eb-91d3-b3cde5bff84a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:36.002152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fe282-3d12-40e6-8414-4b191a6b3cdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:36.005986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8084b-e5f5-47eb-91d3-b3cde5bff84a service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:36.007297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fe282-3d12-40e6-8414-4b191a6b3cdf service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:36.019938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:36.021373 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:36.021869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:36.022472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] PATH_INFO: `/v3/users/96b157ffa2904f09827f30be37ac1cda` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:36.025192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b157ffa2904f09827f30be37ac1cda)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:36.032835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:36.035470 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 925/1819] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:36.271180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b157ffa2904f09827f30be37ac1cda'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:36.374201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b157ffa2904f09827f30be37ac1cda'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:36.424993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b157ffa2904f09827f30be37ac1cda'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:36.426628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b157ffa2904f09827f30be37ac1cda'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:36.447445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b157ffa2904f09827f30be37ac1cda'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:36.479900 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 895/1820] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:35 2022] DELETE /identity/v3/users/96b157ffa2904f09827f30be37ac1cda => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:37.038926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:37.622648 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fe282-3d12-40e6-8414-4b191a6b3cdf service nova] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:37.624329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f22fe282-3d12-40e6-8414-4b191a6b3cdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:37.655182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fe282-3d12-40e6-8414-4b191a6b3cdf service nova] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:37.800333 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:37.805575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:37.808861 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:37.811293 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] PATH_INFO: `/v3/projects/894b923578ef45bfbdaa05fe8b1926d4` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:37.819177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=894b923578ef45bfbdaa05fe8b1926d4)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:37.822111 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:37.978960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:37.980543 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:37.987844 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894b923578ef45bfbdaa05fe8b1926d4', 'request_id': 'req-4e188790-24aa-488f-a153-a920c7a1c5aa'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:37.997591 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc348670-a7f7-45f0-a6b6-a7f74cf6f31c admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:38.105609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894b923578ef45bfbdaa05fe8b1926d4', 'request_id': 'req-4e188790-24aa-488f-a153-a920c7a1c5aa'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.114905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894b923578ef45bfbdaa05fe8b1926d4', 'request_id': 'req-4e188790-24aa-488f-a153-a920c7a1c5aa'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.149172 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] The token cache is being invalidate because project 894b923578ef45bfbdaa05fe8b1926d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:38.149483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.157635 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.159640 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:38.160746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:38.160967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:38.161290 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] PATH_INFO: `/v3/projects/748dc77e57314a35857eeac8cd29210b` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:38.163389 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 926/1821] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:37 2022] DELETE /identity/v3/projects/894b923578ef45bfbdaa05fe8b1926d4 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:38.166359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] RBAC: Authorizing `identity:delete_project(project_id=748dc77e57314a35857eeac8cd29210b)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:38.171676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:38.171782 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:38.174496 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:38.199370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e188790-24aa-488f-a153-a920c7a1c5aa admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:38.212204 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:38.213142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:38.213488 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:38.213815 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] PATH_INFO: `/v3/users/93a875f0ffb64839930dc1e831c21c6b` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:38.216699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a875f0ffb64839930dc1e831c21c6b)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:38.232309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:38.429182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:38.526680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748dc77e57314a35857eeac8cd29210b', 'request_id': 'req-35633c28-4e1f-43b3-9335-f6616294215c'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.529263 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a875f0ffb64839930dc1e831c21c6b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.614099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748dc77e57314a35857eeac8cd29210b', 'request_id': 'req-35633c28-4e1f-43b3-9335-f6616294215c'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.621724 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748dc77e57314a35857eeac8cd29210b', 'request_id': 'req-35633c28-4e1f-43b3-9335-f6616294215c'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.655274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] The token cache is being invalidate because project 748dc77e57314a35857eeac8cd29210b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:38.655567 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.664366 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.666689 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 896/1822] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:37 2022] DELETE /identity/v3/projects/748dc77e57314a35857eeac8cd29210b => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:29:38.670749 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:38.674598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:38.710999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a875f0ffb64839930dc1e831c21c6b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.711822 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a875f0ffb64839930dc1e831c21c6b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.735546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a875f0ffb64839930dc1e831c21c6b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.758774 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a875f0ffb64839930dc1e831c21c6b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:38.771817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 927/1823] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:38 2022] DELETE /identity/v3/users/93a875f0ffb64839930dc1e831c21c6b => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:38.772964 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:38.774539 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:38.810743 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35633c28-4e1f-43b3-9335-f6616294215c admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:38.904169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80916b1f-03b0-48ea-a325-6d32005bb2e6 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:38.914924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:38.915887 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:38.922544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:38.922544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] PATH_INFO: `/v3/users/c0b021bd70dd4f08bbe003affb516300` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:38.922544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b021bd70dd4f08bbe003affb516300)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:38.922544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:38.961058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:38.962112 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:38.962430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:38.963215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b admin admin] PATH_INFO: `/v3/projects/f3ab1c6752b04dd1b4ad6d24118edf74` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:38.966595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ab1c6752b04dd1b4ad6d24118edf74)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:38.968705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:39.199407 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ab1c6752b04dd1b4ad6d24118edf74', 'request_id': 'req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.210458 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b021bd70dd4f08bbe003affb516300'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.317992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ab1c6752b04dd1b4ad6d24118edf74', 'request_id': 'req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.329091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ab1c6752b04dd1b4ad6d24118edf74', 'request_id': 'req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.348373 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b admin admin] The token cache is being invalidate because project f3ab1c6752b04dd1b4ad6d24118edf74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:39.348683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.349861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a6bb57b9-f315-4537-956a-b3f9dec2ca1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.353277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 897/1824] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:38 2022] DELETE /identity/v3/projects/f3ab1c6752b04dd1b4ad6d24118edf74 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:39.360895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de31c62-56ea-4fbc-9cac-56201f30cfc8 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:39.360895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de31c62-56ea-4fbc-9cac-56201f30cfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:39.360895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de31c62-56ea-4fbc-9cac-56201f30cfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:39.401037 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-7de31c62-56ea-4fbc-9cac-56201f30cfc8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:39.403015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7de31c62-56ea-4fbc-9cac-56201f30cfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:39.440789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b021bd70dd4f08bbe003affb516300'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.441763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b021bd70dd4f08bbe003affb516300'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.469468 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b021bd70dd4f08bbe003affb516300'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.477911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b021bd70dd4f08bbe003affb516300'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.496966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 928/1825] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:38 2022] DELETE /identity/v3/users/c0b021bd70dd4f08bbe003affb516300 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:39.498159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:39.500847 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:39.563677 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 898/1826] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:39.573096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec048f0-38aa-4a4b-915d-5bead89129ee None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:39.573411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec048f0-38aa-4a4b-915d-5bead89129ee None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:39.573694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec048f0-38aa-4a4b-915d-5bead89129ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:39.598143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-2ec048f0-38aa-4a4b-915d-5bead89129ee None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:39.602521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2ec048f0-38aa-4a4b-915d-5bead89129ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:39.647067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80739bc2-f742-47a6-bbd2-0bf94670fd81 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:39.660646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:39.661584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:39.661862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:39.662253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f admin admin] PATH_INFO: `/v3/projects/2221ab11be4a41a09c7091ab1c0dee0c` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:39.663514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2221ab11be4a41a09c7091ab1c0dee0c)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:39.666706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:39.729753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 899/1827] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:39.736124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec048f0-38aa-4a4b-915d-5bead89129ee None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:39.747698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec048f0-38aa-4a4b-915d-5bead89129ee None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:39.756946 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52887ef1-6cee-4891-b4c4-65a20b47a3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:39.757705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52887ef1-6cee-4891-b4c4-65a20b47a3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:39.757991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52887ef1-6cee-4891-b4c4-65a20b47a3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:39.758275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52887ef1-6cee-4891-b4c4-65a20b47a3c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:39.759017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52887ef1-6cee-4891-b4c4-65a20b47a3c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:29:39.759324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52887ef1-6cee-4891-b4c4-65a20b47a3c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:39.760940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52887ef1-6cee-4891-b4c4-65a20b47a3c5 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:39.777172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 900/1828] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:29:39.781456 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52887ef1-6cee-4891-b4c4-65a20b47a3c5 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:39.798879 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2221ab11be4a41a09c7091ab1c0dee0c', 'request_id': 'req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.804965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52887ef1-6cee-4891-b4c4-65a20b47a3c5 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:39.914916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600d01a-11d4-44f5-a415-e3ca81e2c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:39.915168 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2221ab11be4a41a09c7091ab1c0dee0c', 'request_id': 'req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.915575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600d01a-11d4-44f5-a415-e3ca81e2c1ec admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:39.915868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600d01a-11d4-44f5-a415-e3ca81e2c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:39.916149 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600d01a-11d4-44f5-a415-e3ca81e2c1ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:39.916853 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600d01a-11d4-44f5-a415-e3ca81e2c1ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:39.919882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600d01a-11d4-44f5-a415-e3ca81e2c1ec admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:39.922667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2221ab11be4a41a09c7091ab1c0dee0c', 'request_id': 'req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.934611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f admin admin] The token cache is being invalidate because project 2221ab11be4a41a09c7091ab1c0dee0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:39.934902 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.935571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4bd7daa5-97b8-4f68-bb94-6c640c898a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:39.937174 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 929/1829] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:39 2022] DELETE /identity/v3/projects/2221ab11be4a41a09c7091ab1c0dee0c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:39.942608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf77c66-551c-40fc-bb5d-a6a16d6eef2b None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:39.942908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf77c66-551c-40fc-bb5d-a6a16d6eef2b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:39.943191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf77c66-551c-40fc-bb5d-a6a16d6eef2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.014064 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-bcf77c66-551c-40fc-bb5d-a6a16d6eef2b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:40.015473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bcf77c66-551c-40fc-bb5d-a6a16d6eef2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:40.026671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 901/1830] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:39 2022] POST /identity/v3/projects => generated 365 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:40.027881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600d01a-11d4-44f5-a415-e3ca81e2c1ec admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:40.031250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f600d01a-11d4-44f5-a415-e3ca81e2c1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:40.036687 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 930/1831] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:40.045866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:40.058956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b871f-80ce-48f4-a1b1-299ba93118f1 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.058956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b871f-80ce-48f4-a1b1-299ba93118f1 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.058956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b871f-80ce-48f4-a1b1-299ba93118f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.085400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-7f6b871f-80ce-48f4-a1b1-299ba93118f1 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:40.085400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-7f6b871f-80ce-48f4-a1b1-299ba93118f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:40.126008 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600d01a-11d4-44f5-a415-e3ca81e2c1ec admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:40.140080 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:40.152516 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903304f7-0f33-4fb7-8775-4507d3b81a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:40.153313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903304f7-0f33-4fb7-8775-4507d3b81a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.153681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903304f7-0f33-4fb7-8775-4507d3b81a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.154026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903304f7-0f33-4fb7-8775-4507d3b81a92 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.154798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903304f7-0f33-4fb7-8775-4507d3b81a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:40.156913 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903304f7-0f33-4fb7-8775-4507d3b81a92 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:40.184048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 931/1832] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:40.188041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b871f-80ce-48f4-a1b1-299ba93118f1 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:40.210559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b871f-80ce-48f4-a1b1-299ba93118f1 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:40.216367 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f30e8-cb56-4823-af72-299a97d1fb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:40.217260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f30e8-cb56-4823-af72-299a97d1fb91 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.217559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f30e8-cb56-4823-af72-299a97d1fb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.217841 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f30e8-cb56-4823-af72-299a97d1fb91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.218883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f30e8-cb56-4823-af72-299a97d1fb91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:29:40.219186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f30e8-cb56-4823-af72-299a97d1fb91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:40.223356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f30e8-cb56-4823-af72-299a97d1fb91 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:40.241968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 932/1833] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:29:40.241968 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f30e8-cb56-4823-af72-299a97d1fb91 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:40.252715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f30e8-cb56-4823-af72-299a97d1fb91 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:40.258274 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73670b11-4ba5-451d-b5f5-8be4824ab54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:40.259014 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73670b11-4ba5-451d-b5f5-8be4824ab54a admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.259324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73670b11-4ba5-451d-b5f5-8be4824ab54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.259642 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73670b11-4ba5-451d-b5f5-8be4824ab54a admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.260350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73670b11-4ba5-451d-b5f5-8be4824ab54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:40.262496 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73670b11-4ba5-451d-b5f5-8be4824ab54a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:40.278744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 902/1834] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:40 2022] POST /identity/v3/users => generated 283 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:40.279790 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903304f7-0f33-4fb7-8775-4507d3b81a92 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:40.293714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903304f7-0f33-4fb7-8775-4507d3b81a92 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:40.301722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb4846-51aa-408d-b606-b6bbaffbb5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:40.302795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb4846-51aa-408d-b606-b6bbaffbb5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.303412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb4846-51aa-408d-b606-b6bbaffbb5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.303912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb4846-51aa-408d-b606-b6bbaffbb5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.304850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb4846-51aa-408d-b606-b6bbaffbb5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:40.309560 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb4846-51aa-408d-b606-b6bbaffbb5e8 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:40.329230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 903/1835] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:40.330587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb4846-51aa-408d-b606-b6bbaffbb5e8 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:40.341811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb4846-51aa-408d-b606-b6bbaffbb5e8 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:40.349719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9fe02-6f62-4c07-a178-a73ce602d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:40.350648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9fe02-6f62-4c07-a178-a73ce602d4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.351050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9fe02-6f62-4c07-a178-a73ce602d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.351399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9fe02-6f62-4c07-a178-a73ce602d4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.353483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9fe02-6f62-4c07-a178-a73ce602d4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:40.358645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9fe02-6f62-4c07-a178-a73ce602d4e1 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:40.388316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 904/1836] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:40.389421 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9fe02-6f62-4c07-a178-a73ce602d4e1 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:40.401055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9fe02-6f62-4c07-a178-a73ce602d4e1 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:40.405967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782df7e-365e-4f44-afcc-3e032eae7f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:40.406923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782df7e-365e-4f44-afcc-3e032eae7f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.408359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782df7e-365e-4f44-afcc-3e032eae7f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.408645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782df7e-365e-4f44-afcc-3e032eae7f93 admin admin] PATH_INFO: `/v3/projects/ce7ad47398884b858a65ea6fd52a2ce6/users/3c6dd807429742cc8aa55e94f020cb1c/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.427472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782df7e-365e-4f44-afcc-3e032eae7f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7ad47398884b858a65ea6fd52a2ce6, user_id=3c6dd807429742cc8aa55e94f020cb1c, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:40.430282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782df7e-365e-4f44-afcc-3e032eae7f93 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:40.437194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 933/1837] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:40 2022] POST /identity/v3/projects => generated 409 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:40.442223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73670b11-4ba5-451d-b5f5-8be4824ab54a admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:40.507823 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73670b11-4ba5-451d-b5f5-8be4824ab54a admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:40.512731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f0e88-e20c-414f-9fb5-73eba3b91f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:40.513444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f0e88-e20c-414f-9fb5-73eba3b91f41 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.513735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f0e88-e20c-414f-9fb5-73eba3b91f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.514008 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f0e88-e20c-414f-9fb5-73eba3b91f41 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.514714 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f0e88-e20c-414f-9fb5-73eba3b91f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:40.516631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f0e88-e20c-414f-9fb5-73eba3b91f41 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:40.557558 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 905/1838] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:40 2022] PUT /identity/v3/projects/ce7ad47398884b858a65ea6fd52a2ce6/users/3c6dd807429742cc8aa55e94f020cb1c/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:29:40.559552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782df7e-365e-4f44-afcc-3e032eae7f93 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:40.561441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3782df7e-365e-4f44-afcc-3e032eae7f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:40.638436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 934/1839] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:40 2022] POST /identity/v3/users => generated 305 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:29:40.640003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb45dd-7596-4095-8e3d-c5b6a6617db2 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.640109 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb45dd-7596-4095-8e3d-c5b6a6617db2 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.640311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb45dd-7596-4095-8e3d-c5b6a6617db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.642415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782df7e-365e-4f44-afcc-3e032eae7f93 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:40.648347 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:40.648695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.649033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.649466 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] PATH_INFO: `/v3/projects/73a49af43e364ab29d6eb715fccf85cb` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.650811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73a49af43e364ab29d6eb715fccf85cb)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:40.652859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:40.672121 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-17fb45dd-7596-4095-8e3d-c5b6a6617db2 None None] MFA Rules not processed for user `3c6dd807429742cc8aa55e94f020cb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:40.673413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-17fb45dd-7596-4095-8e3d-c5b6a6617db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:40.736912 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 935/1840] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:40.737783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb45dd-7596-4095-8e3d-c5b6a6617db2 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:40.748711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb45dd-7596-4095-8e3d-c5b6a6617db2 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:40.759171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73a49af43e364ab29d6eb715fccf85cb', 'request_id': 'req-c991cdd7-d981-4b54-abc7-0744eb3d8839'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:40.810698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33073ae0-3e55-4060-bfc2-9d3482bf9c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:40.811377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33073ae0-3e55-4060-bfc2-9d3482bf9c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.811662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33073ae0-3e55-4060-bfc2-9d3482bf9c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.811940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33073ae0-3e55-4060-bfc2-9d3482bf9c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.812703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33073ae0-3e55-4060-bfc2-9d3482bf9c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:40.814328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33073ae0-3e55-4060-bfc2-9d3482bf9c96 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:40.824189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 936/1841] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:40.824955 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33073ae0-3e55-4060-bfc2-9d3482bf9c96 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:40.831093 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73a49af43e364ab29d6eb715fccf85cb', 'request_id': 'req-c991cdd7-d981-4b54-abc7-0744eb3d8839'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:40.834583 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33073ae0-3e55-4060-bfc2-9d3482bf9c96 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:40.837669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73a49af43e364ab29d6eb715fccf85cb', 'request_id': 'req-c991cdd7-d981-4b54-abc7-0744eb3d8839'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:40.839611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17acd93-49ee-4ca2-a404-32808c3057ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:40.841209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17acd93-49ee-4ca2-a404-32808c3057ca admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.841209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17acd93-49ee-4ca2-a404-32808c3057ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.841209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17acd93-49ee-4ca2-a404-32808c3057ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.841539 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17acd93-49ee-4ca2-a404-32808c3057ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:40.843162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17acd93-49ee-4ca2-a404-32808c3057ca admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:40.848943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] The token cache is being invalidate because project 73a49af43e364ab29d6eb715fccf85cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:40.849302 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:40.849964 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:40.851731 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 906/1842] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:40 2022] DELETE /identity/v3/projects/73a49af43e364ab29d6eb715fccf85cb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:40.852301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:40.856064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:40.868902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991cdd7-d981-4b54-abc7-0744eb3d8839 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:40.873438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd54fbf-0c67-479d-ad29-cec4e68f5905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:40.874095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd54fbf-0c67-479d-ad29-cec4e68f5905 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.874378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd54fbf-0c67-479d-ad29-cec4e68f5905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.874653 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd54fbf-0c67-479d-ad29-cec4e68f5905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.875379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd54fbf-0c67-479d-ad29-cec4e68f5905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:40.876983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd54fbf-0c67-479d-ad29-cec4e68f5905 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:40.886859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 907/1843] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:40.887951 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5789a-f837-4f85-be0a-edca3669717c None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.888247 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5789a-f837-4f85-be0a-edca3669717c None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.888541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5789a-f837-4f85-be0a-edca3669717c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.914316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-2cb5789a-f837-4f85-be0a-edca3669717c None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:40.916629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2cb5789a-f837-4f85-be0a-edca3669717c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:40.930406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 908/1844] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:40.930406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5789a-f837-4f85-be0a-edca3669717c None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:40.942346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5789a-f837-4f85-be0a-edca3669717c None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:40.945762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 937/1845] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:40 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:40.947409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e95e6-8411-4d5e-a8b8-2305246f8a06 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.947801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e95e6-8411-4d5e-a8b8-2305246f8a06 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.948352 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e95e6-8411-4d5e-a8b8-2305246f8a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.954737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3402a6-14f4-4d13-aab8-04ea0a0fe718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:40.956400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3402a6-14f4-4d13-aab8-04ea0a0fe718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:40.957490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3402a6-14f4-4d13-aab8-04ea0a0fe718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:40.957490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3402a6-14f4-4d13-aab8-04ea0a0fe718 admin admin] PATH_INFO: `/v3/projects/e2ac9af0f76b45d794ffee43971217a5/users/df9e52014b3e4f2c8d6a8a7447212d19/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:40.968149 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-2a1e95e6-8411-4d5e-a8b8-2305246f8a06 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:40.969594 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-2a1e95e6-8411-4d5e-a8b8-2305246f8a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:40.973230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3402a6-14f4-4d13-aab8-04ea0a0fe718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ac9af0f76b45d794ffee43971217a5, user_id=df9e52014b3e4f2c8d6a8a7447212d19, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:40.977086 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3402a6-14f4-4d13-aab8-04ea0a0fe718 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.038853 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 938/1846] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:41.039934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e95e6-8411-4d5e-a8b8-2305246f8a06 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.041421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-2a1e95e6-8411-4d5e-a8b8-2305246f8a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:41.054341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e95e6-8411-4d5e-a8b8-2305246f8a06 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.059711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7e84d-b0a6-49aa-965d-513e934ee049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.060813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e84d-b0a6-49aa-965d-513e934ee049 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.060813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e84d-b0a6-49aa-965d-513e934ee049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.061014 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e84d-b0a6-49aa-965d-513e934ee049 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.061744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7e84d-b0a6-49aa-965d-513e934ee049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.063723 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7e84d-b0a6-49aa-965d-513e934ee049 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.102757 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 909/1847] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:40 2022] PUT /identity/v3/projects/e2ac9af0f76b45d794ffee43971217a5/users/df9e52014b3e4f2c8d6a8a7447212d19/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:41.103669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3402a6-14f4-4d13-aab8-04ea0a0fe718 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.170955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3402a6-14f4-4d13-aab8-04ea0a0fe718 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.178076 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 939/1848] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:41 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:41.178076 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8563a-698e-45a4-a382-62c1c34439fb None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.178076 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8563a-698e-45a4-a382-62c1c34439fb None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.178076 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8563a-698e-45a4-a382-62c1c34439fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.179305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054dfb4-0be6-487d-893d-ac25b970e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.180073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054dfb4-0be6-487d-893d-ac25b970e368 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.180459 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054dfb4-0be6-487d-893d-ac25b970e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.180844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054dfb4-0be6-487d-893d-ac25b970e368 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.181690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054dfb4-0be6-487d-893d-ac25b970e368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:29:41.182155 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054dfb4-0be6-487d-893d-ac25b970e368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.190651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054dfb4-0be6-487d-893d-ac25b970e368 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.196732 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 910/1849] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:29:41.197675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054dfb4-0be6-487d-893d-ac25b970e368 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.206442 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ecc8563a-698e-45a4-a382-62c1c34439fb None None] MFA Rules not processed for user `df9e52014b3e4f2c8d6a8a7447212d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:41.207648 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ecc8563a-698e-45a4-a382-62c1c34439fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:41.207934 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054dfb4-0be6-487d-893d-ac25b970e368 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.212750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6277e-1ff6-42b0-a22b-83c49de6dbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.213764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6277e-1ff6-42b0-a22b-83c49de6dbec admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.214060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6277e-1ff6-42b0-a22b-83c49de6dbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.214357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6277e-1ff6-42b0-a22b-83c49de6dbec admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.215067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6277e-1ff6-42b0-a22b-83c49de6dbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.216659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6277e-1ff6-42b0-a22b-83c49de6dbec admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.228607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 911/1850] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:41.230050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6277e-1ff6-42b0-a22b-83c49de6dbec admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.242015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6277e-1ff6-42b0-a22b-83c49de6dbec admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.247571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa0b48-6517-4750-9ff5-16a956e578b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.248170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa0b48-6517-4750-9ff5-16a956e578b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.248507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa0b48-6517-4750-9ff5-16a956e578b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.248789 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa0b48-6517-4750-9ff5-16a956e578b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.249587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa0b48-6517-4750-9ff5-16a956e578b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.253267 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa0b48-6517-4750-9ff5-16a956e578b0 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.271035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:41.273489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 940/1851] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:41 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:41.274303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8563a-698e-45a4-a382-62c1c34439fb None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.284630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8563a-698e-45a4-a382-62c1c34439fb None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.289293 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7ffb9-6a75-4c65-ad2b-9a270fb2c6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.290198 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7ffb9-6a75-4c65-ad2b-9a270fb2c6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.290472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7ffb9-6a75-4c65-ad2b-9a270fb2c6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.290753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7ffb9-6a75-4c65-ad2b-9a270fb2c6e4 admin admin] PATH_INFO: `/v3/projects/86acf3742b284f2692ff19cb4ea0c180/users/3c9b529fd5e04dfd829db9e93dff6a40/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.305281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7ffb9-6a75-4c65-ad2b-9a270fb2c6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86acf3742b284f2692ff19cb4ea0c180, user_id=3c9b529fd5e04dfd829db9e93dff6a40, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.307948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7ffb9-6a75-4c65-ad2b-9a270fb2c6e4 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.340965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 912/1852] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:41 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:41.341941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa0b48-6517-4750-9ff5-16a956e578b0 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.402544 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa0b48-6517-4750-9ff5-16a956e578b0 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.407435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ffe42-d563-45bc-b97e-8dbc87092f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.408082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ffe42-d563-45bc-b97e-8dbc87092f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.408369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ffe42-d563-45bc-b97e-8dbc87092f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.408634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ffe42-d563-45bc-b97e-8dbc87092f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.409365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ffe42-d563-45bc-b97e-8dbc87092f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.411274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ffe42-d563-45bc-b97e-8dbc87092f4a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.503618 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 913/1853] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:41 2022] POST /identity/v3/projects => generated 409 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:41.504493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ffe42-d563-45bc-b97e-8dbc87092f4a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.504954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 941/1854] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:41 2022] PUT /identity/v3/projects/86acf3742b284f2692ff19cb4ea0c180/users/3c9b529fd5e04dfd829db9e93dff6a40/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:41.509989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7ffb9-6a75-4c65-ad2b-9a270fb2c6e4 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.579390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ffe42-d563-45bc-b97e-8dbc87092f4a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.585161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd29ca-d72a-490d-8368-3446036b8d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.585856 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd29ca-d72a-490d-8368-3446036b8d1d admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.586136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd29ca-d72a-490d-8368-3446036b8d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.586418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd29ca-d72a-490d-8368-3446036b8d1d admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.587118 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd29ca-d72a-490d-8368-3446036b8d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.589258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd29ca-d72a-490d-8368-3446036b8d1d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.591904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7ffb9-6a75-4c65-ad2b-9a270fb2c6e4 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.597572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47c4d5-b6af-4fc7-998a-bae61f463955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.598461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47c4d5-b6af-4fc7-998a-bae61f463955 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.599024 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47c4d5-b6af-4fc7-998a-bae61f463955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.599209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47c4d5-b6af-4fc7-998a-bae61f463955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.600053 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47c4d5-b6af-4fc7-998a-bae61f463955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.601971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47c4d5-b6af-4fc7-998a-bae61f463955 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.614393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 942/1855] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:41.615439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47c4d5-b6af-4fc7-998a-bae61f463955 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.634534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47c4d5-b6af-4fc7-998a-bae61f463955 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.634534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b90f3-c4cd-4fc4-bb1b-dcbcb5117d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.634534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b90f3-c4cd-4fc4-bb1b-dcbcb5117d80 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.634534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b90f3-c4cd-4fc4-bb1b-dcbcb5117d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.634865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b90f3-c4cd-4fc4-bb1b-dcbcb5117d80 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.634865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b90f3-c4cd-4fc4-bb1b-dcbcb5117d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.635118 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b90f3-c4cd-4fc4-bb1b-dcbcb5117d80 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.730185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 914/1856] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:41 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:41.731048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd29ca-d72a-490d-8368-3446036b8d1d admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.734332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 943/1857] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:41 2022] POST /identity/v3/users => generated 311 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:41.735394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b90f3-c4cd-4fc4-bb1b-dcbcb5117d80 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.743620 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd29ca-d72a-490d-8368-3446036b8d1d admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.748776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef923de-f0bd-4ee9-b610-8d49686431bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.749789 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef923de-f0bd-4ee9-b610-8d49686431bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.750057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef923de-f0bd-4ee9-b610-8d49686431bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.750337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef923de-f0bd-4ee9-b610-8d49686431bd admin admin] PATH_INFO: `/v3/projects/86acf3742b284f2692ff19cb4ea0c180/users/3c9b529fd5e04dfd829db9e93dff6a40/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.753411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef923de-f0bd-4ee9-b610-8d49686431bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=86acf3742b284f2692ff19cb4ea0c180, user_id=3c9b529fd5e04dfd829db9e93dff6a40, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.756226 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef923de-f0bd-4ee9-b610-8d49686431bd admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.759709 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b90f3-c4cd-4fc4-bb1b-dcbcb5117d80 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.764887 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c089f2-9777-4172-8add-7bac62d12c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.765757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c089f2-9777-4172-8add-7bac62d12c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.766041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c089f2-9777-4172-8add-7bac62d12c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.766314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c089f2-9777-4172-8add-7bac62d12c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.767206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c089f2-9777-4172-8add-7bac62d12c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.769314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c089f2-9777-4172-8add-7bac62d12c4d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.769431 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 915/1858] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:41 2022] PUT /identity/v3/projects/86acf3742b284f2692ff19cb4ea0c180/users/3c9b529fd5e04dfd829db9e93dff6a40/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:41.770456 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef923de-f0bd-4ee9-b610-8d49686431bd admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.779908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 944/1859] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:41.781228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efdcf1-7ec5-4ec2-85c7-464a3e4d2425 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.781520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efdcf1-7ec5-4ec2-85c7-464a3e4d2425 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.781856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efdcf1-7ec5-4ec2-85c7-464a3e4d2425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.812566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-70efdcf1-7ec5-4ec2-85c7-464a3e4d2425 None None] MFA Rules not processed for user `3c9b529fd5e04dfd829db9e93dff6a40`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:41.814883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-70efdcf1-7ec5-4ec2-85c7-464a3e4d2425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:41.852263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef923de-f0bd-4ee9-b610-8d49686431bd admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.857415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106a4d7-0a53-49d1-b1db-87d4e3c5bfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.858096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106a4d7-0a53-49d1-b1db-87d4e3c5bfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.858377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106a4d7-0a53-49d1-b1db-87d4e3c5bfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.858656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106a4d7-0a53-49d1-b1db-87d4e3c5bfa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.859421 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106a4d7-0a53-49d1-b1db-87d4e3c5bfa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.861767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106a4d7-0a53-49d1-b1db-87d4e3c5bfa6 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.872147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 916/1860] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:41.872971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106a4d7-0a53-49d1-b1db-87d4e3c5bfa6 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.883257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106a4d7-0a53-49d1-b1db-87d4e3c5bfa6 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.887931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a19f17-2a96-4f16-add2-5059bdef0167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.888599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a19f17-2a96-4f16-add2-5059bdef0167 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.888887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a19f17-2a96-4f16-add2-5059bdef0167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.889196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a19f17-2a96-4f16-add2-5059bdef0167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.889914 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a19f17-2a96-4f16-add2-5059bdef0167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.891631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a19f17-2a96-4f16-add2-5059bdef0167 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.895563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 945/1861] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:41.896464 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efdcf1-7ec5-4ec2-85c7-464a3e4d2425 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.905454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 917/1862] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:41.906777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efdcf1-7ec5-4ec2-85c7-464a3e4d2425 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.907322 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a19f17-2a96-4f16-add2-5059bdef0167 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:41.909282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e8a19f17-2a96-4f16-add2-5059bdef0167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:41.911663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a3f44-51ef-40b3-97e7-5bf6bdbd71eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.912562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a3f44-51ef-40b3-97e7-5bf6bdbd71eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.912848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a3f44-51ef-40b3-97e7-5bf6bdbd71eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.913138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a3f44-51ef-40b3-97e7-5bf6bdbd71eb admin admin] PATH_INFO: `/v3/projects/2b260298cc42443997a01c15100b1958/users/beb4522c274b4408a96568a9f855f973/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.928875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a3f44-51ef-40b3-97e7-5bf6bdbd71eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b260298cc42443997a01c15100b1958, user_id=beb4522c274b4408a96568a9f855f973, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.931660 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a3f44-51ef-40b3-97e7-5bf6bdbd71eb admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.968137 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a19f17-2a96-4f16-add2-5059bdef0167 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:41.971851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f55b-000a-4c5c-baf7-b3867dacd2d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:41.972505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f55b-000a-4c5c-baf7-b3867dacd2d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:41.972796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f55b-000a-4c5c-baf7-b3867dacd2d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:41.973075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f55b-000a-4c5c-baf7-b3867dacd2d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:41.982239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3f55b-000a-4c5c-baf7-b3867dacd2d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:41.983666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3f55b-000a-4c5c-baf7-b3867dacd2d4 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:41.993590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 918/1863] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:41.994352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f55b-000a-4c5c-baf7-b3867dacd2d4 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:42.004427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f55b-000a-4c5c-baf7-b3867dacd2d4 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:42.009044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb804e8-4fdd-4313-9b41-47b207f74363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:42.009880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb804e8-4fdd-4313-9b41-47b207f74363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:42.010158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb804e8-4fdd-4313-9b41-47b207f74363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:42.010468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb804e8-4fdd-4313-9b41-47b207f74363 admin admin] PATH_INFO: `/v3/projects/9388788634bd4682828d222542b5fe57/users/ea7d7130566240ff97b7f2bd1f960571/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:42.025263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb804e8-4fdd-4313-9b41-47b207f74363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9388788634bd4682828d222542b5fe57, user_id=ea7d7130566240ff97b7f2bd1f960571, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:42.027967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb804e8-4fdd-4313-9b41-47b207f74363 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:42.046425 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 946/1864] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:41 2022] PUT /identity/v3/projects/2b260298cc42443997a01c15100b1958/users/beb4522c274b4408a96568a9f855f973/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:42.050972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a3f44-51ef-40b3-97e7-5bf6bdbd71eb admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:42.111485 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a3f44-51ef-40b3-97e7-5bf6bdbd71eb admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:42.116181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e58a0d-722e-41b0-b43c-c157edae5eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:42.116856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e58a0d-722e-41b0-b43c-c157edae5eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:42.117168 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e58a0d-722e-41b0-b43c-c157edae5eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:42.117450 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e58a0d-722e-41b0-b43c-c157edae5eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:42.118179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e58a0d-722e-41b0-b43c-c157edae5eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:42.119778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e58a0d-722e-41b0-b43c-c157edae5eb1 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:42.133040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 919/1865] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:41 2022] PUT /identity/v3/projects/9388788634bd4682828d222542b5fe57/users/ea7d7130566240ff97b7f2bd1f960571/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:42.144881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 947/1866] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:29:42.150698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e58a0d-722e-41b0-b43c-c157edae5eb1 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:42.151326 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bbeb5-e9a7-439c-9408-3aabb4c54773 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:42.151695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bbeb5-e9a7-439c-9408-3aabb4c54773 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:42.152052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bbeb5-e9a7-439c-9408-3aabb4c54773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:42.165314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e58a0d-722e-41b0-b43c-c157edae5eb1 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:42.190506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-075bbeb5-e9a7-439c-9408-3aabb4c54773 None None] MFA Rules not processed for user `ea7d7130566240ff97b7f2bd1f960571`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:42.191787 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-075bbeb5-e9a7-439c-9408-3aabb4c54773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:42.229820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a15f0-dd1c-465c-b13d-d60c4eed1318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:42.231113 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a15f0-dd1c-465c-b13d-d60c4eed1318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:42.231556 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a15f0-dd1c-465c-b13d-d60c4eed1318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:42.231965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a15f0-dd1c-465c-b13d-d60c4eed1318 admin admin] PATH_INFO: `/v3/projects/2b260298cc42443997a01c15100b1958/users/beb4522c274b4408a96568a9f855f973/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:42.234431 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a15f0-dd1c-465c-b13d-d60c4eed1318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b260298cc42443997a01c15100b1958, user_id=beb4522c274b4408a96568a9f855f973, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:42.237718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a15f0-dd1c-465c-b13d-d60c4eed1318 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:42.248249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 948/1867] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:42 2022] PUT /identity/v3/projects/2b260298cc42443997a01c15100b1958/users/beb4522c274b4408a96568a9f855f973/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:42.259805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23446911-2e30-4a44-8bed-bc0dca146b1a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:42.260029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23446911-2e30-4a44-8bed-bc0dca146b1a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:42.260315 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23446911-2e30-4a44-8bed-bc0dca146b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:42.262776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 920/1868] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:42.267451 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bbeb5-e9a7-439c-9408-3aabb4c54773 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:42.277808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bbeb5-e9a7-439c-9408-3aabb4c54773 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:42.288472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-23446911-2e30-4a44-8bed-bc0dca146b1a None None] MFA Rules not processed for user `beb4522c274b4408a96568a9f855f973`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:42.289703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-23446911-2e30-4a44-8bed-bc0dca146b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:42.336060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4891b-961e-4cc6-8f59-992172f7ac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:42.337006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4891b-961e-4cc6-8f59-992172f7ac10 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:42.337394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4891b-961e-4cc6-8f59-992172f7ac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:42.337609 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4891b-961e-4cc6-8f59-992172f7ac10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:42.341282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4891b-961e-4cc6-8f59-992172f7ac10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:42.343365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4891b-961e-4cc6-8f59-992172f7ac10 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:42.368109 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 949/1869] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:42.372694 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23446911-2e30-4a44-8bed-bc0dca146b1a None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:42.424439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23446911-2e30-4a44-8bed-bc0dca146b1a None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:42.428128 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57104431-9215-4577-8f17-1ec2d63a2d03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:42.428777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57104431-9215-4577-8f17-1ec2d63a2d03 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:42.429064 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57104431-9215-4577-8f17-1ec2d63a2d03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:42.429491 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57104431-9215-4577-8f17-1ec2d63a2d03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:42.431348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-57104431-9215-4577-8f17-1ec2d63a2d03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:42.490756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57104431-9215-4577-8f17-1ec2d63a2d03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:42.492311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57104431-9215-4577-8f17-1ec2d63a2d03 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:42.498276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 921/1870] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:42 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:29:42.498276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4891b-961e-4cc6-8f59-992172f7ac10 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:42.498276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-ddc4891b-961e-4cc6-8f59-992172f7ac10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:42.501856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 950/1871] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:42.502836 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57104431-9215-4577-8f17-1ec2d63a2d03 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:42.513788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57104431-9215-4577-8f17-1ec2d63a2d03 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:42.562095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4891b-961e-4cc6-8f59-992172f7ac10 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:42.567205 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb3d10-00d0-4288-928d-e423e850d799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:42.567875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb3d10-00d0-4288-928d-e423e850d799 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:42.568214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb3d10-00d0-4288-928d-e423e850d799 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:42.568807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb3d10-00d0-4288-928d-e423e850d799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:42.573322 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63c261-f168-4883-a7e1-8105410f952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:42.573965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c261-f168-4883-a7e1-8105410f952b admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:42.574673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c261-f168-4883-a7e1-8105410f952b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:42.574673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c261-f168-4883-a7e1-8105410f952b admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:42.575188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63c261-f168-4883-a7e1-8105410f952b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:42.577102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63c261-f168-4883-a7e1-8105410f952b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:42.632091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb3d10-00d0-4288-928d-e423e850d799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:42.633754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb3d10-00d0-4288-928d-e423e850d799 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:42.644982 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 922/1872] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:42 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:42.657508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 951/1873] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:42 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:42.666724 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb3d10-00d0-4288-928d-e423e850d799 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:42.693840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb3d10-00d0-4288-928d-e423e850d799 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:42.714074 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1a2d9-fb2d-4337-bb4d-fb1548680f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:42.715868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a2d9-fb2d-4337-bb4d-fb1548680f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:42.716282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a2d9-fb2d-4337-bb4d-fb1548680f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:42.716673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a2d9-fb2d-4337-bb4d-fb1548680f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:42.717754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1a2d9-fb2d-4337-bb4d-fb1548680f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:42.719963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1a2d9-fb2d-4337-bb4d-fb1548680f53 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:42.732449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 923/1874] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:42.736873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63c261-f168-4883-a7e1-8105410f952b admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:42.747720 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63c261-f168-4883-a7e1-8105410f952b admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:42.753188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7a8cf-9b71-4314-ad33-ae0410b77e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:42.755137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7a8cf-9b71-4314-ad33-ae0410b77e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:42.755739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7a8cf-9b71-4314-ad33-ae0410b77e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:42.755854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7a8cf-9b71-4314-ad33-ae0410b77e45 admin admin] PATH_INFO: `/v3/projects/4426a342e6564b0daf142e3d0bf2c733/users/e02811f1026b49fbafd14515382c6699/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:42.776305 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7a8cf-9b71-4314-ad33-ae0410b77e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4426a342e6564b0daf142e3d0bf2c733, user_id=e02811f1026b49fbafd14515382c6699, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:42.779397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7a8cf-9b71-4314-ad33-ae0410b77e45 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:42.874693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 952/1875] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:42 2022] PUT /identity/v3/projects/4426a342e6564b0daf142e3d0bf2c733/users/e02811f1026b49fbafd14515382c6699/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:29:42.875880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1a2d9-fb2d-4337-bb4d-fb1548680f53 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:42.886749 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1a2d9-fb2d-4337-bb4d-fb1548680f53 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:42.964632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611d358-5548-4c38-a702-75cb70c19194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:42.965332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611d358-5548-4c38-a702-75cb70c19194 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:42.965622 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611d358-5548-4c38-a702-75cb70c19194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:42.965920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611d358-5548-4c38-a702-75cb70c19194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:42.966631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611d358-5548-4c38-a702-75cb70c19194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:42.968243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611d358-5548-4c38-a702-75cb70c19194 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:42.978745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 924/1876] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:42.983071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7a8cf-9b71-4314-ad33-ae0410b77e45 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:42.994719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7a8cf-9b71-4314-ad33-ae0410b77e45 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:43.000246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce351f-6ee8-47b4-8f31-4c92793423b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:43.002490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce351f-6ee8-47b4-8f31-4c92793423b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:43.011574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce351f-6ee8-47b4-8f31-4c92793423b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:43.011574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce351f-6ee8-47b4-8f31-4c92793423b7 admin admin] PATH_INFO: `/v3/projects/4426a342e6564b0daf142e3d0bf2c733/users/e02811f1026b49fbafd14515382c6699/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:43.011574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce351f-6ee8-47b4-8f31-4c92793423b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4426a342e6564b0daf142e3d0bf2c733, user_id=e02811f1026b49fbafd14515382c6699, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:43.011574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce351f-6ee8-47b4-8f31-4c92793423b7 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:43.020778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 953/1877] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:42 2022] PUT /identity/v3/projects/4426a342e6564b0daf142e3d0bf2c733/users/e02811f1026b49fbafd14515382c6699/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:43.032096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d47661-cd4d-4fb2-8a9f-13294f19f15c None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:43.032400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d47661-cd4d-4fb2-8a9f-13294f19f15c None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:43.032685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d47661-cd4d-4fb2-8a9f-13294f19f15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:43.069752 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-64d47661-cd4d-4fb2-8a9f-13294f19f15c None None] MFA Rules not processed for user `e02811f1026b49fbafd14515382c6699`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:43.070959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-64d47661-cd4d-4fb2-8a9f-13294f19f15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:43.107137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce351f-6ee8-47b4-8f31-4c92793423b7 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:43.154162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 925/1878] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:43.163509 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce351f-6ee8-47b4-8f31-4c92793423b7 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:43.167239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef17082-6198-42d1-9e0b-78bba987c306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:43.167891 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef17082-6198-42d1-9e0b-78bba987c306 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:43.168296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef17082-6198-42d1-9e0b-78bba987c306 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:43.168580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef17082-6198-42d1-9e0b-78bba987c306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:43.183417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:43.226478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef17082-6198-42d1-9e0b-78bba987c306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:43.228007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef17082-6198-42d1-9e0b-78bba987c306 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:43.239746 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 954/1879] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:43 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:29:43.307932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d47661-cd4d-4fb2-8a9f-13294f19f15c None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:43.318244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d47661-cd4d-4fb2-8a9f-13294f19f15c None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:43.322752 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f4f30-cab0-4ee2-a132-7cf059385ac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:43.323114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f4f30-cab0-4ee2-a132-7cf059385ac1 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:43.325590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f4f30-cab0-4ee2-a132-7cf059385ac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:43.325590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f4f30-cab0-4ee2-a132-7cf059385ac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:43.333939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f4f30-cab0-4ee2-a132-7cf059385ac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:43.335623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f4f30-cab0-4ee2-a132-7cf059385ac1 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:43.349352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 926/1880] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:43.762210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef17082-6198-42d1-9e0b-78bba987c306 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:43.770932 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef17082-6198-42d1-9e0b-78bba987c306 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:43.774577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5e574-d511-4195-95b4-edcbdda105ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:43.775221 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e574-d511-4195-95b4-edcbdda105ad service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:43.775509 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e574-d511-4195-95b4-edcbdda105ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:43.775792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e574-d511-4195-95b4-edcbdda105ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:43.834013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5e574-d511-4195-95b4-edcbdda105ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:43.835357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5e574-d511-4195-95b4-edcbdda105ad service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:43.840794 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:43.844256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 955/1881] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:44.434101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f4f30-cab0-4ee2-a132-7cf059385ac1 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:44.512434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f4f30-cab0-4ee2-a132-7cf059385ac1 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:44.519231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:44.520167 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:44.520460 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:44.520743 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] PATH_INFO: `/v3/users/ea7d7130566240ff97b7f2bd1f960571` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:44.522088 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7d7130566240ff97b7f2bd1f960571)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:44.526683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:44.799968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7d7130566240ff97b7f2bd1f960571'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:44.882376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7d7130566240ff97b7f2bd1f960571'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:44.895828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7d7130566240ff97b7f2bd1f960571'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:44.896554 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7d7130566240ff97b7f2bd1f960571'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:44.903488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7d7130566240ff97b7f2bd1f960571'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:44.909645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 927/1882] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:44 2022] DELETE /identity/v3/users/ea7d7130566240ff97b7f2bd1f960571 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:44.914340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f021f-ef34-4cb0-b1f4-e42efeb121e3 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:44.914824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f021f-ef34-4cb0-b1f4-e42efeb121e3 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:44.915029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f021f-ef34-4cb0-b1f4-e42efeb121e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:44.934424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-007f021f-ef34-4cb0-b1f4-e42efeb121e3 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:44.935656 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-007f021f-ef34-4cb0-b1f4-e42efeb121e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:45.010658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 956/1883] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:45.017398 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:45.019807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:45.081682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8c6a1-3b28-4cb3-99da-3d33d1ddb63a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:45.085896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6cc12-956b-4cce-afdd-b971c4f9ac48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:45.086649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6cc12-956b-4cce-afdd-b971c4f9ac48 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:45.086937 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6cc12-956b-4cce-afdd-b971c4f9ac48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:45.087219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6cc12-956b-4cce-afdd-b971c4f9ac48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:45.096990 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6cc12-956b-4cce-afdd-b971c4f9ac48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:45.098491 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6cc12-956b-4cce-afdd-b971c4f9ac48 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:45.109015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 928/1884] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:45.286041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f021f-ef34-4cb0-b1f4-e42efeb121e3 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:45.287483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-007f021f-ef34-4cb0-b1f4-e42efeb121e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:45.299778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:45.308240 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f021f-ef34-4cb0-b1f4-e42efeb121e3 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:45.316501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:45.320410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:45.320921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:45.328909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] PATH_INFO: `/v3/users/6661157880084493baf834969c9dbaf5` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:45.330509 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6661157880084493baf834969c9dbaf5)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:45.336336 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:45.852216 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6661157880084493baf834969c9dbaf5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:45.952483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6661157880084493baf834969c9dbaf5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:45.955513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6661157880084493baf834969c9dbaf5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:45.977814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6661157880084493baf834969c9dbaf5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:45.987695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6661157880084493baf834969c9dbaf5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:45.995962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 957/1885] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:45 2022] DELETE /identity/v3/users/6661157880084493baf834969c9dbaf5 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:46.000751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686ccf1-a4a5-4641-ba20-2f00c9e72d62 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:46.001659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686ccf1-a4a5-4641-ba20-2f00c9e72d62 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:46.002114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686ccf1-a4a5-4641-ba20-2f00c9e72d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:46.022866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-3686ccf1-a4a5-4641-ba20-2f00c9e72d62 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:46.024866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3686ccf1-a4a5-4641-ba20-2f00c9e72d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:46.095960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 929/1886] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:46.106163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:46.109862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:46.112744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:46.171337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080c5e3-42da-4d32-881a-cc0b541578fc admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:46.175684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d27313-9e6e-4e33-b522-6a4b33d06f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:46.176417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d27313-9e6e-4e33-b522-6a4b33d06f6a service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:46.176717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d27313-9e6e-4e33-b522-6a4b33d06f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:46.176997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d27313-9e6e-4e33-b522-6a4b33d06f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:46.186278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d27313-9e6e-4e33-b522-6a4b33d06f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:46.187699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d27313-9e6e-4e33-b522-6a4b33d06f6a service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:46.198587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 958/1887] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:29:46.262917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686ccf1-a4a5-4641-ba20-2f00c9e72d62 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:46.264384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3686ccf1-a4a5-4641-ba20-2f00c9e72d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:46.283769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686ccf1-a4a5-4641-ba20-2f00c9e72d62 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:46.291276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:46.292577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:46.293195 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:46.294207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] PATH_INFO: `/v3/projects/9388788634bd4682828d222542b5fe57` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:46.306674 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9388788634bd4682828d222542b5fe57)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:46.316081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:46.421408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9388788634bd4682828d222542b5fe57', 'request_id': 'req-f62a9bb8-0472-4db1-8560-4283d63eb754'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:46.509053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9388788634bd4682828d222542b5fe57', 'request_id': 'req-f62a9bb8-0472-4db1-8560-4283d63eb754'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:46.523440 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9388788634bd4682828d222542b5fe57', 'request_id': 'req-f62a9bb8-0472-4db1-8560-4283d63eb754'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:46.530768 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] The token cache is being invalidate because project 9388788634bd4682828d222542b5fe57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:46.531064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:46.531747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:46.536729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 930/1888] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:46 2022] DELETE /identity/v3/projects/9388788634bd4682828d222542b5fe57 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:46.538091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d27313-9e6e-4e33-b522-6a4b33d06f6a service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:46.548282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d27313-9e6e-4e33-b522-6a4b33d06f6a service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:46.605305 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a461b69-d34a-4450-8c2f-9d2e89b0ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:46.606181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a461b69-d34a-4450-8c2f-9d2e89b0ac9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:46.606469 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a461b69-d34a-4450-8c2f-9d2e89b0ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:46.606748 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a461b69-d34a-4450-8c2f-9d2e89b0ac9c admin admin] PATH_INFO: `/v3/users/e02811f1026b49fbafd14515382c6699` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:46.607940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a461b69-d34a-4450-8c2f-9d2e89b0ac9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02811f1026b49fbafd14515382c6699)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:46.609937 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a461b69-d34a-4450-8c2f-9d2e89b0ac9c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:46.680009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:46.680009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:46.694033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a9bb8-0472-4db1-8560-4283d63eb754 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:46.708565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:46.709655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:46.709837 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:46.711275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573 admin admin] PATH_INFO: `/v3/projects/80b924ae92ed4b9e9ab3d43becec85bd` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:46.713905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b924ae92ed4b9e9ab3d43becec85bd)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:46.722479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:46.831889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-9a461b69-d34a-4450-8c2f-9d2e89b0ac9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02811f1026b49fbafd14515382c6699'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:46.849731 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b924ae92ed4b9e9ab3d43becec85bd', 'request_id': 'req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:46.926591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-9a461b69-d34a-4450-8c2f-9d2e89b0ac9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02811f1026b49fbafd14515382c6699'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:46.926591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-9a461b69-d34a-4450-8c2f-9d2e89b0ac9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02811f1026b49fbafd14515382c6699'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:46.944513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-9a461b69-d34a-4450-8c2f-9d2e89b0ac9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02811f1026b49fbafd14515382c6699'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:46.955634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-9a461b69-d34a-4450-8c2f-9d2e89b0ac9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02811f1026b49fbafd14515382c6699'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:46.973010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 959/1889] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:46 2022] DELETE /identity/v3/users/e02811f1026b49fbafd14515382c6699 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:47.036698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b924ae92ed4b9e9ab3d43becec85bd', 'request_id': 'req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:47.044897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b924ae92ed4b9e9ab3d43becec85bd', 'request_id': 'req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:47.068473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573 admin admin] The token cache is being invalidate because project 80b924ae92ed4b9e9ab3d43becec85bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:47.072507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:47.073685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-c1480fc6-d3b0-47bf-8e99-1e5e8530d573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:47.076478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 931/1890] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:46 2022] DELETE /identity/v3/projects/80b924ae92ed4b9e9ab3d43becec85bd => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:47.081477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b987a8-9cac-40e6-b7a4-a3d229f8ca83 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:47.081990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b987a8-9cac-40e6-b7a4-a3d229f8ca83 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:47.082490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b987a8-9cac-40e6-b7a4-a3d229f8ca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:47.101794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-57b987a8-9cac-40e6-b7a4-a3d229f8ca83 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:47.104276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-57b987a8-9cac-40e6-b7a4-a3d229f8ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:47.186179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 960/1891] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:47.195434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecd2eb-f5db-4f57-b032-89d94dae4456 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:47.196157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecd2eb-f5db-4f57-b032-89d94dae4456 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:47.196660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecd2eb-f5db-4f57-b032-89d94dae4456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:47.224723 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-f6ecd2eb-f5db-4f57-b032-89d94dae4456 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:47.226738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f6ecd2eb-f5db-4f57-b032-89d94dae4456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:47.244493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 932/1892] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:47.249382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b987a8-9cac-40e6-b7a4-a3d229f8ca83 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:47.265020 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b987a8-9cac-40e6-b7a4-a3d229f8ca83 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:47.276918 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381d564-fc89-4e48-b8a3-150e0521b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:47.281741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381d564-fc89-4e48-b8a3-150e0521b584 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:47.285951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381d564-fc89-4e48-b8a3-150e0521b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:47.285951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381d564-fc89-4e48-b8a3-150e0521b584 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:47.286746 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381d564-fc89-4e48-b8a3-150e0521b584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:29:47.287307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381d564-fc89-4e48-b8a3-150e0521b584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:47.292563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381d564-fc89-4e48-b8a3-150e0521b584 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:47.334488 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 961/1893] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:29:47.334899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecd2eb-f5db-4f57-b032-89d94dae4456 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:47.349624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecd2eb-f5db-4f57-b032-89d94dae4456 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:47.370954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcf7b9-8211-4765-83b7-0bb20634166a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:47.371922 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcf7b9-8211-4765-83b7-0bb20634166a admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:47.372438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcf7b9-8211-4765-83b7-0bb20634166a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:47.372912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcf7b9-8211-4765-83b7-0bb20634166a admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:47.374100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcf7b9-8211-4765-83b7-0bb20634166a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:47.378611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcf7b9-8211-4765-83b7-0bb20634166a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:47.441996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decc10c-5485-422a-abbb-b0a3e036c5b7 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:47.449535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decc10c-5485-422a-abbb-b0a3e036c5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:47.449535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decc10c-5485-422a-abbb-b0a3e036c5b7 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:47.449535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 962/1894] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:29:47.450724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19d389-d218-4151-9c5e-08f8489c79a7 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:47.451019 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19d389-d218-4151-9c5e-08f8489c79a7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:47.451302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19d389-d218-4151-9c5e-08f8489c79a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:47.471990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-9e19d389-d218-4151-9c5e-08f8489c79a7 None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:47.473397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9e19d389-d218-4151-9c5e-08f8489c79a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:47.544048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 933/1895] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:47 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:29:47.552790 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcf7b9-8211-4765-83b7-0bb20634166a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:47.569599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 963/1896] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:29:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:47.608390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19d389-d218-4151-9c5e-08f8489c79a7 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:47.610196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9e19d389-d218-4151-9c5e-08f8489c79a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:47.624735 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcf7b9-8211-4765-83b7-0bb20634166a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:47.627873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19d389-d218-4151-9c5e-08f8489c79a7 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:47.632606 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac670a6-4f20-4213-b145-55a91d19fa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:47.632998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac670a6-4f20-4213-b145-55a91d19fa9d admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:47.633386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac670a6-4f20-4213-b145-55a91d19fa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:47.634258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac670a6-4f20-4213-b145-55a91d19fa9d admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:47.635239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac670a6-4f20-4213-b145-55a91d19fa9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:47.637384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac670a6-4f20-4213-b145-55a91d19fa9d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:47.715730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e8a1b-0c57-420c-a2dc-f96fa429ecb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:47.717933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e8a1b-0c57-420c-a2dc-f96fa429ecb3 service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:47.718441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e8a1b-0c57-420c-a2dc-f96fa429ecb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:47.719077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e8a1b-0c57-420c-a2dc-f96fa429ecb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:47.730621 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e8a1b-0c57-420c-a2dc-f96fa429ecb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:47.733170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e8a1b-0c57-420c-a2dc-f96fa429ecb3 service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:47.750628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 934/1897] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:47 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:47.752056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac670a6-4f20-4213-b145-55a91d19fa9d admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:47.754899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5ac670a6-4f20-4213-b145-55a91d19fa9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:47.761106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 964/1898] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:29:47.762937 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e8a1b-0c57-420c-a2dc-f96fa429ecb3 service nova] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:47.787194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac670a6-4f20-4213-b145-55a91d19fa9d admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:47.789638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e8a1b-0c57-420c-a2dc-f96fa429ecb3 service nova] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:47.800480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d3df2-4a5f-4eca-9cb8-22be31026bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:47.801802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d3df2-4a5f-4eca-9cb8-22be31026bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:47.803196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d3df2-4a5f-4eca-9cb8-22be31026bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:47.803196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d3df2-4a5f-4eca-9cb8-22be31026bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:47.804384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:47.804518 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d3df2-4a5f-4eca-9cb8-22be31026bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:47.805379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:47.805670 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:47.805950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] PATH_INFO: `/v3/projects/4426a342e6564b0daf142e3d0bf2c733` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:47.807527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4426a342e6564b0daf142e3d0bf2c733)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:47.809081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d3df2-4a5f-4eca-9cb8-22be31026bb5 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:47.809704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:47.827305 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 965/1899] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:47.836856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d3df2-4a5f-4eca-9cb8-22be31026bb5 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:47.862977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d3df2-4a5f-4eca-9cb8-22be31026bb5 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:47.869392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a877612-ccce-4b1b-b551-eac02065e433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:47.870679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a877612-ccce-4b1b-b551-eac02065e433 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:47.871047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a877612-ccce-4b1b-b551-eac02065e433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:47.871333 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a877612-ccce-4b1b-b551-eac02065e433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:47.872284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a877612-ccce-4b1b-b551-eac02065e433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:47.873949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a877612-ccce-4b1b-b551-eac02065e433 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:47.893987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 966/1900] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:47.895215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a877612-ccce-4b1b-b551-eac02065e433 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:47.905915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a877612-ccce-4b1b-b551-eac02065e433 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:47.911499 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4758980-e31b-469c-87ea-ad0507df466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:47.912616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4758980-e31b-469c-87ea-ad0507df466d admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:47.913153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4758980-e31b-469c-87ea-ad0507df466d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:47.918281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4758980-e31b-469c-87ea-ad0507df466d admin admin] PATH_INFO: `/v3/projects/5fba7b72484941bdb7d66ca4f8297181/users/04e6be5748904071b53931cd7714b6d2/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:47.932637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4758980-e31b-469c-87ea-ad0507df466d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fba7b72484941bdb7d66ca4f8297181, user_id=04e6be5748904071b53931cd7714b6d2, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:47.935814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4758980-e31b-469c-87ea-ad0507df466d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:48.045339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:48.056185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 967/1901] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:47 2022] PUT /identity/v3/projects/5fba7b72484941bdb7d66ca4f8297181/users/04e6be5748904071b53931cd7714b6d2/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:29:48.061343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6946e-624d-4add-b096-19497ba498b3 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:48.061639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6946e-624d-4add-b096-19497ba498b3 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:48.061922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6946e-624d-4add-b096-19497ba498b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:48.070092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4426a342e6564b0daf142e3d0bf2c733', 'request_id': 'req-2855db5e-818e-4826-ac0b-bcb2ed31dc53'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:48.089549 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-15d6946e-624d-4add-b096-19497ba498b3 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:48.091164 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-15d6946e-624d-4add-b096-19497ba498b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:48.148876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4426a342e6564b0daf142e3d0bf2c733', 'request_id': 'req-2855db5e-818e-4826-ac0b-bcb2ed31dc53'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:48.209813 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4426a342e6564b0daf142e3d0bf2c733', 'request_id': 'req-2855db5e-818e-4826-ac0b-bcb2ed31dc53'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:48.209984 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 968/1902] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:48.210070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] The token cache is being invalidate because project 4426a342e6564b0daf142e3d0bf2c733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:48.210070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:48.210070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:48.210070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 935/1903] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:47 2022] DELETE /identity/v3/projects/4426a342e6564b0daf142e3d0bf2c733 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:48.216356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18b0d8-4663-4dc2-9888-0a796ba6ed88 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:48.216933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18b0d8-4663-4dc2-9888-0a796ba6ed88 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:48.217675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18b0d8-4663-4dc2-9888-0a796ba6ed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:48.226980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:48.228557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:48.241945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-bb18b0d8-4663-4dc2-9888-0a796ba6ed88 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:48.243719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bb18b0d8-4663-4dc2-9888-0a796ba6ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:48.265068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 969/1904] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:48.283035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7462f1-1ede-443f-a445-a3d86e74d181 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:48.283035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7462f1-1ede-443f-a445-a3d86e74d181 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:48.283035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7462f1-1ede-443f-a445-a3d86e74d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:48.309235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-9f7462f1-1ede-443f-a445-a3d86e74d181 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:48.311798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9f7462f1-1ede-443f-a445-a3d86e74d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:48.334281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 970/1905] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:48.340417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7462f1-1ede-443f-a445-a3d86e74d181 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:48.349352 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7462f1-1ede-443f-a445-a3d86e74d181 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:48.356054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f801e-e916-4167-8b26-9a80d98ca831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:48.357059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f801e-e916-4167-8b26-9a80d98ca831 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:48.357513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f801e-e916-4167-8b26-9a80d98ca831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:48.357989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f801e-e916-4167-8b26-9a80d98ca831 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:48.359111 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f801e-e916-4167-8b26-9a80d98ca831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:29:48.359693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f801e-e916-4167-8b26-9a80d98ca831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:48.363509 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f801e-e916-4167-8b26-9a80d98ca831 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:48.382679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 971/1906] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:29:48.383721 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f801e-e916-4167-8b26-9a80d98ca831 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:48.399025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f801e-e916-4167-8b26-9a80d98ca831 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:48.406770 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855db5e-818e-4826-ac0b-bcb2ed31dc53 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:48.410591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10b37a-e603-477a-b253-bd9079ec748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:48.411828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10b37a-e603-477a-b253-bd9079ec748d admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:48.412905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10b37a-e603-477a-b253-bd9079ec748d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:48.414180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10b37a-e603-477a-b253-bd9079ec748d admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:48.415010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10b37a-e603-477a-b253-bd9079ec748d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:48.420562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0aa98-fba2-47c1-879b-f04e5eb9baf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:48.421731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10b37a-e603-477a-b253-bd9079ec748d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:48.423239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0aa98-fba2-47c1-879b-f04e5eb9baf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:48.426618 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0aa98-fba2-47c1-879b-f04e5eb9baf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:48.427050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0aa98-fba2-47c1-879b-f04e5eb9baf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:48.432352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a1f0aa98-fba2-47c1-879b-f04e5eb9baf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:48.466847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0aa98-fba2-47c1-879b-f04e5eb9baf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:48.468548 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0aa98-fba2-47c1-879b-f04e5eb9baf3 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:48.479988 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 936/1907] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:48.575936 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 972/1908] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:48 2022] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:48.580019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0aa98-fba2-47c1-879b-f04e5eb9baf3 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:48.589963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0aa98-fba2-47c1-879b-f04e5eb9baf3 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:48.668156 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226c1b2-c206-4869-b815-575a4937d5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:48.668979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226c1b2-c206-4869-b815-575a4937d5be admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:48.669405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226c1b2-c206-4869-b815-575a4937d5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:48.670057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226c1b2-c206-4869-b815-575a4937d5be admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:48.670935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226c1b2-c206-4869-b815-575a4937d5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:48.674101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226c1b2-c206-4869-b815-575a4937d5be admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:48.775542 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 937/1909] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:48 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:48.776860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10b37a-e603-477a-b253-bd9079ec748d admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:48.787103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10b37a-e603-477a-b253-bd9079ec748d admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:48.792373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fbdfd-b715-4c46-a571-8df40f9a2b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:48.793047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fbdfd-b715-4c46-a571-8df40f9a2b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:48.793358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fbdfd-b715-4c46-a571-8df40f9a2b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:48.793634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fbdfd-b715-4c46-a571-8df40f9a2b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:48.794398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fbdfd-b715-4c46-a571-8df40f9a2b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:48.796421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fbdfd-b715-4c46-a571-8df40f9a2b3d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:48.808292 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 973/1910] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:48.811411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226c1b2-c206-4869-b815-575a4937d5be admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:48.822727 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226c1b2-c206-4869-b815-575a4937d5be admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:48.828457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9e6c2-11da-49f6-b32e-e8f3d8dfae90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:48.829800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e6c2-11da-49f6-b32e-e8f3d8dfae90 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:48.829800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e6c2-11da-49f6-b32e-e8f3d8dfae90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:48.829800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e6c2-11da-49f6-b32e-e8f3d8dfae90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:48.830491 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9e6c2-11da-49f6-b32e-e8f3d8dfae90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:48.832121 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9e6c2-11da-49f6-b32e-e8f3d8dfae90 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:48.843057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 938/1911] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:29:48.849322 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fbdfd-b715-4c46-a571-8df40f9a2b3d admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:48.858011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fbdfd-b715-4c46-a571-8df40f9a2b3d admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:48.863929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da19a6-526b-4233-b429-453150f6f90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:48.864845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da19a6-526b-4233-b429-453150f6f90c admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:48.865142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da19a6-526b-4233-b429-453150f6f90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:48.865434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da19a6-526b-4233-b429-453150f6f90c admin admin] PATH_INFO: `/v3/projects/a5b48e9bfcb344aead60db4b540abb2b/users/eeaf00f5e4854462b48ccc77dc03833f/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:48.881576 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da19a6-526b-4233-b429-453150f6f90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b48e9bfcb344aead60db4b540abb2b, user_id=eeaf00f5e4854462b48ccc77dc03833f, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:48.884351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da19a6-526b-4233-b429-453150f6f90c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:48.955039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:48.961063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 974/1912] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:48 2022] PUT /identity/v3/projects/a5b48e9bfcb344aead60db4b540abb2b/users/eeaf00f5e4854462b48ccc77dc03833f/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:48.972032 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fe910-0105-4f67-875d-f479bc3dd174 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:48.972257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fe910-0105-4f67-875d-f479bc3dd174 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:48.972564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fe910-0105-4f67-875d-f479bc3dd174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:49.002699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-506fe910-0105-4f67-875d-f479bc3dd174 None None] MFA Rules not processed for user `eeaf00f5e4854462b48ccc77dc03833f`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:49.003916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-506fe910-0105-4f67-875d-f479bc3dd174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:49.072720 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 939/1913] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:49.076977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da19a6-526b-4233-b429-453150f6f90c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:49.180756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da19a6-526b-4233-b429-453150f6f90c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:49.185849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcf4af-4910-40dd-965d-427f705f3094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:49.186527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcf4af-4910-40dd-965d-427f705f3094 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:49.186815 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcf4af-4910-40dd-965d-427f705f3094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:49.187095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcf4af-4910-40dd-965d-427f705f3094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:49.187802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcf4af-4910-40dd-965d-427f705f3094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:49.189977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcf4af-4910-40dd-965d-427f705f3094 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:49.297585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 975/1914] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:49 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:29:49.298847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fe910-0105-4f67-875d-f479bc3dd174 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:49.319370 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fe910-0105-4f67-875d-f479bc3dd174 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:49.446756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fc874-0f50-4dc7-82b8-2e97bc423a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:49.453414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fc874-0f50-4dc7-82b8-2e97bc423a2f admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:49.453414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fc874-0f50-4dc7-82b8-2e97bc423a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:49.453414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fc874-0f50-4dc7-82b8-2e97bc423a2f admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:49.455630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fc874-0f50-4dc7-82b8-2e97bc423a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:49.467667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fc874-0f50-4dc7-82b8-2e97bc423a2f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:49.558536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 940/1915] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:49 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:49.560707 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcf4af-4910-40dd-965d-427f705f3094 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:49.574886 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcf4af-4910-40dd-965d-427f705f3094 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:49.581243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877ac1a-2dc9-414a-9a93-624b178c8ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:49.582736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877ac1a-2dc9-414a-9a93-624b178c8ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:49.582736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877ac1a-2dc9-414a-9a93-624b178c8ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:49.582736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877ac1a-2dc9-414a-9a93-624b178c8ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:49.583445 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877ac1a-2dc9-414a-9a93-624b178c8ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:49.585084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877ac1a-2dc9-414a-9a93-624b178c8ad0 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:49.601185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 976/1916] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:29:49.603772 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fc874-0f50-4dc7-82b8-2e97bc423a2f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:49.616604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fc874-0f50-4dc7-82b8-2e97bc423a2f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:49.621849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab215182-65fd-48bb-bc3d-0799acd4ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:49.623060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab215182-65fd-48bb-bc3d-0799acd4ff51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:49.623563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab215182-65fd-48bb-bc3d-0799acd4ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:49.624541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab215182-65fd-48bb-bc3d-0799acd4ff51 admin admin] PATH_INFO: `/v3/projects/bdccd70d1bc64fdbb9c5c7e8d51efa59/users/f454a9210718486bbd96877fcc3bcc16/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:49.648963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab215182-65fd-48bb-bc3d-0799acd4ff51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdccd70d1bc64fdbb9c5c7e8d51efa59, user_id=f454a9210718486bbd96877fcc3bcc16, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:49.652064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab215182-65fd-48bb-bc3d-0799acd4ff51 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:49.786269 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 941/1917] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:49 2022] PUT /identity/v3/projects/bdccd70d1bc64fdbb9c5c7e8d51efa59/users/f454a9210718486bbd96877fcc3bcc16/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:49.794704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877ac1a-2dc9-414a-9a93-624b178c8ad0 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:49.810237 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877ac1a-2dc9-414a-9a93-624b178c8ad0 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:49.877439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b972c-93cc-4d59-bbf6-5953a68be18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:49.878783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b972c-93cc-4d59-bbf6-5953a68be18a admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:49.879705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b972c-93cc-4d59-bbf6-5953a68be18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:49.880214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b972c-93cc-4d59-bbf6-5953a68be18a admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:49.880776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b972c-93cc-4d59-bbf6-5953a68be18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:49.882491 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b972c-93cc-4d59-bbf6-5953a68be18a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:49.892800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 977/1918] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:49.897015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab215182-65fd-48bb-bc3d-0799acd4ff51 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:49.909024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab215182-65fd-48bb-bc3d-0799acd4ff51 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:49.913598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32913c1-8f60-4669-a78e-3b50f6de8fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:49.914484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32913c1-8f60-4669-a78e-3b50f6de8fba admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:49.914768 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32913c1-8f60-4669-a78e-3b50f6de8fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:49.915334 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32913c1-8f60-4669-a78e-3b50f6de8fba admin admin] PATH_INFO: `/v3/projects/bdccd70d1bc64fdbb9c5c7e8d51efa59/users/f454a9210718486bbd96877fcc3bcc16/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:49.917089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32913c1-8f60-4669-a78e-3b50f6de8fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdccd70d1bc64fdbb9c5c7e8d51efa59, user_id=f454a9210718486bbd96877fcc3bcc16, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:49.920581 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32913c1-8f60-4669-a78e-3b50f6de8fba admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:49.942965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 942/1919] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:49 2022] PUT /identity/v3/projects/bdccd70d1bc64fdbb9c5c7e8d51efa59/users/f454a9210718486bbd96877fcc3bcc16/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:49.945048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927cc34-5ef1-4834-9c62-03fdd840264c None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:49.945412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927cc34-5ef1-4834-9c62-03fdd840264c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:49.945921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927cc34-5ef1-4834-9c62-03fdd840264c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:49.986730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-3927cc34-5ef1-4834-9c62-03fdd840264c None None] MFA Rules not processed for user `f454a9210718486bbd96877fcc3bcc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:49.987966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3927cc34-5ef1-4834-9c62-03fdd840264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:50.072424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 978/1920] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:50.087670 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32913c1-8f60-4669-a78e-3b50f6de8fba admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:50.090289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b32913c1-8f60-4669-a78e-3b50f6de8fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:50.100530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927cc34-5ef1-4834-9c62-03fdd840264c None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:50.103602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3927cc34-5ef1-4834-9c62-03fdd840264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:50.162106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32913c1-8f60-4669-a78e-3b50f6de8fba admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:50.167875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9e6a2-155e-40a8-8317-f8ce1829e533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:50.169070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9e6a2-155e-40a8-8317-f8ce1829e533 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:50.169905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9e6a2-155e-40a8-8317-f8ce1829e533 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:50.170438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9e6a2-155e-40a8-8317-f8ce1829e533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:50.186739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927cc34-5ef1-4834-9c62-03fdd840264c None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:50.193204 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9af5e6-5d3f-40e2-8c77-963d48fb263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:50.194406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9af5e6-5d3f-40e2-8c77-963d48fb263e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:50.194694 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9af5e6-5d3f-40e2-8c77-963d48fb263e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:50.195148 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9af5e6-5d3f-40e2-8c77-963d48fb263e admin admin] PATH_INFO: `/v3/users/3c6dd807429742cc8aa55e94f020cb1c` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:50.196602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9af5e6-5d3f-40e2-8c77-963d48fb263e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c6dd807429742cc8aa55e94f020cb1c)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:50.200048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9af5e6-5d3f-40e2-8c77-963d48fb263e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:50.240292 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9e6a2-155e-40a8-8317-f8ce1829e533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:50.241856 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9e6a2-155e-40a8-8317-f8ce1829e533 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:50.252882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 943/1921] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:29:50.474547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1b9af5e6-5d3f-40e2-8c77-963d48fb263e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c6dd807429742cc8aa55e94f020cb1c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:50.580714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b9f15-db3a-447e-8f2f-184cc6c6cda7 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:50.581014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b9f15-db3a-447e-8f2f-184cc6c6cda7 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:50.581319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b9f15-db3a-447e-8f2f-184cc6c6cda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:50.596977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1b9af5e6-5d3f-40e2-8c77-963d48fb263e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c6dd807429742cc8aa55e94f020cb1c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:50.597854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1b9af5e6-5d3f-40e2-8c77-963d48fb263e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c6dd807429742cc8aa55e94f020cb1c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:50.611081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-848b9f15-db3a-447e-8f2f-184cc6c6cda7 None None] MFA Rules not processed for user `04e6be5748904071b53931cd7714b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:50.612190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1b9af5e6-5d3f-40e2-8c77-963d48fb263e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c6dd807429742cc8aa55e94f020cb1c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:50.612377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-848b9f15-db3a-447e-8f2f-184cc6c6cda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:50.622574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1b9af5e6-5d3f-40e2-8c77-963d48fb263e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c6dd807429742cc8aa55e94f020cb1c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:50.632333 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 979/1922] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:50 2022] DELETE /identity/v3/users/3c6dd807429742cc8aa55e94f020cb1c => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:50.636537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a3c3-eb36-406a-889f-e984c1d90c4b None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:50.637264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a3c3-eb36-406a-889f-e984c1d90c4b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:50.637264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a3c3-eb36-406a-889f-e984c1d90c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:50.658059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-8d54a3c3-eb36-406a-889f-e984c1d90c4b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:50.663169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8d54a3c3-eb36-406a-889f-e984c1d90c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:50.716827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 944/1923] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:50.730006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 980/1924] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:50.741500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b9f15-db3a-447e-8f2f-184cc6c6cda7 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:50.744133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-848b9f15-db3a-447e-8f2f-184cc6c6cda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:50.768692 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:50.805921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b9f15-db3a-447e-8f2f-184cc6c6cda7 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:50.925805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e06e8e-dc3a-4281-a24a-a33d601502e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:50.925805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06e8e-dc3a-4281-a24a-a33d601502e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:50.925805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06e8e-dc3a-4281-a24a-a33d601502e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:50.925805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06e8e-dc3a-4281-a24a-a33d601502e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:50.926429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e06e8e-dc3a-4281-a24a-a33d601502e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:50.926429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e06e8e-dc3a-4281-a24a-a33d601502e7 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:50.926429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 945/1925] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:52.010734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a3c3-eb36-406a-889f-e984c1d90c4b None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:52.012342 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8d54a3c3-eb36-406a-889f-e984c1d90c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:52.083287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a3c3-eb36-406a-889f-e984c1d90c4b None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:52.087665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dafca-c8d9-40b7-947f-3c69aaf5e7e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:52.088390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dafca-c8d9-40b7-947f-3c69aaf5e7e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:52.089889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dafca-c8d9-40b7-947f-3c69aaf5e7e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:52.089889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dafca-c8d9-40b7-947f-3c69aaf5e7e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:52.163681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e06e8e-dc3a-4281-a24a-a33d601502e7 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:52.164218 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11dafca-c8d9-40b7-947f-3c69aaf5e7e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:52.166036 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a1e06e8e-dc3a-4281-a24a-a33d601502e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:52.166233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11dafca-c8d9-40b7-947f-3c69aaf5e7e4 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:52.178997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 981/1926] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:52.185379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e06e8e-dc3a-4281-a24a-a33d601502e7 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:52.192492 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5d89e-0015-4c67-82b7-531378696218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:52.193998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5d89e-0015-4c67-82b7-531378696218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:52.194590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5d89e-0015-4c67-82b7-531378696218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:52.195007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5d89e-0015-4c67-82b7-531378696218 admin admin] PATH_INFO: `/v3/users/df9e52014b3e4f2c8d6a8a7447212d19` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:52.196528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5d89e-0015-4c67-82b7-531378696218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9e52014b3e4f2c8d6a8a7447212d19)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:52.201396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5d89e-0015-4c67-82b7-531378696218 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:52.467357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:52.494052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-48d5d89e-0015-4c67-82b7-531378696218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9e52014b3e4f2c8d6a8a7447212d19'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:52.512580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dafca-c8d9-40b7-947f-3c69aaf5e7e4 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:52.515176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d11dafca-c8d9-40b7-947f-3c69aaf5e7e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:52.531396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dafca-c8d9-40b7-947f-3c69aaf5e7e4 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:52.536560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:52.537544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:52.537903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:52.538246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] PATH_INFO: `/v3/projects/ce7ad47398884b858a65ea6fd52a2ce6` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:52.539608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7ad47398884b858a65ea6fd52a2ce6)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:52.541633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:52.625353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-48d5d89e-0015-4c67-82b7-531378696218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9e52014b3e4f2c8d6a8a7447212d19'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:52.643174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-48d5d89e-0015-4c67-82b7-531378696218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9e52014b3e4f2c8d6a8a7447212d19'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:52.644680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-48d5d89e-0015-4c67-82b7-531378696218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9e52014b3e4f2c8d6a8a7447212d19'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:52.658012 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-48d5d89e-0015-4c67-82b7-531378696218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9e52014b3e4f2c8d6a8a7447212d19'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:52.664623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 946/1927] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:52 2022] DELETE /identity/v3/users/df9e52014b3e4f2c8d6a8a7447212d19 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:52.669845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e302060-15d9-48e2-af04-d7b713ffffa7 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:52.670154 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e302060-15d9-48e2-af04-d7b713ffffa7 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:52.670444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e302060-15d9-48e2-af04-d7b713ffffa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:52.690533 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-0e302060-15d9-48e2-af04-d7b713ffffa7 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:52.694130 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0e302060-15d9-48e2-af04-d7b713ffffa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:52.722011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7ad47398884b858a65ea6fd52a2ce6', 'request_id': 'req-c41137e0-ebc5-498a-8a3d-b76c37970b39'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:52.781881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 947/1928] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:52.791767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e302060-15d9-48e2-af04-d7b713ffffa7 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:52.793177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0e302060-15d9-48e2-af04-d7b713ffffa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:52.839005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7ad47398884b858a65ea6fd52a2ce6', 'request_id': 'req-c41137e0-ebc5-498a-8a3d-b76c37970b39'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:52.847010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7ad47398884b858a65ea6fd52a2ce6', 'request_id': 'req-c41137e0-ebc5-498a-8a3d-b76c37970b39'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:52.858751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] The token cache is being invalidate because project ce7ad47398884b858a65ea6fd52a2ce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:52.859041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:52.859685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:52.861498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 982/1929] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:52 2022] DELETE /identity/v3/projects/ce7ad47398884b858a65ea6fd52a2ce6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:29:52.863631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e302060-15d9-48e2-af04-d7b713ffffa7 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:52.865747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:52.867561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744af7a1-e953-4f57-b135-352b326b8091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:52.867693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:52.868468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744af7a1-e953-4f57-b135-352b326b8091 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:52.868934 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744af7a1-e953-4f57-b135-352b326b8091 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:52.869472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744af7a1-e953-4f57-b135-352b326b8091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:52.871844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-744af7a1-e953-4f57-b135-352b326b8091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:52.884924 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744af7a1-e953-4f57-b135-352b326b8091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:52.885169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41137e0-ebc5-498a-8a3d-b76c37970b39 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:52.887287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744af7a1-e953-4f57-b135-352b326b8091 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:52.890562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:52.891446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:52.892354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:52.892638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] PATH_INFO: `/v3/users/3c9b529fd5e04dfd829db9e93dff6a40` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:52.893924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c9b529fd5e04dfd829db9e93dff6a40)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:52.896177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:52.899948 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 948/1930] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:29:53.101826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c9b529fd5e04dfd829db9e93dff6a40'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:53.177512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c9b529fd5e04dfd829db9e93dff6a40'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:53.178168 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c9b529fd5e04dfd829db9e93dff6a40'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:53.191433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c9b529fd5e04dfd829db9e93dff6a40'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:53.199615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c9b529fd5e04dfd829db9e93dff6a40'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:53.206534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 983/1931] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:52 2022] DELETE /identity/v3/users/3c9b529fd5e04dfd829db9e93dff6a40 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:53.385850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744af7a1-e953-4f57-b135-352b326b8091 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:53.387666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-744af7a1-e953-4f57-b135-352b326b8091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:53.400823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744af7a1-e953-4f57-b135-352b326b8091 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:53.483038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:53.483906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:53.484196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:53.484504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] PATH_INFO: `/v3/projects/e2ac9af0f76b45d794ffee43971217a5` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:53.486325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ac9af0f76b45d794ffee43971217a5)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:53.488275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:53.607816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ac9af0f76b45d794ffee43971217a5', 'request_id': 'req-16a18ec8-080b-4d15-b328-ff37fdc0b810'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:53.705603 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ac9af0f76b45d794ffee43971217a5', 'request_id': 'req-16a18ec8-080b-4d15-b328-ff37fdc0b810'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:53.716168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ac9af0f76b45d794ffee43971217a5', 'request_id': 'req-16a18ec8-080b-4d15-b328-ff37fdc0b810'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:53.744193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] The token cache is being invalidate because project e2ac9af0f76b45d794ffee43971217a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:53.745166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:53.749732 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:53.752470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 949/1932] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:53 2022] DELETE /identity/v3/projects/e2ac9af0f76b45d794ffee43971217a5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:53.756215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:53.757909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:53.788426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b4424-9515-41a9-931d-4fd0db7f62be admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:53.882378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a17b7b-3733-4e09-a8a6-d27fa5e83361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:53.883357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17b7b-3733-4e09-a8a6-d27fa5e83361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:53.883916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17b7b-3733-4e09-a8a6-d27fa5e83361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:53.883916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17b7b-3733-4e09-a8a6-d27fa5e83361 admin admin] PATH_INFO: `/v3/users/beb4522c274b4408a96568a9f855f973` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:53.894208 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a17b7b-3733-4e09-a8a6-d27fa5e83361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb4522c274b4408a96568a9f855f973)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:53.896311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a17b7b-3733-4e09-a8a6-d27fa5e83361 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:54.009780 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:54.011278 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:54.027057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a18ec8-080b-4d15-b328-ff37fdc0b810 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:54.031925 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecc9bc-c645-4b15-bdf7-13252e396057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:54.033394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecc9bc-c645-4b15-bdf7-13252e396057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:54.033682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecc9bc-c645-4b15-bdf7-13252e396057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:54.033991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecc9bc-c645-4b15-bdf7-13252e396057 admin admin] PATH_INFO: `/v3/projects/86acf3742b284f2692ff19cb4ea0c180` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:54.035157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecc9bc-c645-4b15-bdf7-13252e396057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86acf3742b284f2692ff19cb4ea0c180)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:54.037236 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecc9bc-c645-4b15-bdf7-13252e396057 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:54.120443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:54.133907 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5a17b7b-3733-4e09-a8a6-d27fa5e83361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb4522c274b4408a96568a9f855f973'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:54.200586 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-70ecc9bc-c645-4b15-bdf7-13252e396057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86acf3742b284f2692ff19cb4ea0c180', 'request_id': 'req-70ecc9bc-c645-4b15-bdf7-13252e396057'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:54.211779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5a17b7b-3733-4e09-a8a6-d27fa5e83361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb4522c274b4408a96568a9f855f973'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:54.213380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:54.214014 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5a17b7b-3733-4e09-a8a6-d27fa5e83361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb4522c274b4408a96568a9f855f973'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:54.226606 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5a17b7b-3733-4e09-a8a6-d27fa5e83361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb4522c274b4408a96568a9f855f973'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:54.233607 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5a17b7b-3733-4e09-a8a6-d27fa5e83361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb4522c274b4408a96568a9f855f973'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:54.239967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 984/1933] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:29:53 2022] DELETE /identity/v3/users/beb4522c274b4408a96568a9f855f973 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:54.242933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbe4eb-2e6c-4e9b-a7dc-46b9d5bcefcc None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:54.242933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbe4eb-2e6c-4e9b-a7dc-46b9d5bcefcc None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:54.242933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbe4eb-2e6c-4e9b-a7dc-46b9d5bcefcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:54.259758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-2fbbe4eb-2e6c-4e9b-a7dc-46b9d5bcefcc None None] MFA Rules not processed for user `04e6be5748904071b53931cd7714b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:54.260965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-2fbbe4eb-2e6c-4e9b-a7dc-46b9d5bcefcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:54.321102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 985/1934] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:54.335611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-70ecc9bc-c645-4b15-bdf7-13252e396057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86acf3742b284f2692ff19cb4ea0c180', 'request_id': 'req-70ecc9bc-c645-4b15-bdf7-13252e396057'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:54.347189 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-70ecc9bc-c645-4b15-bdf7-13252e396057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86acf3742b284f2692ff19cb4ea0c180', 'request_id': 'req-70ecc9bc-c645-4b15-bdf7-13252e396057'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:54.358004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-70ecc9bc-c645-4b15-bdf7-13252e396057 admin admin] The token cache is being invalidate because project 86acf3742b284f2692ff19cb4ea0c180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:54.358519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-70ecc9bc-c645-4b15-bdf7-13252e396057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:54.359303 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-70ecc9bc-c645-4b15-bdf7-13252e396057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:54.361163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 950/1935] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:54 2022] DELETE /identity/v3/projects/86acf3742b284f2692ff19cb4ea0c180 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:29:54.366024 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7ccfc-c880-4fac-abb2-0e5638ab8fe9 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:54.366363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7ccfc-c880-4fac-abb2-0e5638ab8fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:54.366678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7ccfc-c880-4fac-abb2-0e5638ab8fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:54.385904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-eba7ccfc-c880-4fac-abb2-0e5638ab8fe9 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:54.387082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-eba7ccfc-c880-4fac-abb2-0e5638ab8fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:54.477292 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 986/1936] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:54.484475 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78456d-087a-4e70-849f-d03306970e80 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:54.484985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78456d-087a-4e70-849f-d03306970e80 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:54.485301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78456d-087a-4e70-849f-d03306970e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:54.524484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-2e78456d-087a-4e70-849f-d03306970e80 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:54.525999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2e78456d-087a-4e70-849f-d03306970e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:54.537612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 951/1937] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:54.546566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7ccfc-c880-4fac-abb2-0e5638ab8fe9 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:54.564380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7ccfc-c880-4fac-abb2-0e5638ab8fe9 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:54.576257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586127e-aa28-4bf7-9acc-b076671b8a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:54.576960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586127e-aa28-4bf7-9acc-b076671b8a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:54.577387 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586127e-aa28-4bf7-9acc-b076671b8a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:54.577535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586127e-aa28-4bf7-9acc-b076671b8a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:54.578277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586127e-aa28-4bf7-9acc-b076671b8a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:29:54.578588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586127e-aa28-4bf7-9acc-b076671b8a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:54.583544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586127e-aa28-4bf7-9acc-b076671b8a8a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:54.614518 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 987/1938] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:29:54.614758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78456d-087a-4e70-849f-d03306970e80 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:54.625436 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78456d-087a-4e70-849f-d03306970e80 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:54.632055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ffc36-111f-4a03-aca1-5ba0600b7c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:54.632745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ffc36-111f-4a03-aca1-5ba0600b7c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:54.639298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ffc36-111f-4a03-aca1-5ba0600b7c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:54.639298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ffc36-111f-4a03-aca1-5ba0600b7c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:54.639298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ffc36-111f-4a03-aca1-5ba0600b7c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:54.639298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ffc36-111f-4a03-aca1-5ba0600b7c54 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:54.776464 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586127e-aa28-4bf7-9acc-b076671b8a8a admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:54.783601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 952/1939] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:54 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:29:54.788048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586127e-aa28-4bf7-9acc-b076671b8a8a admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:54.821525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ffc36-111f-4a03-aca1-5ba0600b7c54 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:54.823753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-275ffc36-111f-4a03-aca1-5ba0600b7c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:54.866624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cdfd5-79fe-4e9c-a2aa-3d95b10dbc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:54.867405 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cdfd5-79fe-4e9c-a2aa-3d95b10dbc52 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:54.867698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cdfd5-79fe-4e9c-a2aa-3d95b10dbc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:54.868075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cdfd5-79fe-4e9c-a2aa-3d95b10dbc52 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:54.868959 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cdfd5-79fe-4e9c-a2aa-3d95b10dbc52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:54.871131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cdfd5-79fe-4e9c-a2aa-3d95b10dbc52 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:54.920952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ffc36-111f-4a03-aca1-5ba0600b7c54 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:54.927101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:54.928388 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:54.929595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:54.930091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e admin admin] PATH_INFO: `/v3/projects/2b260298cc42443997a01c15100b1958` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:54.931522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b260298cc42443997a01c15100b1958)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:54.934793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:55.001663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 988/1940] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:54 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:55.003244 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cdfd5-79fe-4e9c-a2aa-3d95b10dbc52 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:55.022655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cdfd5-79fe-4e9c-a2aa-3d95b10dbc52 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:55.029302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a33fa-3d8c-42fe-86f6-b2f4b177eb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:55.030062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a33fa-3d8c-42fe-86f6-b2f4b177eb6e admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:55.030350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a33fa-3d8c-42fe-86f6-b2f4b177eb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:55.030627 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a33fa-3d8c-42fe-86f6-b2f4b177eb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:55.031863 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a33fa-3d8c-42fe-86f6-b2f4b177eb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:55.036852 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a33fa-3d8c-42fe-86f6-b2f4b177eb6e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:55.049534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 989/1941] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:29:55.053315 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a33fa-3d8c-42fe-86f6-b2f4b177eb6e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:55.069898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a33fa-3d8c-42fe-86f6-b2f4b177eb6e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:55.097646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654eb641-9c03-4dd7-a223-40f3129f2dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:55.098251 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b260298cc42443997a01c15100b1958', 'request_id': 'req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:55.101253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eb641-9c03-4dd7-a223-40f3129f2dab admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:55.103311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eb641-9c03-4dd7-a223-40f3129f2dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:55.103311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eb641-9c03-4dd7-a223-40f3129f2dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:55.103311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654eb641-9c03-4dd7-a223-40f3129f2dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:55.107818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654eb641-9c03-4dd7-a223-40f3129f2dab admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:55.137634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 990/1942] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:55.141743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654eb641-9c03-4dd7-a223-40f3129f2dab admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:55.155977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654eb641-9c03-4dd7-a223-40f3129f2dab admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:55.179029 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b260298cc42443997a01c15100b1958', 'request_id': 'req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:55.188721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b260298cc42443997a01c15100b1958', 'request_id': 'req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:55.214279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e admin admin] The token cache is being invalidate because project 2b260298cc42443997a01c15100b1958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:29:55.214689 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:55.216108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dfcc5f6b-284b-4c77-92ef-3eb31ef4bf0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:29:55.219119 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 953/1943] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:29:54 2022] DELETE /identity/v3/projects/2b260298cc42443997a01c15100b1958 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:29:55.224539 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aae0d-78b4-4c1c-a50e-7cab378f995d None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:55.226299 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aae0d-78b4-4c1c-a50e-7cab378f995d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:55.226601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aae0d-78b4-4c1c-a50e-7cab378f995d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:55.238672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddf630-dbfd-4288-9d20-f8ced23b159a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:55.240393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddf630-dbfd-4288-9d20-f8ced23b159a admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:55.240834 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddf630-dbfd-4288-9d20-f8ced23b159a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:55.241324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddf630-dbfd-4288-9d20-f8ced23b159a admin admin] PATH_INFO: `/v3/projects/f0743d3e1cd44d39bd99e1444e9cc92c/users/26029c0563b6474bb256653826e9a779/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:55.261367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-005aae0d-78b4-4c1c-a50e-7cab378f995d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:55.262170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddf630-dbfd-4288-9d20-f8ced23b159a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0743d3e1cd44d39bd99e1444e9cc92c, user_id=26029c0563b6474bb256653826e9a779, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:55.262672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-005aae0d-78b4-4c1c-a50e-7cab378f995d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:55.264982 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddf630-dbfd-4288-9d20-f8ced23b159a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:55.272007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 954/1944] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:55.280157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d78c6-a959-436a-a424-b964b081d14c None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:55.282994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d78c6-a959-436a-a424-b964b081d14c None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:55.282994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d78c6-a959-436a-a424-b964b081d14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:55.301408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-ad4d78c6-a959-436a-a424-b964b081d14c None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:55.302695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-ad4d78c6-a959-436a-a424-b964b081d14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:55.315277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 955/1945] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:55.316443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d78c6-a959-436a-a424-b964b081d14c None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:55.327824 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d78c6-a959-436a-a424-b964b081d14c None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:55.336990 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f76841-e239-492d-b499-f77f455231d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:55.338018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76841-e239-492d-b499-f77f455231d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:55.338501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76841-e239-492d-b499-f77f455231d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:55.338978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76841-e239-492d-b499-f77f455231d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:55.340234 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f76841-e239-492d-b499-f77f455231d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:29:55.340752 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f76841-e239-492d-b499-f77f455231d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:55.342854 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f76841-e239-492d-b499-f77f455231d6 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:55.367729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 991/1946] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:55 2022] PUT /identity/v3/projects/f0743d3e1cd44d39bd99e1444e9cc92c/users/26029c0563b6474bb256653826e9a779/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:29:55.370947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 956/1947] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:29:55.375886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f76841-e239-492d-b499-f77f455231d6 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:55.376717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbce7d-324b-4a44-91ba-a5d769c6f5bc None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:55.377094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbce7d-324b-4a44-91ba-a5d769c6f5bc None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:55.377510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbce7d-324b-4a44-91ba-a5d769c6f5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:55.394597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f76841-e239-492d-b499-f77f455231d6 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:55.411249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-b7dbce7d-324b-4a44-91ba-a5d769c6f5bc None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:55.416893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b7dbce7d-324b-4a44-91ba-a5d769c6f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:55.498607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bd287-711d-4ff3-9c6f-09768baaeeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:55.499422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bd287-711d-4ff3-9c6f-09768baaeeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:55.499985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bd287-711d-4ff3-9c6f-09768baaeeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:55.500281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bd287-711d-4ff3-9c6f-09768baaeeb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:55.501102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bd287-711d-4ff3-9c6f-09768baaeeb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:55.504663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bd287-711d-4ff3-9c6f-09768baaeeb8 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:55.548031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 992/1948] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:55.560393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbce7d-324b-4a44-91ba-a5d769c6f5bc None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:55.562487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b7dbce7d-324b-4a44-91ba-a5d769c6f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:55.636695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbce7d-324b-4a44-91ba-a5d769c6f5bc None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:55.641245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa9138-dddf-40ec-aede-3666510f294e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:55.642556 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa9138-dddf-40ec-aede-3666510f294e service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:55.642910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa9138-dddf-40ec-aede-3666510f294e service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:55.643259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa9138-dddf-40ec-aede-3666510f294e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:55.654339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa9138-dddf-40ec-aede-3666510f294e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:55.655894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa9138-dddf-40ec-aede-3666510f294e service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:55.671785 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 993/1949] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:55.691243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 957/1950] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:55 2022] POST /identity/v3/projects => generated 377 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:55.695467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa9138-dddf-40ec-aede-3666510f294e service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:55.709922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa9138-dddf-40ec-aede-3666510f294e service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:55.779265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a98abd-4f2c-4f25-bd5f-ea09114ff98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:55.779947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a98abd-4f2c-4f25-bd5f-ea09114ff98e admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:55.780323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a98abd-4f2c-4f25-bd5f-ea09114ff98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:55.780614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a98abd-4f2c-4f25-bd5f-ea09114ff98e admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:55.781371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a98abd-4f2c-4f25-bd5f-ea09114ff98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:55.783956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a98abd-4f2c-4f25-bd5f-ea09114ff98e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:55.878616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 994/1951] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:55 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:55.879519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bd287-711d-4ff3-9c6f-09768baaeeb8 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:55.894562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bd287-711d-4ff3-9c6f-09768baaeeb8 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:55.900343 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f52366-1ee3-4b53-abea-aa862ff56195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:55.901067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f52366-1ee3-4b53-abea-aa862ff56195 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:55.901555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f52366-1ee3-4b53-abea-aa862ff56195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:55.908479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f52366-1ee3-4b53-abea-aa862ff56195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:55.908479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f52366-1ee3-4b53-abea-aa862ff56195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:55.908479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f52366-1ee3-4b53-abea-aa862ff56195 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:55.914836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 958/1952] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:55.918825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a98abd-4f2c-4f25-bd5f-ea09114ff98e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:55.929742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a98abd-4f2c-4f25-bd5f-ea09114ff98e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:55.935150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eaf7a-3de7-45fa-b8f6-c4541b37608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:55.935917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eaf7a-3de7-45fa-b8f6-c4541b37608d admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:55.936519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eaf7a-3de7-45fa-b8f6-c4541b37608d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:55.936650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eaf7a-3de7-45fa-b8f6-c4541b37608d admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:55.937429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eaf7a-3de7-45fa-b8f6-c4541b37608d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:55.963421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eaf7a-3de7-45fa-b8f6-c4541b37608d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:55.996855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 995/1953] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:55.998750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f52366-1ee3-4b53-abea-aa862ff56195 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:56.010963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f52366-1ee3-4b53-abea-aa862ff56195 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:56.016561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cba2b-44e7-48ec-a405-b1a74ad8f1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:56.017866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cba2b-44e7-48ec-a405-b1a74ad8f1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:56.018257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cba2b-44e7-48ec-a405-b1a74ad8f1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:56.018642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cba2b-44e7-48ec-a405-b1a74ad8f1cd admin admin] PATH_INFO: `/v3/projects/b2f906e5417b42c1a555030e5e4b250a/users/1c8d23b881274f9fb0f0ba4f00a72811/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:56.038431 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cba2b-44e7-48ec-a405-b1a74ad8f1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f906e5417b42c1a555030e5e4b250a, user_id=1c8d23b881274f9fb0f0ba4f00a72811, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:56.042095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cba2b-44e7-48ec-a405-b1a74ad8f1cd admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:56.197958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 959/1954] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:55 2022] PUT /identity/v3/projects/b2f906e5417b42c1a555030e5e4b250a/users/1c8d23b881274f9fb0f0ba4f00a72811/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:56.208631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad93d32-5311-4fbf-b71c-38a33210c90e None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:56.209243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad93d32-5311-4fbf-b71c-38a33210c90e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:56.209243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad93d32-5311-4fbf-b71c-38a33210c90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:56.238767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-aad93d32-5311-4fbf-b71c-38a33210c90e None None] MFA Rules not processed for user `1c8d23b881274f9fb0f0ba4f00a72811`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:56.240066 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-aad93d32-5311-4fbf-b71c-38a33210c90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:56.336611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 996/1955] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:56.341560 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cba2b-44e7-48ec-a405-b1a74ad8f1cd admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:56.431225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cba2b-44e7-48ec-a405-b1a74ad8f1cd admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:56.436088 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa01e1f-9109-4c00-b8da-7fc71ccb6eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:56.436868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa01e1f-9109-4c00-b8da-7fc71ccb6eeb admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:56.437277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa01e1f-9109-4c00-b8da-7fc71ccb6eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:56.437563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa01e1f-9109-4c00-b8da-7fc71ccb6eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:56.438262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa01e1f-9109-4c00-b8da-7fc71ccb6eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:56.440209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa01e1f-9109-4c00-b8da-7fc71ccb6eeb admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:56.585376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 960/1956] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:56 2022] POST /identity/v3/projects => generated 377 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:56.589080 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad93d32-5311-4fbf-b71c-38a33210c90e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:56.601142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad93d32-5311-4fbf-b71c-38a33210c90e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:56.721730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319998e8-e895-4123-ae6a-afc49390d226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:56.722477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319998e8-e895-4123-ae6a-afc49390d226 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:56.722769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319998e8-e895-4123-ae6a-afc49390d226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:56.723053 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319998e8-e895-4123-ae6a-afc49390d226 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:56.723757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319998e8-e895-4123-ae6a-afc49390d226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:56.725934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319998e8-e895-4123-ae6a-afc49390d226 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:56.834691 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 997/1957] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:56 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:56.838679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa01e1f-9109-4c00-b8da-7fc71ccb6eeb admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:56.849959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa01e1f-9109-4c00-b8da-7fc71ccb6eeb admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:56.855132 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df2746-6624-44fa-ba47-411efb1aa3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:56.856103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df2746-6624-44fa-ba47-411efb1aa3aa admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:56.856587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df2746-6624-44fa-ba47-411efb1aa3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:56.856935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df2746-6624-44fa-ba47-411efb1aa3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:56.857794 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df2746-6624-44fa-ba47-411efb1aa3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:56.859462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df2746-6624-44fa-ba47-411efb1aa3aa admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:56.870405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 961/1958] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:29:56.874126 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319998e8-e895-4123-ae6a-afc49390d226 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:56.886765 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319998e8-e895-4123-ae6a-afc49390d226 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:56.904913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a97faf-97d8-476d-b379-b95ed4f32c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:56.904913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a97faf-97d8-476d-b379-b95ed4f32c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:56.904913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a97faf-97d8-476d-b379-b95ed4f32c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:56.904913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a97faf-97d8-476d-b379-b95ed4f32c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:56.908107 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a97faf-97d8-476d-b379-b95ed4f32c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:56.908107 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a97faf-97d8-476d-b379-b95ed4f32c29 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:56.914889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 998/1959] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:56.918632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df2746-6624-44fa-ba47-411efb1aa3aa admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:56.926323 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:56.932323 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df2746-6624-44fa-ba47-411efb1aa3aa admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:56.939681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0b5ba-68c6-440a-ba5c-7a6142d8179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:56.940805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0b5ba-68c6-440a-ba5c-7a6142d8179b admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:56.941085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0b5ba-68c6-440a-ba5c-7a6142d8179b admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:56.941401 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0b5ba-68c6-440a-ba5c-7a6142d8179b admin admin] PATH_INFO: `/v3/projects/9179c108a3634ee9bd28e41263649642/users/a0620e525a594033a43b860f1bd8cfda/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:56.963753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0b5ba-68c6-440a-ba5c-7a6142d8179b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9179c108a3634ee9bd28e41263649642, user_id=a0620e525a594033a43b860f1bd8cfda, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:56.966573 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0b5ba-68c6-440a-ba5c-7a6142d8179b admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:56.980353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:57.010545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a97faf-97d8-476d-b379-b95ed4f32c29 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:57.012242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-05a97faf-97d8-476d-b379-b95ed4f32c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:57.056086 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 962/1960] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:56 2022] PUT /identity/v3/projects/9179c108a3634ee9bd28e41263649642/users/a0620e525a594033a43b860f1bd8cfda/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:57.067295 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840ff36-7a32-46a9-b583-11d55bd16c88 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:57.067486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840ff36-7a32-46a9-b583-11d55bd16c88 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:57.067739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840ff36-7a32-46a9-b583-11d55bd16c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:57.081195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a97faf-97d8-476d-b379-b95ed4f32c29 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:57.096632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-7840ff36-7a32-46a9-b583-11d55bd16c88 None None] MFA Rules not processed for user `a0620e525a594033a43b860f1bd8cfda`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:57.097874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7840ff36-7a32-46a9-b583-11d55bd16c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:57.162424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1524882-4ec5-4a73-8537-c353adc1a340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:57.163187 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1524882-4ec5-4a73-8537-c353adc1a340 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:57.163482 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1524882-4ec5-4a73-8537-c353adc1a340 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:57.163767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1524882-4ec5-4a73-8537-c353adc1a340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:57.165763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d1524882-4ec5-4a73-8537-c353adc1a340 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:57.179960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 963/1961] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:57.184379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840ff36-7a32-46a9-b583-11d55bd16c88 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:57.326086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1524882-4ec5-4a73-8537-c353adc1a340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:57.329649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1524882-4ec5-4a73-8537-c353adc1a340 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:57.340458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840ff36-7a32-46a9-b583-11d55bd16c88 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:57.347651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c06973-b2e4-41c1-a30e-e54a362ca25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:57.348534 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06973-b2e4-41c1-a30e-e54a362ca25f admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:57.348799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06973-b2e4-41c1-a30e-e54a362ca25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:57.349079 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06973-b2e4-41c1-a30e-e54a362ca25f admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:57.353106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c06973-b2e4-41c1-a30e-e54a362ca25f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:57.353106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c06973-b2e4-41c1-a30e-e54a362ca25f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:57.354122 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 999/1962] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:29:57.356833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6aad2-e012-485b-adac-667f53e19331 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:57.357138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6aad2-e012-485b-adac-667f53e19331 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:57.359330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6aad2-e012-485b-adac-667f53e19331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:57.400493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-96d6aad2-e012-485b-adac-667f53e19331 None None] MFA Rules not processed for user `26029c0563b6474bb256653826e9a779`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:57.401792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-96d6aad2-e012-485b-adac-667f53e19331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:57.494537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1000/1963] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:29:57.497834 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6aad2-e012-485b-adac-667f53e19331 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:57.499957 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-96d6aad2-e012-485b-adac-667f53e19331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:57.517435 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6aad2-e012-485b-adac-667f53e19331 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:57.522963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a60a62-e4e2-4a4c-b7e2-0558b811880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:57.528475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a60a62-e4e2-4a4c-b7e2-0558b811880c admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:57.528475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a60a62-e4e2-4a4c-b7e2-0558b811880c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:57.528475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a60a62-e4e2-4a4c-b7e2-0558b811880c admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:57.528475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a60a62-e4e2-4a4c-b7e2-0558b811880c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:57.528845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 964/1964] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:57 2022] POST /identity/v3/projects => generated 377 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:29:57.528931 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a60a62-e4e2-4a4c-b7e2-0558b811880c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:57.530044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c06973-b2e4-41c1-a30e-e54a362ca25f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:57.604468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c06973-b2e4-41c1-a30e-e54a362ca25f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:57.610114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f066f-d32a-4214-9c43-ff45d44d7c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:57.611355 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f066f-d32a-4214-9c43-ff45d44d7c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:57.611613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f066f-d32a-4214-9c43-ff45d44d7c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:57.611893 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f066f-d32a-4214-9c43-ff45d44d7c07 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:57.612852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f066f-d32a-4214-9c43-ff45d44d7c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:57.614884 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f066f-d32a-4214-9c43-ff45d44d7c07 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:57.647235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1001/1965] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:29:57 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:29:57.651157 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a60a62-e4e2-4a4c-b7e2-0558b811880c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:57.757686 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 965/1966] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:57 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:29:57.764540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f066f-d32a-4214-9c43-ff45d44d7c07 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:57.772295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a60a62-e4e2-4a4c-b7e2-0558b811880c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:57.778619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f066f-d32a-4214-9c43-ff45d44d7c07 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:57.780023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17998db7-11cf-4cd8-bd66-b943252bf6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:57.781069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17998db7-11cf-4cd8-bd66-b943252bf6fc admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:57.781647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17998db7-11cf-4cd8-bd66-b943252bf6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:57.782146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17998db7-11cf-4cd8-bd66-b943252bf6fc admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:57.784038 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17998db7-11cf-4cd8-bd66-b943252bf6fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:57.784664 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4a80f-f492-4f30-a3e5-2dc922b16d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:57.785472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4a80f-f492-4f30-a3e5-2dc922b16d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:57.785859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4a80f-f492-4f30-a3e5-2dc922b16d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:57.786241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4a80f-f492-4f30-a3e5-2dc922b16d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:57.787082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4a80f-f492-4f30-a3e5-2dc922b16d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:57.787894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17998db7-11cf-4cd8-bd66-b943252bf6fc admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:57.789612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4a80f-f492-4f30-a3e5-2dc922b16d31 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:57.805161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 966/1967] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:29:57.809165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4a80f-f492-4f30-a3e5-2dc922b16d31 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:57.821366 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4a80f-f492-4f30-a3e5-2dc922b16d31 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:57.827176 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f3371-37c3-4b30-8cf7-42434c969af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:57.834385 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f3371-37c3-4b30-8cf7-42434c969af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:57.834385 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f3371-37c3-4b30-8cf7-42434c969af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:57.834385 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f3371-37c3-4b30-8cf7-42434c969af6 admin admin] PATH_INFO: `/v3/projects/84a07e2bb616477a8dcfe6a4002c3523/users/8b41b8663e0b4996a9ecbc81b51bbcb5/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:57.870740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f3371-37c3-4b30-8cf7-42434c969af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a07e2bb616477a8dcfe6a4002c3523, user_id=8b41b8663e0b4996a9ecbc81b51bbcb5, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:57.873515 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f3371-37c3-4b30-8cf7-42434c969af6 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:58.006789 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 967/1968] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:57 2022] PUT /identity/v3/projects/84a07e2bb616477a8dcfe6a4002c3523/users/8b41b8663e0b4996a9ecbc81b51bbcb5/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:58.010504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f3371-37c3-4b30-8cf7-42434c969af6 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:58.019599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1002/1969] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:29:57 2022] POST /identity/v3/users => generated 293 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:29:58.038941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17998db7-11cf-4cd8-bd66-b943252bf6fc admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:58.052193 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17998db7-11cf-4cd8-bd66-b943252bf6fc admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:58.103378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f3371-37c3-4b30-8cf7-42434c969af6 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:58.111195 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0ab4b-91fc-4e93-8aa1-e4f4335c2f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:58.111986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0ab4b-91fc-4e93-8aa1-e4f4335c2f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:58.112980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0ab4b-91fc-4e93-8aa1-e4f4335c2f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:58.112980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0ab4b-91fc-4e93-8aa1-e4f4335c2f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:58.113673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0ab4b-91fc-4e93-8aa1-e4f4335c2f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:58.115509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0ab4b-91fc-4e93-8aa1-e4f4335c2f84 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:58.124083 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31dd88-db98-4efb-a5ce-fd3da8aaf7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:58.124840 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31dd88-db98-4efb-a5ce-fd3da8aaf7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:58.126540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31dd88-db98-4efb-a5ce-fd3da8aaf7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:58.126540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31dd88-db98-4efb-a5ce-fd3da8aaf7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:58.126877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31dd88-db98-4efb-a5ce-fd3da8aaf7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:58.130648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 968/1970] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:29:58.130807 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31dd88-db98-4efb-a5ce-fd3da8aaf7c9 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:58.134305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0ab4b-91fc-4e93-8aa1-e4f4335c2f84 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:58.148775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0ab4b-91fc-4e93-8aa1-e4f4335c2f84 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:58.173411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1003/1971] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:58.177348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe54fad-0ecd-4768-b26c-11beed3a8602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:58.177735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31dd88-db98-4efb-a5ce-fd3da8aaf7c9 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:58.177836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe54fad-0ecd-4768-b26c-11beed3a8602 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:58.177836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe54fad-0ecd-4768-b26c-11beed3a8602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:58.177836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe54fad-0ecd-4768-b26c-11beed3a8602 admin admin] PATH_INFO: `/v3/projects/84a07e2bb616477a8dcfe6a4002c3523/users/8b41b8663e0b4996a9ecbc81b51bbcb5/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:58.182816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe54fad-0ecd-4768-b26c-11beed3a8602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a07e2bb616477a8dcfe6a4002c3523, user_id=8b41b8663e0b4996a9ecbc81b51bbcb5, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:58.190590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31dd88-db98-4efb-a5ce-fd3da8aaf7c9 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:58.190987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe54fad-0ecd-4768-b26c-11beed3a8602 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:58.196948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d80c8-a8ad-4370-8175-5ec62735315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:58.198282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d80c8-a8ad-4370-8175-5ec62735315c admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:58.198908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d80c8-a8ad-4370-8175-5ec62735315c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:58.199377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d80c8-a8ad-4370-8175-5ec62735315c admin admin] PATH_INFO: `/v3/projects/408a62a83e4042498f9d9bcacf0fc1bc/users/005e68a8a58b49c5983461025c73d172/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:58.222294 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 969/1972] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:58 2022] PUT /identity/v3/projects/84a07e2bb616477a8dcfe6a4002c3523/users/8b41b8663e0b4996a9ecbc81b51bbcb5/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:58.228840 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d80c8-a8ad-4370-8175-5ec62735315c admin admin] RBAC: Authorizing `identity:create_grant(project_id=408a62a83e4042498f9d9bcacf0fc1bc, user_id=005e68a8a58b49c5983461025c73d172, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:58.232600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d54023-332b-4d30-9044-96d5b27a4ec9 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:58.233038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d54023-332b-4d30-9044-96d5b27a4ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:58.233434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d54023-332b-4d30-9044-96d5b27a4ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:58.236608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d80c8-a8ad-4370-8175-5ec62735315c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:58.272312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-59d54023-332b-4d30-9044-96d5b27a4ec9 None None] MFA Rules not processed for user `8b41b8663e0b4996a9ecbc81b51bbcb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:29:58.274161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-59d54023-332b-4d30-9044-96d5b27a4ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:58.349255 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1004/1973] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:58 2022] PUT /identity/v3/projects/408a62a83e4042498f9d9bcacf0fc1bc/users/005e68a8a58b49c5983461025c73d172/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:58.350695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d80c8-a8ad-4370-8175-5ec62735315c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:58.440022 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 970/1974] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:29:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:29:58.452943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d54023-332b-4d30-9044-96d5b27a4ec9 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:58.455271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-59d54023-332b-4d30-9044-96d5b27a4ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:29:58.476892 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d80c8-a8ad-4370-8175-5ec62735315c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:58.482389 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af8302-c132-4072-9068-ddf2acb4bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:58.483224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af8302-c132-4072-9068-ddf2acb4bdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:58.483617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af8302-c132-4072-9068-ddf2acb4bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:58.484096 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af8302-c132-4072-9068-ddf2acb4bdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:58.484944 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af8302-c132-4072-9068-ddf2acb4bdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:58.487413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af8302-c132-4072-9068-ddf2acb4bdd4 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:58.502250 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1005/1975] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:29:58.505950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af8302-c132-4072-9068-ddf2acb4bdd4 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:58.535623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af8302-c132-4072-9068-ddf2acb4bdd4 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:58.553242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b26dd-b4de-473e-abdf-38932d2d463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:58.554262 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b26dd-b4de-473e-abdf-38932d2d463d admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:58.554552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b26dd-b4de-473e-abdf-38932d2d463d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:58.554898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b26dd-b4de-473e-abdf-38932d2d463d admin admin] PATH_INFO: `/v3/projects/408a62a83e4042498f9d9bcacf0fc1bc/users/005e68a8a58b49c5983461025c73d172/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:58.569341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b26dd-b4de-473e-abdf-38932d2d463d admin admin] RBAC: Authorizing `identity:create_grant(project_id=408a62a83e4042498f9d9bcacf0fc1bc, user_id=005e68a8a58b49c5983461025c73d172, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:58.574390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b26dd-b4de-473e-abdf-38932d2d463d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:58.592066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d54023-332b-4d30-9044-96d5b27a4ec9 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:58.598706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1006/1976] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:29:58 2022] PUT /identity/v3/projects/408a62a83e4042498f9d9bcacf0fc1bc/users/005e68a8a58b49c5983461025c73d172/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:29:58.685926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d7146-d9f2-40bc-a3ab-191a2d7021d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:58.685926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d7146-d9f2-40bc-a3ab-191a2d7021d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:58.685926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d7146-d9f2-40bc-a3ab-191a2d7021d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:58.686572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d7146-d9f2-40bc-a3ab-191a2d7021d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:58.766069 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d7146-d9f2-40bc-a3ab-191a2d7021d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:58.767712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d7146-d9f2-40bc-a3ab-191a2d7021d4 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:58.781064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 971/1977] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:29:58.887597 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b26dd-b4de-473e-abdf-38932d2d463d admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:29:58.902479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b26dd-b4de-473e-abdf-38932d2d463d admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:29:58.907683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405776e-5fdd-43d5-a168-958b1ff957b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:29:58.908513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405776e-5fdd-43d5-a168-958b1ff957b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:29:58.908971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405776e-5fdd-43d5-a168-958b1ff957b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:29:58.909731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405776e-5fdd-43d5-a168-958b1ff957b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:29:58.987135 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405776e-5fdd-43d5-a168-958b1ff957b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:29:58.988912 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405776e-5fdd-43d5-a168-958b1ff957b8 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:29:59.001235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1007/1978] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:29:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:29:59.134265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:29:59.176692 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:00.477078 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:00.535018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:00.874293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3699a-3e38-4713-9c13-9e5c5b5da4a9 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:00.874588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3699a-3e38-4713-9c13-9e5c5b5da4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:00.874869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3699a-3e38-4713-9c13-9e5c5b5da4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:00.946407 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-00a3699a-3e38-4713-9c13-9e5c5b5da4a9 None None] MFA Rules not processed for user `005e68a8a58b49c5983461025c73d172`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:00.952043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-00a3699a-3e38-4713-9c13-9e5c5b5da4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:01.077516 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 972/1979] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:01.095270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c465c4-d539-42a3-ac83-468361d7ae2d None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:01.100943 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c465c4-d539-42a3-ac83-468361d7ae2d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:01.102203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c465c4-d539-42a3-ac83-468361d7ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:01.122460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-b7c465c4-d539-42a3-ac83-468361d7ae2d None None] MFA Rules not processed for user `26029c0563b6474bb256653826e9a779`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:01.123730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b7c465c4-d539-42a3-ac83-468361d7ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:01.233444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1008/1980] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:01.245166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3699a-3e38-4713-9c13-9e5c5b5da4a9 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:01.247969 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-00a3699a-3e38-4713-9c13-9e5c5b5da4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:01.352368 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3699a-3e38-4713-9c13-9e5c5b5da4a9 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:01.360986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57591c0d-c618-4e7f-9848-facffa00048e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:01.361726 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57591c0d-c618-4e7f-9848-facffa00048e service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:01.362019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57591c0d-c618-4e7f-9848-facffa00048e service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:01.362302 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57591c0d-c618-4e7f-9848-facffa00048e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:01.373964 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57591c0d-c618-4e7f-9848-facffa00048e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:01.380988 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57591c0d-c618-4e7f-9848-facffa00048e service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:01.391015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 973/1981] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:02.181745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:02.299933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:03.575383 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c465c4-d539-42a3-ac83-468361d7ae2d None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:03.635944 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c465c4-d539-42a3-ac83-468361d7ae2d None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:03.641215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:03.643795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:03.643795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:03.643795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] PATH_INFO: `/v3/users/1c8d23b881274f9fb0f0ba4f00a72811` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:03.645277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c8d23b881274f9fb0f0ba4f00a72811)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:03.647833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:03.808180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c8d23b881274f9fb0f0ba4f00a72811'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:03.893639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c8d23b881274f9fb0f0ba4f00a72811'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:03.894284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c8d23b881274f9fb0f0ba4f00a72811'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:03.906715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c8d23b881274f9fb0f0ba4f00a72811'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:03.913374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c8d23b881274f9fb0f0ba4f00a72811'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:03.919884 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1009/1982] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:03 2022] DELETE /identity/v3/users/1c8d23b881274f9fb0f0ba4f00a72811 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:03.924417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8aa74-228f-47c4-b701-a607d2210cc8 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:03.924869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8aa74-228f-47c4-b701-a607d2210cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:03.924961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8aa74-228f-47c4-b701-a607d2210cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:03.942541 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-60b8aa74-228f-47c4-b701-a607d2210cc8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:03.943773 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-60b8aa74-228f-47c4-b701-a607d2210cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:04.003466 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 974/1983] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:04.013243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:04.014809 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:04.042053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:04.076071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df335c46-994e-4857-b0ba-80477a06f2d5 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:04.085214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec6d52-99f8-4f4e-8f17-8a574d0975c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:04.086359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec6d52-99f8-4f4e-8f17-8a574d0975c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:04.086359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec6d52-99f8-4f4e-8f17-8a574d0975c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:04.086540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec6d52-99f8-4f4e-8f17-8a574d0975c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:04.097850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8aa74-228f-47c4-b701-a607d2210cc8 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:04.099449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-60b8aa74-228f-47c4-b701-a607d2210cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:04.099532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:04.103409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec6d52-99f8-4f4e-8f17-8a574d0975c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:04.103409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec6d52-99f8-4f4e-8f17-8a574d0975c4 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:04.117206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8aa74-228f-47c4-b701-a607d2210cc8 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:04.118131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1010/1984] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:04.123640 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:04.124531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:04.124813 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:04.125460 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] PATH_INFO: `/v3/users/eeaf00f5e4854462b48ccc77dc03833f` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:04.126360 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeaf00f5e4854462b48ccc77dc03833f)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:04.128613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:04.347911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeaf00f5e4854462b48ccc77dc03833f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:04.464713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeaf00f5e4854462b48ccc77dc03833f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:04.482660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeaf00f5e4854462b48ccc77dc03833f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:04.483537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeaf00f5e4854462b48ccc77dc03833f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:04.491194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeaf00f5e4854462b48ccc77dc03833f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:04.506561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 975/1985] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:04 2022] DELETE /identity/v3/users/eeaf00f5e4854462b48ccc77dc03833f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:04.510367 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d58f9-2ab5-432c-a105-94f93109f3ce None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:04.510672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d58f9-2ab5-432c-a105-94f93109f3ce None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:04.510955 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d58f9-2ab5-432c-a105-94f93109f3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:04.530412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-223d58f9-2ab5-432c-a105-94f93109f3ce None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:04.531773 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-223d58f9-2ab5-432c-a105-94f93109f3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:04.624989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1011/1986] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:04.656430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:04.658600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:04.727174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ceae3-7811-495a-ae94-5d874bc80935 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:04.731576 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15537ab-dc6e-4571-9c57-ef239049475d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:04.732317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15537ab-dc6e-4571-9c57-ef239049475d service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:04.732547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15537ab-dc6e-4571-9c57-ef239049475d service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:04.732896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15537ab-dc6e-4571-9c57-ef239049475d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:04.743623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15537ab-dc6e-4571-9c57-ef239049475d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:04.745172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15537ab-dc6e-4571-9c57-ef239049475d service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:04.755271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 976/1987] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:04.776740 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d58f9-2ab5-432c-a105-94f93109f3ce None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:04.779524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-223d58f9-2ab5-432c-a105-94f93109f3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:04.795980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d58f9-2ab5-432c-a105-94f93109f3ce None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:04.808895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:04.811184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:04.811719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:04.812224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] PATH_INFO: `/v3/projects/b2f906e5417b42c1a555030e5e4b250a` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:04.817106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f906e5417b42c1a555030e5e4b250a)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:04.819127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:04.963405 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f906e5417b42c1a555030e5e4b250a', 'request_id': 'req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.053595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f906e5417b42c1a555030e5e4b250a', 'request_id': 'req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.066716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f906e5417b42c1a555030e5e4b250a', 'request_id': 'req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.083820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] The token cache is being invalidate because project b2f906e5417b42c1a555030e5e4b250a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:05.084315 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.085094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.088508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1012/1988] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:04 2022] DELETE /identity/v3/projects/b2f906e5417b42c1a555030e5e4b250a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:05.092907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15537ab-dc6e-4571-9c57-ef239049475d service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:05.105465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15537ab-dc6e-4571-9c57-ef239049475d service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:05.223209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:05.224905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:05.225356 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:05.225739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] PATH_INFO: `/v3/users/a0620e525a594033a43b860f1bd8cfda` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:05.227136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0620e525a594033a43b860f1bd8cfda)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:05.229926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:05.363428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:05.364851 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:05.379094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c0b71-9675-4ead-931c-6b2d36a57fdf admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:05.386613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:05.387543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:05.387834 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:05.388114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] PATH_INFO: `/v3/projects/a5b48e9bfcb344aead60db4b540abb2b` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:05.389487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b48e9bfcb344aead60db4b540abb2b)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:05.394230 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:05.574981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b48e9bfcb344aead60db4b540abb2b', 'request_id': 'req-0ef3c516-4881-4f7b-9616-3fe171b0c68a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.580579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0620e525a594033a43b860f1bd8cfda'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.668874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b48e9bfcb344aead60db4b540abb2b', 'request_id': 'req-0ef3c516-4881-4f7b-9616-3fe171b0c68a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.674133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:05.679001 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b48e9bfcb344aead60db4b540abb2b', 'request_id': 'req-0ef3c516-4881-4f7b-9616-3fe171b0c68a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.694682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] The token cache is being invalidate because project a5b48e9bfcb344aead60db4b540abb2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:05.695112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.696936 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.701083 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1013/1989] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:05 2022] DELETE /identity/v3/projects/a5b48e9bfcb344aead60db4b540abb2b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:05.704127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:05.706345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:05.744816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0620e525a594033a43b860f1bd8cfda'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.767590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0620e525a594033a43b860f1bd8cfda'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.768623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0620e525a594033a43b860f1bd8cfda'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.780291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0620e525a594033a43b860f1bd8cfda'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:05.800729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 977/1990] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:05 2022] DELETE /identity/v3/users/a0620e525a594033a43b860f1bd8cfda => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:05.822777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3c516-4881-4f7b-9616-3fe171b0c68a admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:05.905931 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:05.907233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:05.907540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:05.907809 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] PATH_INFO: `/v3/users/f454a9210718486bbd96877fcc3bcc16` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:05.909278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f454a9210718486bbd96877fcc3bcc16)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:05.916781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:06.127302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f454a9210718486bbd96877fcc3bcc16'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:06.188949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f454a9210718486bbd96877fcc3bcc16'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:06.190257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f454a9210718486bbd96877fcc3bcc16'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:06.206493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f454a9210718486bbd96877fcc3bcc16'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:06.224176 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=11,keystone:SELECT=84,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:06.229615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f454a9210718486bbd96877fcc3bcc16'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:06.242780 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1014/1991] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:05 2022] DELETE /identity/v3/users/f454a9210718486bbd96877fcc3bcc16 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:06.335313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:06.337051 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:06.352027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9ace9-f444-4df8-a905-af37f27f3b86 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:06.467036 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:06.468001 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:06.468371 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:06.473373 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] PATH_INFO: `/v3/projects/9179c108a3634ee9bd28e41263649642` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:06.476751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9179c108a3634ee9bd28e41263649642)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:06.479212 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:06.640698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9179c108a3634ee9bd28e41263649642', 'request_id': 'req-5effcb12-2abc-4742-98df-48b682790bc5'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:06.733547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9179c108a3634ee9bd28e41263649642', 'request_id': 'req-5effcb12-2abc-4742-98df-48b682790bc5'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:06.740277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9179c108a3634ee9bd28e41263649642', 'request_id': 'req-5effcb12-2abc-4742-98df-48b682790bc5'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:06.751482 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] The token cache is being invalidate because project 9179c108a3634ee9bd28e41263649642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:06.751773 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:06.752944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:06.754319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 978/1992] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:06 2022] DELETE /identity/v3/projects/9179c108a3634ee9bd28e41263649642 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:06.758295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:06.761678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:06.780344 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35b513-1ac9-4a17-87b9-9de7810d663c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:06.853554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73844d-8ecc-456e-ab98-9958319e9fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:06.854443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73844d-8ecc-456e-ab98-9958319e9fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:06.854771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73844d-8ecc-456e-ab98-9958319e9fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:06.854996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73844d-8ecc-456e-ab98-9958319e9fbc admin admin] PATH_INFO: `/v3/users/8b41b8663e0b4996a9ecbc81b51bbcb5` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:06.856321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73844d-8ecc-456e-ab98-9958319e9fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b41b8663e0b4996a9ecbc81b51bbcb5)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:06.858383 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73844d-8ecc-456e-ab98-9958319e9fbc admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:07.017903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:07.020096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:07.047496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effcb12-2abc-4742-98df-48b682790bc5 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:07.052422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199137d2-ebae-46df-8fc6-c79011b4a06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:07.055330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199137d2-ebae-46df-8fc6-c79011b4a06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:07.055330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199137d2-ebae-46df-8fc6-c79011b4a06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:07.055330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199137d2-ebae-46df-8fc6-c79011b4a06e admin admin] PATH_INFO: `/v3/projects/bdccd70d1bc64fdbb9c5c7e8d51efa59` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:07.055905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199137d2-ebae-46df-8fc6-c79011b4a06e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdccd70d1bc64fdbb9c5c7e8d51efa59)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:07.057940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199137d2-ebae-46df-8fc6-c79011b4a06e admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:07.111564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bd73844d-8ecc-456e-ab98-9958319e9fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b41b8663e0b4996a9ecbc81b51bbcb5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:07.177364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-199137d2-ebae-46df-8fc6-c79011b4a06e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdccd70d1bc64fdbb9c5c7e8d51efa59', 'request_id': 'req-199137d2-ebae-46df-8fc6-c79011b4a06e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:07.182389 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bd73844d-8ecc-456e-ab98-9958319e9fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b41b8663e0b4996a9ecbc81b51bbcb5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:07.183046 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bd73844d-8ecc-456e-ab98-9958319e9fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b41b8663e0b4996a9ecbc81b51bbcb5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:07.195988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bd73844d-8ecc-456e-ab98-9958319e9fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b41b8663e0b4996a9ecbc81b51bbcb5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:07.202986 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bd73844d-8ecc-456e-ab98-9958319e9fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b41b8663e0b4996a9ecbc81b51bbcb5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:07.209670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1015/1993] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:06 2022] DELETE /identity/v3/users/8b41b8663e0b4996a9ecbc81b51bbcb5 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:30:07.251714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-199137d2-ebae-46df-8fc6-c79011b4a06e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdccd70d1bc64fdbb9c5c7e8d51efa59', 'request_id': 'req-199137d2-ebae-46df-8fc6-c79011b4a06e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:07.259849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-199137d2-ebae-46df-8fc6-c79011b4a06e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdccd70d1bc64fdbb9c5c7e8d51efa59', 'request_id': 'req-199137d2-ebae-46df-8fc6-c79011b4a06e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:07.271298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-199137d2-ebae-46df-8fc6-c79011b4a06e admin admin] The token cache is being invalidate because project bdccd70d1bc64fdbb9c5c7e8d51efa59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:07.271587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-199137d2-ebae-46df-8fc6-c79011b4a06e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:07.272241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-199137d2-ebae-46df-8fc6-c79011b4a06e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:07.274080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 979/1994] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:07 2022] DELETE /identity/v3/projects/bdccd70d1bc64fdbb9c5c7e8d51efa59 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:07.280124 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d4615-ec4c-4ee6-8a8a-14180a20b996 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:07.280465 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d4615-ec4c-4ee6-8a8a-14180a20b996 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:07.281002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d4615-ec4c-4ee6-8a8a-14180a20b996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:07.302091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a72d4615-ec4c-4ee6-8a8a-14180a20b996 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:07.303631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a72d4615-ec4c-4ee6-8a8a-14180a20b996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:07.365084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1016/1995] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:07.373686 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3423e9-6749-43de-bdd4-5b961b35c54e None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:07.373974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3423e9-6749-43de-bdd4-5b961b35c54e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:07.374254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3423e9-6749-43de-bdd4-5b961b35c54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:07.393760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-8c3423e9-6749-43de-bdd4-5b961b35c54e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:07.395372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8c3423e9-6749-43de-bdd4-5b961b35c54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:07.404736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 980/1996] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:07.409206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d4615-ec4c-4ee6-8a8a-14180a20b996 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:07.421291 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d4615-ec4c-4ee6-8a8a-14180a20b996 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:07.425606 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16afb8-a466-4d29-b89e-6760e222e6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:07.426351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16afb8-a466-4d29-b89e-6760e222e6cd admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:07.427179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16afb8-a466-4d29-b89e-6760e222e6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:07.427179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16afb8-a466-4d29-b89e-6760e222e6cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:07.429582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16afb8-a466-4d29-b89e-6760e222e6cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:30:07.429985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16afb8-a466-4d29-b89e-6760e222e6cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:07.431959 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16afb8-a466-4d29-b89e-6760e222e6cd admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:07.445886 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1017/1997] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:30:07.450022 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3423e9-6749-43de-bdd4-5b961b35c54e None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:07.461041 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3423e9-6749-43de-bdd4-5b961b35c54e None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:07.469222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb8192-4ecc-4321-9c59-1883a9fe2e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:07.470170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb8192-4ecc-4321-9c59-1883a9fe2e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:07.470560 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb8192-4ecc-4321-9c59-1883a9fe2e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:07.470915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb8192-4ecc-4321-9c59-1883a9fe2e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:07.471692 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb8192-4ecc-4321-9c59-1883a9fe2e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:07.476184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb8192-4ecc-4321-9c59-1883a9fe2e83 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:07.593665 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 981/1998] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:07 2022] POST /identity/v3/projects => generated 361 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:07.598505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16afb8-a466-4d29-b89e-6760e222e6cd admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:07.609383 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16afb8-a466-4d29-b89e-6760e222e6cd admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:07.683817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d79f33-0e50-40ba-851c-0ed91632e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:07.684503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79f33-0e50-40ba-851c-0ed91632e989 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:07.684788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79f33-0e50-40ba-851c-0ed91632e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:07.685059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79f33-0e50-40ba-851c-0ed91632e989 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:07.685885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d79f33-0e50-40ba-851c-0ed91632e989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:07.687981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d79f33-0e50-40ba-851c-0ed91632e989 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:07.714158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb8192-4ecc-4321-9c59-1883a9fe2e83 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:07.714158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-ddeb8192-4ecc-4321-9c59-1883a9fe2e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:07.726498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb8192-4ecc-4321-9c59-1883a9fe2e83 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:07.733470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fbbb9-698c-4148-9f92-d60402e804fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:07.734115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:07.734495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fbbb9-698c-4148-9f92-d60402e804fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:07.734987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fbbb9-698c-4148-9f92-d60402e804fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:07.735430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fbbb9-698c-4148-9f92-d60402e804fb admin admin] PATH_INFO: `/v3/projects/84a07e2bb616477a8dcfe6a4002c3523` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:07.737229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fbbb9-698c-4148-9f92-d60402e804fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a07e2bb616477a8dcfe6a4002c3523)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:07.739257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fbbb9-698c-4148-9f92-d60402e804fb admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:07.785724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1018/1999] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:07 2022] POST /identity/v3/users => generated 281 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:07.791263 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d79f33-0e50-40ba-851c-0ed91632e989 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:07.801942 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d79f33-0e50-40ba-851c-0ed91632e989 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:07.806599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23b284-5183-44c8-bc56-4268b25e4dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:07.807260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23b284-5183-44c8-bc56-4268b25e4dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:07.807548 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23b284-5183-44c8-bc56-4268b25e4dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:07.807828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23b284-5183-44c8-bc56-4268b25e4dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:07.808595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23b284-5183-44c8-bc56-4268b25e4dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:07.810304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23b284-5183-44c8-bc56-4268b25e4dbe admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:07.820765 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1019/2000] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:30:07.824550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23b284-5183-44c8-bc56-4268b25e4dbe admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:07.833698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23b284-5183-44c8-bc56-4268b25e4dbe admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:07.838271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6796-f345-45bc-bc37-d7704e479a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:07.838899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6796-f345-45bc-bc37-d7704e479a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:07.839182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6796-f345-45bc-bc37-d7704e479a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:07.839466 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6796-f345-45bc-bc37-d7704e479a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:07.840173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d6796-f345-45bc-bc37-d7704e479a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:07.841793 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d6796-f345-45bc-bc37-d7704e479a1d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:07.852329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1020/2001] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:30:07.856381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6796-f345-45bc-bc37-d7704e479a1d admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:07.866807 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6796-f345-45bc-bc37-d7704e479a1d admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:07.880019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-807fbbb9-698c-4148-9f92-d60402e804fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a07e2bb616477a8dcfe6a4002c3523', 'request_id': 'req-807fbbb9-698c-4148-9f92-d60402e804fb'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:07.923728 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885489b-6b1f-4bab-8023-1b825e34899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:07.924969 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885489b-6b1f-4bab-8023-1b825e34899a admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:07.925284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885489b-6b1f-4bab-8023-1b825e34899a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:07.925561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885489b-6b1f-4bab-8023-1b825e34899a admin admin] PATH_INFO: `/v3/projects/63fb43e3b738430fb5f1f3f76c9daac2/users/57467841d536441bab42bf9c55580660/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:07.942799 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885489b-6b1f-4bab-8023-1b825e34899a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fb43e3b738430fb5f1f3f76c9daac2, user_id=57467841d536441bab42bf9c55580660, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:07.945610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885489b-6b1f-4bab-8023-1b825e34899a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:08.024289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-807fbbb9-698c-4148-9f92-d60402e804fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a07e2bb616477a8dcfe6a4002c3523', 'request_id': 'req-807fbbb9-698c-4148-9f92-d60402e804fb'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:08.033630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-807fbbb9-698c-4148-9f92-d60402e804fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a07e2bb616477a8dcfe6a4002c3523', 'request_id': 'req-807fbbb9-698c-4148-9f92-d60402e804fb'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:08.045961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-807fbbb9-698c-4148-9f92-d60402e804fb admin admin] The token cache is being invalidate because project 84a07e2bb616477a8dcfe6a4002c3523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:08.046530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-807fbbb9-698c-4148-9f92-d60402e804fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:08.047436 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-807fbbb9-698c-4148-9f92-d60402e804fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:08.049799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 982/2002] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:07 2022] DELETE /identity/v3/projects/84a07e2bb616477a8dcfe6a4002c3523 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:08.056067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8eb58-46b7-4518-baba-e1b526bb419f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:08.056444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8eb58-46b7-4518-baba-e1b526bb419f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:08.056734 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8eb58-46b7-4518-baba-e1b526bb419f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:08.071682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1021/2003] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:07 2022] PUT /identity/v3/projects/63fb43e3b738430fb5f1f3f76c9daac2/users/57467841d536441bab42bf9c55580660/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:30:08.074645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf794e0-9869-4948-af03-c7e45bdbab1e None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:08.075013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf794e0-9869-4948-af03-c7e45bdbab1e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:08.075386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf794e0-9869-4948-af03-c7e45bdbab1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:08.086550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a3a8eb58-46b7-4518-baba-e1b526bb419f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:08.088187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a3a8eb58-46b7-4518-baba-e1b526bb419f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:08.107142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-abf794e0-9869-4948-af03-c7e45bdbab1e None None] MFA Rules not processed for user `57467841d536441bab42bf9c55580660`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:08.108434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-abf794e0-9869-4948-af03-c7e45bdbab1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:08.166659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 983/2004] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:08.175680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c09184-dcba-4465-a9a6-302ca7f533b5 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:08.175975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c09184-dcba-4465-a9a6-302ca7f533b5 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:08.176439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c09184-dcba-4465-a9a6-302ca7f533b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:08.202331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1022/2005] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:30:08.207902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-79c09184-dcba-4465-a9a6-302ca7f533b5 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:08.209442 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-79c09184-dcba-4465-a9a6-302ca7f533b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:08.218310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 984/2006] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:30:08.223530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf794e0-9869-4948-af03-c7e45bdbab1e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:08.237505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf794e0-9869-4948-af03-c7e45bdbab1e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:08.242691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c09184-dcba-4465-a9a6-302ca7f533b5 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:08.242818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03213ad-63f8-46ec-9591-9c928d0fceb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:08.243525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03213ad-63f8-46ec-9591-9c928d0fceb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:08.252414 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03213ad-63f8-46ec-9591-9c928d0fceb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:08.252414 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03213ad-63f8-46ec-9591-9c928d0fceb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:08.252751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-79c09184-dcba-4465-a9a6-302ca7f533b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:08.253243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03213ad-63f8-46ec-9591-9c928d0fceb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:30:08.253243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03213ad-63f8-46ec-9591-9c928d0fceb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:08.253243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03213ad-63f8-46ec-9591-9c928d0fceb5 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:08.267379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1023/2007] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:30:08.271824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03213ad-63f8-46ec-9591-9c928d0fceb5 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:08.282108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03213ad-63f8-46ec-9591-9c928d0fceb5 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:08.289883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1b593-25d7-42ac-a760-ac4c5b490eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:08.290570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1b593-25d7-42ac-a760-ac4c5b490eec admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:08.290857 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1b593-25d7-42ac-a760-ac4c5b490eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:08.291137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1b593-25d7-42ac-a760-ac4c5b490eec admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:08.291866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1b593-25d7-42ac-a760-ac4c5b490eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:08.293859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1b593-25d7-42ac-a760-ac4c5b490eec admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:08.308829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c09184-dcba-4465-a9a6-302ca7f533b5 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:08.312711 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1d397-f7fa-4399-8912-2a448548438a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:08.313535 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1d397-f7fa-4399-8912-2a448548438a service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:08.313823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1d397-f7fa-4399-8912-2a448548438a service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:08.314169 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1d397-f7fa-4399-8912-2a448548438a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:08.316786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:08.325765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1d397-f7fa-4399-8912-2a448548438a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:08.327402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1d397-f7fa-4399-8912-2a448548438a service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:08.337815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 985/2008] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:30:08.353145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1d397-f7fa-4399-8912-2a448548438a service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:08.354781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-afc1d397-f7fa-4399-8912-2a448548438a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:08.369263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1d397-f7fa-4399-8912-2a448548438a service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:08.374042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e969739-422d-42da-bbfb-f15778e1cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:08.374932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e969739-422d-42da-bbfb-f15778e1cc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:08.375212 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e969739-422d-42da-bbfb-f15778e1cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:08.375532 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e969739-422d-42da-bbfb-f15778e1cc18 admin admin] PATH_INFO: `/v3/users/57467841d536441bab42bf9c55580660` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:08.377634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e969739-422d-42da-bbfb-f15778e1cc18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57467841d536441bab42bf9c55580660)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:08.379463 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e969739-422d-42da-bbfb-f15778e1cc18 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:08.418624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1024/2009] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:08 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:30:08.422911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1b593-25d7-42ac-a760-ac4c5b490eec admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:08.797381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1b593-25d7-42ac-a760-ac4c5b490eec admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:08.797381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c77294-a7b0-4400-ad46-dd59200253c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:08.797381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c77294-a7b0-4400-ad46-dd59200253c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:08.797381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c77294-a7b0-4400-ad46-dd59200253c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:08.799235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c77294-a7b0-4400-ad46-dd59200253c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:08.799235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c77294-a7b0-4400-ad46-dd59200253c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:08.799235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c77294-a7b0-4400-ad46-dd59200253c9 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:08.802914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1025/2010] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:08 2022] POST /identity/v3/users => generated 291 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:30:08.806868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c77294-a7b0-4400-ad46-dd59200253c9 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:08.817199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c77294-a7b0-4400-ad46-dd59200253c9 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:08.821926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e348-a570-4dac-b6fe-f9e964d8c28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:08.822590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e348-a570-4dac-b6fe-f9e964d8c28c admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:08.822873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e348-a570-4dac-b6fe-f9e964d8c28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:08.823147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e348-a570-4dac-b6fe-f9e964d8c28c admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:08.823883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900e348-a570-4dac-b6fe-f9e964d8c28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:08.826563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900e348-a570-4dac-b6fe-f9e964d8c28c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:08.835966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1026/2011] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:30:08.839781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e348-a570-4dac-b6fe-f9e964d8c28c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:08.849657 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e348-a570-4dac-b6fe-f9e964d8c28c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:08.854984 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b580f8-6beb-4f81-9f51-15ef4cb16a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:08.855994 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b580f8-6beb-4f81-9f51-15ef4cb16a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:08.856449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b580f8-6beb-4f81-9f51-15ef4cb16a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:08.856892 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b580f8-6beb-4f81-9f51-15ef4cb16a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:08.857835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b580f8-6beb-4f81-9f51-15ef4cb16a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:08.860948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b580f8-6beb-4f81-9f51-15ef4cb16a2f admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:08.872726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1027/2012] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:30:08.877261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b580f8-6beb-4f81-9f51-15ef4cb16a2f admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:08.883927 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7e969739-422d-42da-bbfb-f15778e1cc18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57467841d536441bab42bf9c55580660'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:08.890673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b580f8-6beb-4f81-9f51-15ef4cb16a2f admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:08.897598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76140e41-3674-4f4c-adeb-0f90b74f78d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:08.898725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76140e41-3674-4f4c-adeb-0f90b74f78d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:08.899510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76140e41-3674-4f4c-adeb-0f90b74f78d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:08.899808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76140e41-3674-4f4c-adeb-0f90b74f78d1 admin admin] PATH_INFO: `/v3/projects/1039bc0309fa48f1b24e7fd9991ad40d/users/39d23f40324a454aa700babd722853b2/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:08.920108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76140e41-3674-4f4c-adeb-0f90b74f78d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1039bc0309fa48f1b24e7fd9991ad40d, user_id=39d23f40324a454aa700babd722853b2, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:08.923567 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76140e41-3674-4f4c-adeb-0f90b74f78d1 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:08.988493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7e969739-422d-42da-bbfb-f15778e1cc18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57467841d536441bab42bf9c55580660'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:09.015719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7e969739-422d-42da-bbfb-f15778e1cc18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57467841d536441bab42bf9c55580660'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:09.016907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7e969739-422d-42da-bbfb-f15778e1cc18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57467841d536441bab42bf9c55580660'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:09.025320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1028/2013] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:08 2022] PUT /identity/v3/projects/1039bc0309fa48f1b24e7fd9991ad40d/users/39d23f40324a454aa700babd722853b2/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:30:09.031552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7e969739-422d-42da-bbfb-f15778e1cc18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57467841d536441bab42bf9c55580660'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:09.037743 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 986/2014] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:08 2022] DELETE /identity/v3/users/57467841d536441bab42bf9c55580660 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:30:09.043103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab7050-5158-460b-8d4f-b2f55b9bf7cb None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:09.043103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab7050-5158-460b-8d4f-b2f55b9bf7cb None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:09.043103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab7050-5158-460b-8d4f-b2f55b9bf7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:09.048788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b73ca0-ef4e-4c98-8218-2770e9ec9afd None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:09.049075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b73ca0-ef4e-4c98-8218-2770e9ec9afd None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:09.049384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b73ca0-ef4e-4c98-8218-2770e9ec9afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:09.061660 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-adab7050-5158-460b-8d4f-b2f55b9bf7cb None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:09.062870 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-adab7050-5158-460b-8d4f-b2f55b9bf7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:09.080187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-18b73ca0-ef4e-4c98-8218-2770e9ec9afd None None] MFA Rules not processed for user `39d23f40324a454aa700babd722853b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:09.081412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-18b73ca0-ef4e-4c98-8218-2770e9ec9afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:09.141240 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1029/2015] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:09.153832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab7050-5158-460b-8d4f-b2f55b9bf7cb None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:09.155256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-adab7050-5158-460b-8d4f-b2f55b9bf7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:09.159878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 987/2016] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:30:09.175769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b73ca0-ef4e-4c98-8218-2770e9ec9afd None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:09.180930 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-18b73ca0-ef4e-4c98-8218-2770e9ec9afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:09.229997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab7050-5158-460b-8d4f-b2f55b9bf7cb None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:09.234545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66f4e9-d526-4952-9a3b-67cf690f1895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:09.236525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66f4e9-d526-4952-9a3b-67cf690f1895 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:09.236525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66f4e9-d526-4952-9a3b-67cf690f1895 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:09.236525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66f4e9-d526-4952-9a3b-67cf690f1895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:09.247095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66f4e9-d526-4952-9a3b-67cf690f1895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:09.248707 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66f4e9-d526-4952-9a3b-67cf690f1895 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:09.270950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1030/2017] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:30:09.275677 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b73ca0-ef4e-4c98-8218-2770e9ec9afd None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:09.279922 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b8e20-399b-4428-be4f-1db19d3d3919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:09.280672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b8e20-399b-4428-be4f-1db19d3d3919 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:09.281024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b8e20-399b-4428-be4f-1db19d3d3919 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:09.281404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b8e20-399b-4428-be4f-1db19d3d3919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:09.300707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b8e20-399b-4428-be4f-1db19d3d3919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:09.300707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b8e20-399b-4428-be4f-1db19d3d3919 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:09.311198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 988/2018] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:09.333590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66f4e9-d526-4952-9a3b-67cf690f1895 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:09.337369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bc66f4e9-d526-4952-9a3b-67cf690f1895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:09.352993 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66f4e9-d526-4952-9a3b-67cf690f1895 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:09.358441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:09.359354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:09.359640 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:09.359921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] PATH_INFO: `/v3/users/39d23f40324a454aa700babd722853b2` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:09.362427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d23f40324a454aa700babd722853b2)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:09.364560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:09.538096 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d23f40324a454aa700babd722853b2'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:09.602725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d23f40324a454aa700babd722853b2'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:09.603649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d23f40324a454aa700babd722853b2'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:09.620356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d23f40324a454aa700babd722853b2'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:09.635029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d23f40324a454aa700babd722853b2'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:09.642485 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1031/2019] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:09 2022] DELETE /identity/v3/users/39d23f40324a454aa700babd722853b2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:09.647028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8115-4304-43a8-b281-39a90f252f1f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:09.647320 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8115-4304-43a8-b281-39a90f252f1f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:09.647594 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c8115-4304-43a8-b281-39a90f252f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:09.665549 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-9b2c8115-4304-43a8-b281-39a90f252f1f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:09.666722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9b2c8115-4304-43a8-b281-39a90f252f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:09.738580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 989/2020] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:09.745410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:09.746895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:09.806848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5083d1-d1eb-4d02-a676-cb1b5fa0e6f1 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:09.810935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edd946-e39b-4801-8851-91c7ee8a66c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:09.811596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edd946-e39b-4801-8851-91c7ee8a66c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:09.812077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edd946-e39b-4801-8851-91c7ee8a66c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:09.812363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edd946-e39b-4801-8851-91c7ee8a66c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:09.833096 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edd946-e39b-4801-8851-91c7ee8a66c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:09.834652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edd946-e39b-4801-8851-91c7ee8a66c0 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:09.845656 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1032/2021] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:10.097739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:10.379629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c8115-4304-43a8-b281-39a90f252f1f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:10.381184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9b2c8115-4304-43a8-b281-39a90f252f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:10.394511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c8115-4304-43a8-b281-39a90f252f1f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:10.399730 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:10.400609 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:10.401086 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:10.401585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da admin admin] PATH_INFO: `/v3/projects/63fb43e3b738430fb5f1f3f76c9daac2` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:10.403042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da admin admin] RBAC: Authorizing `identity:delete_project(project_id=63fb43e3b738430fb5f1f3f76c9daac2)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:10.405091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:10.434319 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edd946-e39b-4801-8851-91c7ee8a66c0 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:10.437622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b1edd946-e39b-4801-8851-91c7ee8a66c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:10.459663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edd946-e39b-4801-8851-91c7ee8a66c0 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:10.468574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6967f5-170e-4cce-9bf9-035c9b91db8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:10.469537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6967f5-170e-4cce-9bf9-035c9b91db8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:10.470479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6967f5-170e-4cce-9bf9-035c9b91db8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:10.470479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6967f5-170e-4cce-9bf9-035c9b91db8c admin admin] PATH_INFO: `/v3/projects/1039bc0309fa48f1b24e7fd9991ad40d` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:10.471543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6967f5-170e-4cce-9bf9-035c9b91db8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1039bc0309fa48f1b24e7fd9991ad40d)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:10.473505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6967f5-170e-4cce-9bf9-035c9b91db8c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:10.572106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63fb43e3b738430fb5f1f3f76c9daac2', 'request_id': 'req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:10.600541 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-dc6967f5-170e-4cce-9bf9-035c9b91db8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1039bc0309fa48f1b24e7fd9991ad40d', 'request_id': 'req-dc6967f5-170e-4cce-9bf9-035c9b91db8c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:10.668468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63fb43e3b738430fb5f1f3f76c9daac2', 'request_id': 'req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:10.676234 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63fb43e3b738430fb5f1f3f76c9daac2', 'request_id': 'req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:10.686559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da admin admin] The token cache is being invalidate because project 63fb43e3b738430fb5f1f3f76c9daac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:10.686850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:10.687495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d8498d2a-b6f9-4758-8ca2-8ff61d1692da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:10.689080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 990/2022] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:10 2022] DELETE /identity/v3/projects/63fb43e3b738430fb5f1f3f76c9daac2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:10.693821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec998bc-c2bd-4240-8a2c-63feab931511 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:10.694121 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec998bc-c2bd-4240-8a2c-63feab931511 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:10.694431 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec998bc-c2bd-4240-8a2c-63feab931511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:10.697998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:10.713944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-aec998bc-c2bd-4240-8a2c-63feab931511 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:10.715196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-aec998bc-c2bd-4240-8a2c-63feab931511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:10.753994 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-dc6967f5-170e-4cce-9bf9-035c9b91db8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1039bc0309fa48f1b24e7fd9991ad40d', 'request_id': 'req-dc6967f5-170e-4cce-9bf9-035c9b91db8c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:10.760083 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-dc6967f5-170e-4cce-9bf9-035c9b91db8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1039bc0309fa48f1b24e7fd9991ad40d', 'request_id': 'req-dc6967f5-170e-4cce-9bf9-035c9b91db8c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:10.777761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 991/2023] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:30:10.778014 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-dc6967f5-170e-4cce-9bf9-035c9b91db8c admin admin] The token cache is being invalidate because project 1039bc0309fa48f1b24e7fd9991ad40d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:10.778489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-dc6967f5-170e-4cce-9bf9-035c9b91db8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:10.779210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-dc6967f5-170e-4cce-9bf9-035c9b91db8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:10.785216 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1033/2024] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:10 2022] DELETE /identity/v3/projects/1039bc0309fa48f1b24e7fd9991ad40d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:30:10.789056 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c54e6-0ae7-46d4-a704-1e76e5afb8d8 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:10.789254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f1686-679d-4f73-a785-16052ea9672b None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:10.789610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c54e6-0ae7-46d4-a704-1e76e5afb8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:10.789809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f1686-679d-4f73-a785-16052ea9672b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:10.789963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c54e6-0ae7-46d4-a704-1e76e5afb8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:10.790234 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f1686-679d-4f73-a785-16052ea9672b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:10.810697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-9c8f1686-679d-4f73-a785-16052ea9672b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:10.811978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9c8f1686-679d-4f73-a785-16052ea9672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:10.846206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 992/2025] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:10.846541 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-142c54e6-0ae7-46d4-a704-1e76e5afb8d8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:10.846541 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-142c54e6-0ae7-46d4-a704-1e76e5afb8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:10.847009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc6158-e577-4ed4-9cb7-5cc74ab10af0 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:10.847009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc6158-e577-4ed4-9cb7-5cc74ab10af0 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:10.847009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc6158-e577-4ed4-9cb7-5cc74ab10af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:10.847219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1034/2026] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:10.847219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c54e6-0ae7-46d4-a704-1e76e5afb8d8 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:10.856197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c54e6-0ae7-46d4-a704-1e76e5afb8d8 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:10.858934 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-2ebc6158-e577-4ed4-9cb7-5cc74ab10af0 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:10.860328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2ebc6158-e577-4ed4-9cb7-5cc74ab10af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:10.869647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542677ac-25c3-43f9-9a32-541c12dcfad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:10.870363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542677ac-25c3-43f9-9a32-541c12dcfad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:10.870654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542677ac-25c3-43f9-9a32-541c12dcfad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:10.870934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542677ac-25c3-43f9-9a32-541c12dcfad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:10.871678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542677ac-25c3-43f9-9a32-541c12dcfad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:30:10.871988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542677ac-25c3-43f9-9a32-541c12dcfad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:10.873016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 993/2027] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:10.874578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542677ac-25c3-43f9-9a32-541c12dcfad2 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:10.878577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc6158-e577-4ed4-9cb7-5cc74ab10af0 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:10.888306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc6158-e577-4ed4-9cb7-5cc74ab10af0 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:10.904903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1035/2028] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:30:10.911126 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542677ac-25c3-43f9-9a32-541c12dcfad2 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:10.918897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b214d90-ade5-4bba-ba4f-81bf15577050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:10.919962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b214d90-ade5-4bba-ba4f-81bf15577050 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:10.920398 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b214d90-ade5-4bba-ba4f-81bf15577050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:10.920686 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b214d90-ade5-4bba-ba4f-81bf15577050 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:10.921464 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b214d90-ade5-4bba-ba4f-81bf15577050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:30:10.921777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b214d90-ade5-4bba-ba4f-81bf15577050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:10.925105 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b214d90-ade5-4bba-ba4f-81bf15577050 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:10.935890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542677ac-25c3-43f9-9a32-541c12dcfad2 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:10.948476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2abcfd-f53d-405d-af50-07b2049a55d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:10.949201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2abcfd-f53d-405d-af50-07b2049a55d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:10.949500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2abcfd-f53d-405d-af50-07b2049a55d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:10.949782 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2abcfd-f53d-405d-af50-07b2049a55d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:10.953300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2abcfd-f53d-405d-af50-07b2049a55d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:10.955838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2abcfd-f53d-405d-af50-07b2049a55d5 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:10.961215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 994/2029] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:30:10.962661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b214d90-ade5-4bba-ba4f-81bf15577050 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:10.982361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b214d90-ade5-4bba-ba4f-81bf15577050 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:10.991502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096d5cd-04ad-4bc7-849c-269a9a4852e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:10.992459 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096d5cd-04ad-4bc7-849c-269a9a4852e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:10.992814 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096d5cd-04ad-4bc7-849c-269a9a4852e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:10.993188 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096d5cd-04ad-4bc7-849c-269a9a4852e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:10.993967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096d5cd-04ad-4bc7-849c-269a9a4852e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:10.997272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096d5cd-04ad-4bc7-849c-269a9a4852e0 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:11.066335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1036/2030] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:10 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:11.067629 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2abcfd-f53d-405d-af50-07b2049a55d5 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:11.082766 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:11.093153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 995/2031] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:10 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:30:11.096660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096d5cd-04ad-4bc7-849c-269a9a4852e0 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:11.184264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2abcfd-f53d-405d-af50-07b2049a55d5 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:11.203641 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096d5cd-04ad-4bc7-849c-269a9a4852e0 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:11.228011 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7dd11-372b-48e7-bf8c-349f6c9100f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:11.237264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7dd11-372b-48e7-bf8c-349f6c9100f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:11.237264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7dd11-372b-48e7-bf8c-349f6c9100f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:11.237264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7dd11-372b-48e7-bf8c-349f6c9100f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:11.237264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7dd11-372b-48e7-bf8c-349f6c9100f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:11.239282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7dd11-372b-48e7-bf8c-349f6c9100f0 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:11.280158 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96501473-3330-4578-9822-57605ee81bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:11.281240 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96501473-3330-4578-9822-57605ee81bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:11.282904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96501473-3330-4578-9822-57605ee81bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:11.283455 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96501473-3330-4578-9822-57605ee81bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:11.285372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96501473-3330-4578-9822-57605ee81bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:11.289572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96501473-3330-4578-9822-57605ee81bc7 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:11.319661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 996/2032] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:11 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:11.320557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7dd11-372b-48e7-bf8c-349f6c9100f0 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:11.332715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7dd11-372b-48e7-bf8c-349f6c9100f0 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:11.338859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d2e21-fa87-49d1-9047-90c8154255c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:11.339540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d2e21-fa87-49d1-9047-90c8154255c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:11.340123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d2e21-fa87-49d1-9047-90c8154255c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:11.340554 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d2e21-fa87-49d1-9047-90c8154255c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:11.341328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d2e21-fa87-49d1-9047-90c8154255c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:11.343619 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d2e21-fa87-49d1-9047-90c8154255c3 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:11.361689 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 997/2033] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:11.363245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d2e21-fa87-49d1-9047-90c8154255c3 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:11.374213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d2e21-fa87-49d1-9047-90c8154255c3 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:11.380808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd6203-6cf6-4648-93f7-278ba83338e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:11.382721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd6203-6cf6-4648-93f7-278ba83338e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:11.382721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd6203-6cf6-4648-93f7-278ba83338e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:11.382721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd6203-6cf6-4648-93f7-278ba83338e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:11.383517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd6203-6cf6-4648-93f7-278ba83338e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:11.386105 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd6203-6cf6-4648-93f7-278ba83338e4 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:11.406025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 998/2034] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:11.407161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd6203-6cf6-4648-93f7-278ba83338e4 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:11.413360 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1037/2035] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:11 2022] POST /identity/v3/users => generated 283 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:11.415038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:11.417337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96501473-3330-4578-9822-57605ee81bc7 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:11.426490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd6203-6cf6-4648-93f7-278ba83338e4 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:11.434179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96501473-3330-4578-9822-57605ee81bc7 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:11.440451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a39c33-2f5f-4a95-87c3-d8de753c4e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:11.441320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a39c33-2f5f-4a95-87c3-d8de753c4e0c admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:11.441615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a39c33-2f5f-4a95-87c3-d8de753c4e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:11.441941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a39c33-2f5f-4a95-87c3-d8de753c4e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:11.442411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be8e10-0caa-4585-abd1-0e33dc0b5c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:11.442802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a39c33-2f5f-4a95-87c3-d8de753c4e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:11.443513 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be8e10-0caa-4585-abd1-0e33dc0b5c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:11.443868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be8e10-0caa-4585-abd1-0e33dc0b5c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:11.444216 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be8e10-0caa-4585-abd1-0e33dc0b5c92 admin admin] PATH_INFO: `/v3/projects/5c56846e91b54939b14e8c831cd75b30/users/e791c5c80730422381db57191a45323b/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:11.444464 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a39c33-2f5f-4a95-87c3-d8de753c4e0c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:11.468653 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1038/2036] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:11.471583 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a39c33-2f5f-4a95-87c3-d8de753c4e0c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:11.487936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be8e10-0caa-4585-abd1-0e33dc0b5c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c56846e91b54939b14e8c831cd75b30, user_id=e791c5c80730422381db57191a45323b, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:11.494889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be8e10-0caa-4585-abd1-0e33dc0b5c92 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:11.500471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a39c33-2f5f-4a95-87c3-d8de753c4e0c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:11.510105 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51245dee-b214-47bc-b7bd-a104dd0fe8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:11.511092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51245dee-b214-47bc-b7bd-a104dd0fe8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:11.511284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51245dee-b214-47bc-b7bd-a104dd0fe8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:11.511564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51245dee-b214-47bc-b7bd-a104dd0fe8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:11.512353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51245dee-b214-47bc-b7bd-a104dd0fe8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:11.514479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51245dee-b214-47bc-b7bd-a104dd0fe8d8 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:11.529963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1039/2037] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:11.534245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51245dee-b214-47bc-b7bd-a104dd0fe8d8 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:11.544271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51245dee-b214-47bc-b7bd-a104dd0fe8d8 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:11.548940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58927e2-fd84-4601-ab53-5a72061e95e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:11.549840 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58927e2-fd84-4601-ab53-5a72061e95e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:11.550124 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58927e2-fd84-4601-ab53-5a72061e95e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:11.550398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58927e2-fd84-4601-ab53-5a72061e95e3 admin admin] PATH_INFO: `/v3/projects/71e8cee1cb6c4300abf38d1907fbca20/users/04e9e7b10de8416f80d6b6f86b1885fc/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:11.566680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58927e2-fd84-4601-ab53-5a72061e95e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e8cee1cb6c4300abf38d1907fbca20, user_id=04e9e7b10de8416f80d6b6f86b1885fc, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:11.569388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58927e2-fd84-4601-ab53-5a72061e95e3 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:11.570975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 999/2038] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:11 2022] PUT /identity/v3/projects/5c56846e91b54939b14e8c831cd75b30/users/e791c5c80730422381db57191a45323b/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:11.583112 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df80e27-b473-4b9d-b30e-c31e5652df07 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:11.583562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df80e27-b473-4b9d-b30e-c31e5652df07 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:11.583906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df80e27-b473-4b9d-b30e-c31e5652df07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:11.615255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-4df80e27-b473-4b9d-b30e-c31e5652df07 None None] MFA Rules not processed for user `e791c5c80730422381db57191a45323b`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:11.616686 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-4df80e27-b473-4b9d-b30e-c31e5652df07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:11.654031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1040/2039] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:11 2022] PUT /identity/v3/projects/71e8cee1cb6c4300abf38d1907fbca20/users/04e9e7b10de8416f80d6b6f86b1885fc/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:30:11.665195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff9530-c6e0-4fd0-9d64-a997b3bf82a3 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:11.665195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff9530-c6e0-4fd0-9d64-a997b3bf82a3 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:11.665492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff9530-c6e0-4fd0-9d64-a997b3bf82a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:11.692510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1000/2040] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:11.698211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-0aff9530-c6e0-4fd0-9d64-a997b3bf82a3 None None] MFA Rules not processed for user `04e9e7b10de8416f80d6b6f86b1885fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:11.699398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0aff9530-c6e0-4fd0-9d64-a997b3bf82a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:11.705381 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df80e27-b473-4b9d-b30e-c31e5652df07 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:11.706874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-4df80e27-b473-4b9d-b30e-c31e5652df07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:11.776041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1041/2041] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:11.788505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff9530-c6e0-4fd0-9d64-a997b3bf82a3 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:11.790044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0aff9530-c6e0-4fd0-9d64-a997b3bf82a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:11.800176 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df80e27-b473-4b9d-b30e-c31e5652df07 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:11.852081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c84f8-aa7e-433e-a6c6-74aa9e42fcf9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f9ba17c2634999b350b887a5229e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:11.852745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c84f8-aa7e-433e-a6c6-74aa9e42fcf9 service glance] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:11.853030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c84f8-aa7e-433e-a6c6-74aa9e42fcf9 service glance] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:11.853335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c84f8-aa7e-433e-a6c6-74aa9e42fcf9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:11.854837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:11.857358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff9530-c6e0-4fd0-9d64-a997b3bf82a3 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:11.865852 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ad971-2185-49fe-a38c-28f6a016aa09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:11.865852 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ad971-2185-49fe-a38c-28f6a016aa09 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:11.865852 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ad971-2185-49fe-a38c-28f6a016aa09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:11.865852 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ad971-2185-49fe-a38c-28f6a016aa09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:11.872976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ad971-2185-49fe-a38c-28f6a016aa09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:11.874419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ad971-2185-49fe-a38c-28f6a016aa09 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:11.884560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1042/2042] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:30:11.920422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c84f8-aa7e-433e-a6c6-74aa9e42fcf9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:11.922128 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c84f8-aa7e-433e-a6c6-74aa9e42fcf9 service glance] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:11.945355 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1001/2043] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:30:12.005904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:12.944881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:13.476376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:14.946004 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e07c-ddc8-4446-adff-e34c6c79e3d2 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:14.946875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e07c-ddc8-4446-adff-e34c6c79e3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:14.947623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e07c-ddc8-4446-adff-e34c6c79e3d2 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:14.949631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1043/2044] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:30:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:30:14.956566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d38fe-337b-4186-abdb-f11b25edbcde None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:14.957083 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d38fe-337b-4186-abdb-f11b25edbcde None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:14.957218 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d38fe-337b-4186-abdb-f11b25edbcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:14.977149 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e72d38fe-337b-4186-abdb-f11b25edbcde None None] MFA Rules not processed for user `b62795a6111a4c05a24e69efc7a0faba`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:14.978423 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e72d38fe-337b-4186-abdb-f11b25edbcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:15.064327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1002/2045] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:30:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:15.076264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85e07c-ddc8-4446-adff-e34c6c79e3d2 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:15.078007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-6b85e07c-ddc8-4446-adff-e34c6c79e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:15.104395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85e07c-ddc8-4446-adff-e34c6c79e3d2 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:15.111448 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70007a4-555d-4c84-ba08-0c2c1010b749 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b62795a6111a4c05a24e69efc7a0faba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:15.112338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70007a4-555d-4c84-ba08-0c2c1010b749 service placement] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:15.112774 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70007a4-555d-4c84-ba08-0c2c1010b749 service placement] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:15.113245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70007a4-555d-4c84-ba08-0c2c1010b749 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:15.127299 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70007a4-555d-4c84-ba08-0c2c1010b749 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:15.129187 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70007a4-555d-4c84-ba08-0c2c1010b749 service placement] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:15.141159 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d38fe-337b-4186-abdb-f11b25edbcde None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:15.142615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e72d38fe-337b-4186-abdb-f11b25edbcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:15.155677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1044/2046] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:15.229325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d38fe-337b-4186-abdb-f11b25edbcde None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:15.233854 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27635bdf-c357-4762-bdbf-a0c4e3333598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:15.234727 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27635bdf-c357-4762-bdbf-a0c4e3333598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:15.235040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27635bdf-c357-4762-bdbf-a0c4e3333598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:15.235945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27635bdf-c357-4762-bdbf-a0c4e3333598 admin admin] PATH_INFO: `/v3/users/3e0ff52608ed4cd4b9b4dfadc97ce9f5` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:15.237258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27635bdf-c357-4762-bdbf-a0c4e3333598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0ff52608ed4cd4b9b4dfadc97ce9f5)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:15.239194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27635bdf-c357-4762-bdbf-a0c4e3333598 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:15.501745 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-27635bdf-c357-4762-bdbf-a0c4e3333598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0ff52608ed4cd4b9b4dfadc97ce9f5'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:15.544835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:15.576403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-27635bdf-c357-4762-bdbf-a0c4e3333598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0ff52608ed4cd4b9b4dfadc97ce9f5'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:15.589631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-27635bdf-c357-4762-bdbf-a0c4e3333598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0ff52608ed4cd4b9b4dfadc97ce9f5'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:15.590319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-27635bdf-c357-4762-bdbf-a0c4e3333598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0ff52608ed4cd4b9b4dfadc97ce9f5'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:15.598182 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-27635bdf-c357-4762-bdbf-a0c4e3333598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0ff52608ed4cd4b9b4dfadc97ce9f5'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:15.604400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1003/2047] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:15 2022] DELETE /identity/v3/users/3e0ff52608ed4cd4b9b4dfadc97ce9f5 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:15.860047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70007a4-555d-4c84-ba08-0c2c1010b749 service placement] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:15.871536 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70007a4-555d-4c84-ba08-0c2c1010b749 service placement] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:15.929103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fdf55-3185-4bac-8cda-5e01d963a74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:15.930003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fdf55-3185-4bac-8cda-5e01d963a74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:15.930282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fdf55-3185-4bac-8cda-5e01d963a74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:15.930554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fdf55-3185-4bac-8cda-5e01d963a74c admin admin] PATH_INFO: `/v3/projects/0bec0d73869348db900bc569664bb7b3` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:15.931747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fdf55-3185-4bac-8cda-5e01d963a74c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bec0d73869348db900bc569664bb7b3)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:15.933685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fdf55-3185-4bac-8cda-5e01d963a74c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:16.079414 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5f0fdf55-3185-4bac-8cda-5e01d963a74c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bec0d73869348db900bc569664bb7b3', 'request_id': 'req-5f0fdf55-3185-4bac-8cda-5e01d963a74c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:16.154033 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5f0fdf55-3185-4bac-8cda-5e01d963a74c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bec0d73869348db900bc569664bb7b3', 'request_id': 'req-5f0fdf55-3185-4bac-8cda-5e01d963a74c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:16.163535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5f0fdf55-3185-4bac-8cda-5e01d963a74c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bec0d73869348db900bc569664bb7b3', 'request_id': 'req-5f0fdf55-3185-4bac-8cda-5e01d963a74c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:16.184066 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5f0fdf55-3185-4bac-8cda-5e01d963a74c admin admin] The token cache is being invalidate because project 0bec0d73869348db900bc569664bb7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:16.184437 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5f0fdf55-3185-4bac-8cda-5e01d963a74c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:16.185197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5f0fdf55-3185-4bac-8cda-5e01d963a74c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:16.188430 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1045/2048] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:15 2022] DELETE /identity/v3/projects/0bec0d73869348db900bc569664bb7b3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:16.193646 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2b0e0-c567-4919-85a6-6d53cce8dfef None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:16.198259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2b0e0-c567-4919-85a6-6d53cce8dfef None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:16.198259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2b0e0-c567-4919-85a6-6d53cce8dfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:16.212617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-79c2b0e0-c567-4919-85a6-6d53cce8dfef None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:16.214035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-79c2b0e0-c567-4919-85a6-6d53cce8dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:16.285296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1004/2049] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:16.294215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f07b7f-d455-4bae-b97d-3ede7998cb33 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:16.294752 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f07b7f-d455-4bae-b97d-3ede7998cb33 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:16.295291 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f07b7f-d455-4bae-b97d-3ede7998cb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:16.314214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-49f07b7f-d455-4bae-b97d-3ede7998cb33 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:16.315523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-49f07b7f-d455-4bae-b97d-3ede7998cb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:16.324343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1046/2050] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:16.328506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2b0e0-c567-4919-85a6-6d53cce8dfef None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:16.339270 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2b0e0-c567-4919-85a6-6d53cce8dfef None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:16.350986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4f97-8c94-42b2-9b36-e929ab6f052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:16.351706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4f97-8c94-42b2-9b36-e929ab6f052d admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:16.352006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4f97-8c94-42b2-9b36-e929ab6f052d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:16.352286 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4f97-8c94-42b2-9b36-e929ab6f052d admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:16.353055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d4f97-8c94-42b2-9b36-e929ab6f052d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:30:16.353396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d4f97-8c94-42b2-9b36-e929ab6f052d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:16.355002 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d4f97-8c94-42b2-9b36-e929ab6f052d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:16.375677 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1005/2051] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:30:16.380233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f07b7f-d455-4bae-b97d-3ede7998cb33 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:16.397912 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f07b7f-d455-4bae-b97d-3ede7998cb33 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:16.416713 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666b9ff-f1ba-4462-b2ff-dd11fec51451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:16.417740 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666b9ff-f1ba-4462-b2ff-dd11fec51451 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:16.418077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666b9ff-f1ba-4462-b2ff-dd11fec51451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:16.418356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666b9ff-f1ba-4462-b2ff-dd11fec51451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:16.419437 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666b9ff-f1ba-4462-b2ff-dd11fec51451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:16.421763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666b9ff-f1ba-4462-b2ff-dd11fec51451 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:16.439558 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:16.563935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1047/2052] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:16 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:16.567936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4f97-8c94-42b2-9b36-e929ab6f052d admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:16.578207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4f97-8c94-42b2-9b36-e929ab6f052d admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:16.645015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10746d3b-c000-4e71-a540-fcf9a80cd9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:16.645754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10746d3b-c000-4e71-a540-fcf9a80cd9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:16.646035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10746d3b-c000-4e71-a540-fcf9a80cd9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:16.649392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10746d3b-c000-4e71-a540-fcf9a80cd9d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:16.649392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10746d3b-c000-4e71-a540-fcf9a80cd9d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:16.649392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10746d3b-c000-4e71-a540-fcf9a80cd9d9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:16.737159 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1006/2053] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:16 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:30:16.741083 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666b9ff-f1ba-4462-b2ff-dd11fec51451 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:16.751875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666b9ff-f1ba-4462-b2ff-dd11fec51451 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:16.756577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc83bce-64a6-4938-8b23-0aa54ccb9dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:16.757265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc83bce-64a6-4938-8b23-0aa54ccb9dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:16.757552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc83bce-64a6-4938-8b23-0aa54ccb9dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:16.757830 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc83bce-64a6-4938-8b23-0aa54ccb9dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:16.758584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc83bce-64a6-4938-8b23-0aa54ccb9dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:16.760175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc83bce-64a6-4938-8b23-0aa54ccb9dfe admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:16.771265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1048/2054] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:16.775225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10746d3b-c000-4e71-a540-fcf9a80cd9d9 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:16.785013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10746d3b-c000-4e71-a540-fcf9a80cd9d9 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:16.790215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaa10e-15f8-414e-b1c4-72e9b5d2c45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:16.790920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaa10e-15f8-414e-b1c4-72e9b5d2c45e admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:16.791211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaa10e-15f8-414e-b1c4-72e9b5d2c45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:16.792292 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaa10e-15f8-414e-b1c4-72e9b5d2c45e admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:16.793067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaa10e-15f8-414e-b1c4-72e9b5d2c45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:16.795566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaa10e-15f8-414e-b1c4-72e9b5d2c45e admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:16.807454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1007/2055] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:16.814503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc83bce-64a6-4938-8b23-0aa54ccb9dfe admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:16.824718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc83bce-64a6-4938-8b23-0aa54ccb9dfe admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:16.830062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e130aff-c687-46a5-bf81-42d8e7f5ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:16.830949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e130aff-c687-46a5-bf81-42d8e7f5ded6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:16.842318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e130aff-c687-46a5-bf81-42d8e7f5ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:16.842318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e130aff-c687-46a5-bf81-42d8e7f5ded6 admin admin] PATH_INFO: `/v3/projects/08246599e1ef4eef8c7d02edc96c2c8a/users/95ee4f5eea3b49a3a792a0bb13bb427a/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:16.847090 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e130aff-c687-46a5-bf81-42d8e7f5ded6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08246599e1ef4eef8c7d02edc96c2c8a, user_id=95ee4f5eea3b49a3a792a0bb13bb427a, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:16.850180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e130aff-c687-46a5-bf81-42d8e7f5ded6 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:16.923392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1049/2056] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:16 2022] PUT /identity/v3/projects/08246599e1ef4eef8c7d02edc96c2c8a/users/95ee4f5eea3b49a3a792a0bb13bb427a/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:16.934283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278162-066a-4681-84a2-c360dd79e844 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:16.934570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278162-066a-4681-84a2-c360dd79e844 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:16.934870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278162-066a-4681-84a2-c360dd79e844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:16.962040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-20278162-066a-4681-84a2-c360dd79e844 None None] MFA Rules not processed for user `95ee4f5eea3b49a3a792a0bb13bb427a`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:16.963254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-20278162-066a-4681-84a2-c360dd79e844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:17.031661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1008/2057] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:17.040552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e130aff-c687-46a5-bf81-42d8e7f5ded6 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:17.105290 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e130aff-c687-46a5-bf81-42d8e7f5ded6 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:17.110971 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df892c6-a12b-44b3-889b-2f9c9baa4f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:17.112134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df892c6-a12b-44b3-889b-2f9c9baa4f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:17.112423 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df892c6-a12b-44b3-889b-2f9c9baa4f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:17.112703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df892c6-a12b-44b3-889b-2f9c9baa4f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:17.113444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df892c6-a12b-44b3-889b-2f9c9baa4f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:17.115452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df892c6-a12b-44b3-889b-2f9c9baa4f55 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:17.268967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1050/2058] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:17 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:17.269203 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20278162-066a-4681-84a2-c360dd79e844 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:17.276040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20278162-066a-4681-84a2-c360dd79e844 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:17.341938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7c016-5649-4ffa-aeec-14958a4144a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:17.345584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7c016-5649-4ffa-aeec-14958a4144a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:17.345584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7c016-5649-4ffa-aeec-14958a4144a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:17.345584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7c016-5649-4ffa-aeec-14958a4144a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:17.345584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7c016-5649-4ffa-aeec-14958a4144a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:17.346325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7c016-5649-4ffa-aeec-14958a4144a7 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:17.514189 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1009/2059] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:17 2022] POST /identity/v3/users => generated 299 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:17.518899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df892c6-a12b-44b3-889b-2f9c9baa4f55 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:17.536156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df892c6-a12b-44b3-889b-2f9c9baa4f55 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:17.536156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3fcaa-812a-416d-b55c-e0e88a373520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:17.536539 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3fcaa-812a-416d-b55c-e0e88a373520 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:17.536869 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3fcaa-812a-416d-b55c-e0e88a373520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:17.537186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3fcaa-812a-416d-b55c-e0e88a373520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:17.537927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3fcaa-812a-416d-b55c-e0e88a373520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:17.539575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3fcaa-812a-416d-b55c-e0e88a373520 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:17.554833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1051/2060] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:17.558714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7c016-5649-4ffa-aeec-14958a4144a7 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:17.569556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7c016-5649-4ffa-aeec-14958a4144a7 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:17.574547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeed85e-8ad8-44af-9436-c94f5a61de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:17.575578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeed85e-8ad8-44af-9436-c94f5a61de92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:17.575930 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeed85e-8ad8-44af-9436-c94f5a61de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:17.576257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeed85e-8ad8-44af-9436-c94f5a61de92 admin admin] PATH_INFO: `/v3/projects/a129d78b82ae4a56a4b8a9b2e61cec29/users/01ffa8d677234dbeb2371d24e4746ab1/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:17.591996 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeed85e-8ad8-44af-9436-c94f5a61de92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a129d78b82ae4a56a4b8a9b2e61cec29, user_id=01ffa8d677234dbeb2371d24e4746ab1, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:17.595631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeed85e-8ad8-44af-9436-c94f5a61de92 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:17.729947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1010/2061] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:17 2022] PUT /identity/v3/projects/a129d78b82ae4a56a4b8a9b2e61cec29/users/01ffa8d677234dbeb2371d24e4746ab1/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:17.733864 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3fcaa-812a-416d-b55c-e0e88a373520 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:17.746103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3fcaa-812a-416d-b55c-e0e88a373520 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:17.818373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd6fd4-17f8-4c90-a06c-147c5de887fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:17.819073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd6fd4-17f8-4c90-a06c-147c5de887fa admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:17.819374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd6fd4-17f8-4c90-a06c-147c5de887fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:17.819631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd6fd4-17f8-4c90-a06c-147c5de887fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:17.820372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd6fd4-17f8-4c90-a06c-147c5de887fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:17.822078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd6fd4-17f8-4c90-a06c-147c5de887fa admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:17.835561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1052/2062] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:17.837692 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeed85e-8ad8-44af-9436-c94f5a61de92 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:17.849175 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeed85e-8ad8-44af-9436-c94f5a61de92 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:17.867011 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31fee0-b8ca-4cf0-9023-b07ae6445ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:17.867946 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31fee0-b8ca-4cf0-9023-b07ae6445ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:17.868304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31fee0-b8ca-4cf0-9023-b07ae6445ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:17.868783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31fee0-b8ca-4cf0-9023-b07ae6445ef6 admin admin] PATH_INFO: `/v3/projects/a129d78b82ae4a56a4b8a9b2e61cec29/users/01ffa8d677234dbeb2371d24e4746ab1/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:17.871224 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31fee0-b8ca-4cf0-9023-b07ae6445ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a129d78b82ae4a56a4b8a9b2e61cec29, user_id=01ffa8d677234dbeb2371d24e4746ab1, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:17.874080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31fee0-b8ca-4cf0-9023-b07ae6445ef6 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:17.884935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1011/2063] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:17 2022] PUT /identity/v3/projects/a129d78b82ae4a56a4b8a9b2e61cec29/users/01ffa8d677234dbeb2371d24e4746ab1/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:17.895596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19765b2f-27cd-43cf-b5d8-0aab65d34372 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:17.895904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19765b2f-27cd-43cf-b5d8-0aab65d34372 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:17.896181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19765b2f-27cd-43cf-b5d8-0aab65d34372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:17.925151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-19765b2f-27cd-43cf-b5d8-0aab65d34372 None None] MFA Rules not processed for user `01ffa8d677234dbeb2371d24e4746ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:17.926344 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-19765b2f-27cd-43cf-b5d8-0aab65d34372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:18.002183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1053/2064] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:18.015294 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31fee0-b8ca-4cf0-9023-b07ae6445ef6 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:18.017659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-be31fee0-b8ca-4cf0-9023-b07ae6445ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:18.073390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31fee0-b8ca-4cf0-9023-b07ae6445ef6 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:18.077242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5925a-26eb-4090-810e-82bb0cc3545e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:18.078125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5925a-26eb-4090-810e-82bb0cc3545e service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:18.078415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5925a-26eb-4090-810e-82bb0cc3545e service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:18.078859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5925a-26eb-4090-810e-82bb0cc3545e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:18.089888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5925a-26eb-4090-810e-82bb0cc3545e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:18.091635 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5925a-26eb-4090-810e-82bb0cc3545e service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:18.102187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1012/2065] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:18.131072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19765b2f-27cd-43cf-b5d8-0aab65d34372 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:18.193783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19765b2f-27cd-43cf-b5d8-0aab65d34372 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:18.198391 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:18.199266 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:18.199542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:18.199812 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] PATH_INFO: `/v3/users/95ee4f5eea3b49a3a792a0bb13bb427a` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:18.201028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ee4f5eea3b49a3a792a0bb13bb427a)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:18.203073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:18.207901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:18.473391 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ee4f5eea3b49a3a792a0bb13bb427a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:18.548542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ee4f5eea3b49a3a792a0bb13bb427a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:18.549217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ee4f5eea3b49a3a792a0bb13bb427a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:18.561624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ee4f5eea3b49a3a792a0bb13bb427a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:18.569023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ee4f5eea3b49a3a792a0bb13bb427a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:18.575396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1054/2066] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:18 2022] DELETE /identity/v3/users/95ee4f5eea3b49a3a792a0bb13bb427a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:18.580151 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c824cb8-3fac-41a5-aaae-e0db083c98df None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:18.580681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c824cb8-3fac-41a5-aaae-e0db083c98df None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:18.580802 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c824cb8-3fac-41a5-aaae-e0db083c98df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:18.598494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-1c824cb8-3fac-41a5-aaae-e0db083c98df None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:18.599676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1c824cb8-3fac-41a5-aaae-e0db083c98df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:18.659353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1013/2067] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:18.678783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:18.678783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:18.740454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead7752-c699-4a8f-9d4d-65195ea2e957 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:18.744061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7614ffa-b704-4724-932f-3459436fb278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:18.744714 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7614ffa-b704-4724-932f-3459436fb278 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:18.745194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7614ffa-b704-4724-932f-3459436fb278 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:18.745473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7614ffa-b704-4724-932f-3459436fb278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:18.756339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7614ffa-b704-4724-932f-3459436fb278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:18.758078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7614ffa-b704-4724-932f-3459436fb278 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:18.768779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1055/2068] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:30:18.841995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:19.262683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c824cb8-3fac-41a5-aaae-e0db083c98df None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:19.262683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1c824cb8-3fac-41a5-aaae-e0db083c98df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:19.298304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c824cb8-3fac-41a5-aaae-e0db083c98df None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:19.307433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:19.308386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:19.308845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:19.309313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] PATH_INFO: `/v3/projects/08246599e1ef4eef8c7d02edc96c2c8a` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:19.310898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=08246599e1ef4eef8c7d02edc96c2c8a)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:19.313080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:19.435986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08246599e1ef4eef8c7d02edc96c2c8a', 'request_id': 'req-1d278455-6b39-4aa6-8efa-ada0c961cfdb'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:19.515796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08246599e1ef4eef8c7d02edc96c2c8a', 'request_id': 'req-1d278455-6b39-4aa6-8efa-ada0c961cfdb'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:19.523175 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08246599e1ef4eef8c7d02edc96c2c8a', 'request_id': 'req-1d278455-6b39-4aa6-8efa-ada0c961cfdb'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:19.534250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] The token cache is being invalidate because project 08246599e1ef4eef8c7d02edc96c2c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:19.534537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:19.535196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:19.536750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1014/2069] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:19 2022] DELETE /identity/v3/projects/08246599e1ef4eef8c7d02edc96c2c8a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:19.540729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7614ffa-b704-4724-932f-3459436fb278 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:19.551562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7614ffa-b704-4724-932f-3459436fb278 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:19.648159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68cfb5-545d-4538-8cca-61c4841639c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:19.649448 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68cfb5-545d-4538-8cca-61c4841639c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:19.649891 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68cfb5-545d-4538-8cca-61c4841639c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:19.650168 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68cfb5-545d-4538-8cca-61c4841639c9 admin admin] PATH_INFO: `/v3/users/01ffa8d677234dbeb2371d24e4746ab1` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:19.651874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68cfb5-545d-4538-8cca-61c4841639c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ffa8d677234dbeb2371d24e4746ab1)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:19.653927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68cfb5-545d-4538-8cca-61c4841639c9 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:19.784960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:19.847209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-2a68cfb5-545d-4538-8cca-61c4841639c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ffa8d677234dbeb2371d24e4746ab1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:19.854108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:19.939212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-2a68cfb5-545d-4538-8cca-61c4841639c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ffa8d677234dbeb2371d24e4746ab1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:19.939867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-2a68cfb5-545d-4538-8cca-61c4841639c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ffa8d677234dbeb2371d24e4746ab1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:19.952433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-2a68cfb5-545d-4538-8cca-61c4841639c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ffa8d677234dbeb2371d24e4746ab1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:19.959256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-2a68cfb5-545d-4538-8cca-61c4841639c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ffa8d677234dbeb2371d24e4746ab1'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:19.965370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1056/2070] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:19 2022] DELETE /identity/v3/users/01ffa8d677234dbeb2371d24e4746ab1 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:20.424086 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:20.426637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:20.439122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d278455-6b39-4aa6-8efa-ada0c961cfdb admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:20.520618 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b1636-e352-4875-9be0-fbcf60bd337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:20.521603 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b1636-e352-4875-9be0-fbcf60bd337f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:20.521895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b1636-e352-4875-9be0-fbcf60bd337f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:20.522170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b1636-e352-4875-9be0-fbcf60bd337f admin admin] PATH_INFO: `/v3/projects/a129d78b82ae4a56a4b8a9b2e61cec29` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:20.523517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b1636-e352-4875-9be0-fbcf60bd337f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a129d78b82ae4a56a4b8a9b2e61cec29)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:20.525495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b1636-e352-4875-9be0-fbcf60bd337f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:20.657802 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-624b1636-e352-4875-9be0-fbcf60bd337f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a129d78b82ae4a56a4b8a9b2e61cec29', 'request_id': 'req-624b1636-e352-4875-9be0-fbcf60bd337f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:20.728297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-624b1636-e352-4875-9be0-fbcf60bd337f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a129d78b82ae4a56a4b8a9b2e61cec29', 'request_id': 'req-624b1636-e352-4875-9be0-fbcf60bd337f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:20.737224 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-624b1636-e352-4875-9be0-fbcf60bd337f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a129d78b82ae4a56a4b8a9b2e61cec29', 'request_id': 'req-624b1636-e352-4875-9be0-fbcf60bd337f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:20.750330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-624b1636-e352-4875-9be0-fbcf60bd337f admin admin] The token cache is being invalidate because project a129d78b82ae4a56a4b8a9b2e61cec29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:20.750866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-624b1636-e352-4875-9be0-fbcf60bd337f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:20.751318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-624b1636-e352-4875-9be0-fbcf60bd337f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:20.754428 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1015/2071] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:20 2022] DELETE /identity/v3/projects/a129d78b82ae4a56a4b8a9b2e61cec29 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:20.762810 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043da2c-23a2-4c9e-b178-cbfab5108209 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:20.763287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043da2c-23a2-4c9e-b178-cbfab5108209 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:20.763439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043da2c-23a2-4c9e-b178-cbfab5108209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:20.791013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-f043da2c-23a2-4c9e-b178-cbfab5108209 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:20.793359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f043da2c-23a2-4c9e-b178-cbfab5108209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:20.877327 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1057/2072] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:20.880907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202430-4562-4833-9482-6d6fc80e08e7 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:20.881448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202430-4562-4833-9482-6d6fc80e08e7 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:20.881574 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202430-4562-4833-9482-6d6fc80e08e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:20.909287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-98202430-4562-4833-9482-6d6fc80e08e7 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:20.913947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-98202430-4562-4833-9482-6d6fc80e08e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:20.922901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1016/2073] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:30:20.924090 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043da2c-23a2-4c9e-b178-cbfab5108209 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:20.934089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043da2c-23a2-4c9e-b178-cbfab5108209 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:20.938962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983250b-d7c0-4e23-90dc-a88334b7609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:20.939624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983250b-d7c0-4e23-90dc-a88334b7609f admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:20.939913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983250b-d7c0-4e23-90dc-a88334b7609f admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:20.940191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983250b-d7c0-4e23-90dc-a88334b7609f admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:20.940924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983250b-d7c0-4e23-90dc-a88334b7609f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:30:20.941276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983250b-d7c0-4e23-90dc-a88334b7609f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:20.942941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983250b-d7c0-4e23-90dc-a88334b7609f admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:20.955742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1058/2074] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:30:20.960128 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202430-4562-4833-9482-6d6fc80e08e7 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:20.970636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202430-4562-4833-9482-6d6fc80e08e7 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:20.973830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:20.981476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea427ad-c32f-4657-b6ad-a8a48a4fc470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:20.984817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea427ad-c32f-4657-b6ad-a8a48a4fc470 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:20.984817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea427ad-c32f-4657-b6ad-a8a48a4fc470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:20.984817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea427ad-c32f-4657-b6ad-a8a48a4fc470 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:20.984817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea427ad-c32f-4657-b6ad-a8a48a4fc470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:20.987719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea427ad-c32f-4657-b6ad-a8a48a4fc470 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:21.014221 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:21.084375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1017/2075] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:20 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:21.089137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983250b-d7c0-4e23-90dc-a88334b7609f admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:21.106989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983250b-d7c0-4e23-90dc-a88334b7609f admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:21.178150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eba589-1777-42c4-a742-544c285eebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:21.179117 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eba589-1777-42c4-a742-544c285eebde admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:21.179559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eba589-1777-42c4-a742-544c285eebde admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:21.179994 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eba589-1777-42c4-a742-544c285eebde admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:21.181177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eba589-1777-42c4-a742-544c285eebde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:21.184036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eba589-1777-42c4-a742-544c285eebde admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:21.292921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1059/2076] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:21 2022] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:21.295381 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea427ad-c32f-4657-b6ad-a8a48a4fc470 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:21.309058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea427ad-c32f-4657-b6ad-a8a48a4fc470 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:21.317401 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906437b3-9665-47ee-b4bf-783520506302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:21.318095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906437b3-9665-47ee-b4bf-783520506302 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:21.318383 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906437b3-9665-47ee-b4bf-783520506302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:21.318663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906437b3-9665-47ee-b4bf-783520506302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:21.319462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906437b3-9665-47ee-b4bf-783520506302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:21.321146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906437b3-9665-47ee-b4bf-783520506302 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:21.336421 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1018/2077] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:30:21.337665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eba589-1777-42c4-a742-544c285eebde admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:21.349526 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eba589-1777-42c4-a742-544c285eebde admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:21.378591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b0061-8b36-479e-9837-7af4d4869021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:21.378591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b0061-8b36-479e-9837-7af4d4869021 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:21.378591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b0061-8b36-479e-9837-7af4d4869021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:21.378591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b0061-8b36-479e-9837-7af4d4869021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:21.379015 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b0061-8b36-479e-9837-7af4d4869021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:21.381982 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b0061-8b36-479e-9837-7af4d4869021 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:21.401184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1060/2078] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:21.404209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906437b3-9665-47ee-b4bf-783520506302 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:21.419536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906437b3-9665-47ee-b4bf-783520506302 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:21.448341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ddcfc-3071-425f-83d6-745614dbecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:21.451966 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ddcfc-3071-425f-83d6-745614dbecef admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:21.451966 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ddcfc-3071-425f-83d6-745614dbecef admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:21.451966 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ddcfc-3071-425f-83d6-745614dbecef admin admin] PATH_INFO: `/v3/projects/4a0df0da21e7467a9239ade6b4dc2fa6/users/97e7fc393ff14e1c9c1c4632db3acc3b/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:21.487458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ddcfc-3071-425f-83d6-745614dbecef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a0df0da21e7467a9239ade6b4dc2fa6, user_id=97e7fc393ff14e1c9c1c4632db3acc3b, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:21.494153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ddcfc-3071-425f-83d6-745614dbecef admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:21.580567 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1019/2079] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:21 2022] PUT /identity/v3/projects/4a0df0da21e7467a9239ade6b4dc2fa6/users/97e7fc393ff14e1c9c1c4632db3acc3b/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:21.590908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e87d-76f7-4136-ae6e-6754db3a496e None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:21.591205 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e87d-76f7-4136-ae6e-6754db3a496e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:21.591489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e87d-76f7-4136-ae6e-6754db3a496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:21.618486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-74a6e87d-76f7-4136-ae6e-6754db3a496e None None] MFA Rules not processed for user `97e7fc393ff14e1c9c1c4632db3acc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:21.619736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-74a6e87d-76f7-4136-ae6e-6754db3a496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:21.696501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1061/2080] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:21.700855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ddcfc-3071-425f-83d6-745614dbecef admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:21.778501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ddcfc-3071-425f-83d6-745614dbecef admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:21.784046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fd4a3-9bcf-41ad-9478-c4e4296e9b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:21.784933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd4a3-9bcf-41ad-9478-c4e4296e9b2e admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:21.785252 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd4a3-9bcf-41ad-9478-c4e4296e9b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:21.785594 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd4a3-9bcf-41ad-9478-c4e4296e9b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:21.786413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fd4a3-9bcf-41ad-9478-c4e4296e9b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:21.788511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fd4a3-9bcf-41ad-9478-c4e4296e9b2e admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:21.894958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1020/2081] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:21 2022] POST /identity/v3/projects => generated 393 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:30:21.899195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6e87d-76f7-4136-ae6e-6754db3a496e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:21.910185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6e87d-76f7-4136-ae6e-6754db3a496e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:21.971443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0c3cf-76ee-4d7b-bafd-e19c6d26e87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:21.971443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0c3cf-76ee-4d7b-bafd-e19c6d26e87e admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:21.971443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0c3cf-76ee-4d7b-bafd-e19c6d26e87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:21.971443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0c3cf-76ee-4d7b-bafd-e19c6d26e87e admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:21.971781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0c3cf-76ee-4d7b-bafd-e19c6d26e87e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:21.972864 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0c3cf-76ee-4d7b-bafd-e19c6d26e87e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:22.082671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1062/2082] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:21 2022] POST /identity/v3/users => generated 303 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:22.086676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fd4a3-9bcf-41ad-9478-c4e4296e9b2e admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:22.097097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fd4a3-9bcf-41ad-9478-c4e4296e9b2e admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:22.101836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb66f1-5c19-4b7a-a437-cfd7b6092a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:22.102501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb66f1-5c19-4b7a-a437-cfd7b6092a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:22.102790 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb66f1-5c19-4b7a-a437-cfd7b6092a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:22.103093 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb66f1-5c19-4b7a-a437-cfd7b6092a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:22.103788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb66f1-5c19-4b7a-a437-cfd7b6092a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:22.105405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb66f1-5c19-4b7a-a437-cfd7b6092a7f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:22.121653 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1021/2083] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:22.126449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0c3cf-76ee-4d7b-bafd-e19c6d26e87e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:22.136634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0c3cf-76ee-4d7b-bafd-e19c6d26e87e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:22.141331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e9abc-bc37-4cff-8cda-f0e9398b8d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:22.142251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e9abc-bc37-4cff-8cda-f0e9398b8d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:22.143058 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e9abc-bc37-4cff-8cda-f0e9398b8d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:22.143336 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e9abc-bc37-4cff-8cda-f0e9398b8d03 admin admin] PATH_INFO: `/v3/projects/0917e67dc369432dbc29c30ba3a3b880/users/d883ae9316fa413aa6579b15b93cf6ac/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:22.157746 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e9abc-bc37-4cff-8cda-f0e9398b8d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0917e67dc369432dbc29c30ba3a3b880, user_id=d883ae9316fa413aa6579b15b93cf6ac, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:22.160477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e9abc-bc37-4cff-8cda-f0e9398b8d03 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:22.228153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1063/2084] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:22 2022] PUT /identity/v3/projects/0917e67dc369432dbc29c30ba3a3b880/users/d883ae9316fa413aa6579b15b93cf6ac/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:22.232191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb66f1-5c19-4b7a-a437-cfd7b6092a7f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:22.242623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb66f1-5c19-4b7a-a437-cfd7b6092a7f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:22.307531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fbf9f-2a51-4cc5-bac9-1a6a324259e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:22.309805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:22.310353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fbf9f-2a51-4cc5-bac9-1a6a324259e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:22.310921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fbf9f-2a51-4cc5-bac9-1a6a324259e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:22.311398 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fbf9f-2a51-4cc5-bac9-1a6a324259e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:22.312479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fbf9f-2a51-4cc5-bac9-1a6a324259e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:22.314804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fbf9f-2a51-4cc5-bac9-1a6a324259e9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:22.325133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1022/2085] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:30:22.329621 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e9abc-bc37-4cff-8cda-f0e9398b8d03 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:22.347725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e9abc-bc37-4cff-8cda-f0e9398b8d03 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:22.352842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad92b86-8f4a-4019-88c9-aca6f81fa89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:22.353778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad92b86-8f4a-4019-88c9-aca6f81fa89d admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:22.354063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad92b86-8f4a-4019-88c9-aca6f81fa89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:22.354498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad92b86-8f4a-4019-88c9-aca6f81fa89d admin admin] PATH_INFO: `/v3/projects/0917e67dc369432dbc29c30ba3a3b880/users/d883ae9316fa413aa6579b15b93cf6ac/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:22.356371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad92b86-8f4a-4019-88c9-aca6f81fa89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0917e67dc369432dbc29c30ba3a3b880, user_id=d883ae9316fa413aa6579b15b93cf6ac, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:22.359101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad92b86-8f4a-4019-88c9-aca6f81fa89d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:22.371139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1064/2086] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:22 2022] PUT /identity/v3/projects/0917e67dc369432dbc29c30ba3a3b880/users/d883ae9316fa413aa6579b15b93cf6ac/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:22.383258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a73069-c741-4346-b54b-02f18d0455c3 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:22.383555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a73069-c741-4346-b54b-02f18d0455c3 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:22.383844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a73069-c741-4346-b54b-02f18d0455c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:22.410567 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-d1a73069-c741-4346-b54b-02f18d0455c3 None None] MFA Rules not processed for user `d883ae9316fa413aa6579b15b93cf6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:22.411778 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d1a73069-c741-4346-b54b-02f18d0455c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:22.489685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1023/2087] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:22.489987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:22.497800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad92b86-8f4a-4019-88c9-aca6f81fa89d admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:22.499906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-7ad92b86-8f4a-4019-88c9-aca6f81fa89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:22.577611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad92b86-8f4a-4019-88c9-aca6f81fa89d admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:22.587497 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de050d55-1314-458e-9b6c-b67ab620ef6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:22.588179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de050d55-1314-458e-9b6c-b67ab620ef6c service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:22.588622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de050d55-1314-458e-9b6c-b67ab620ef6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:22.588972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de050d55-1314-458e-9b6c-b67ab620ef6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:22.601371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de050d55-1314-458e-9b6c-b67ab620ef6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:22.602919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de050d55-1314-458e-9b6c-b67ab620ef6c service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:22.616976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1065/2088] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:22.667681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a73069-c741-4346-b54b-02f18d0455c3 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:22.677737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a73069-c741-4346-b54b-02f18d0455c3 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:22.681501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa28d5-0e0e-4fc0-844c-10396cabf0ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:22.682244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa28d5-0e0e-4fc0-844c-10396cabf0ef service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:22.682563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa28d5-0e0e-4fc0-844c-10396cabf0ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:22.682872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa28d5-0e0e-4fc0-844c-10396cabf0ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:22.788414 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ea86-6922-4c1b-b843-724b92b867fc None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:22.788704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ea86-6922-4c1b-b843-724b92b867fc None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:22.792270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ea86-6922-4c1b-b843-724b92b867fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:22.792402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa28d5-0e0e-4fc0-844c-10396cabf0ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:22.792402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa28d5-0e0e-4fc0-844c-10396cabf0ef service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:22.801550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1024/2089] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:22.809941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-82b5ea86-6922-4c1b-b843-724b92b867fc None None] MFA Rules not processed for user `04e6be5748904071b53931cd7714b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:22.810932 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-82b5ea86-6922-4c1b-b843-724b92b867fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:22.875419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1066/2090] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:30:23.136952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:23.222978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:24.612873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa28d5-0e0e-4fc0-844c-10396cabf0ef service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:24.615076 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-4cfa28d5-0e0e-4fc0-844c-10396cabf0ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:24.627987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa28d5-0e0e-4fc0-844c-10396cabf0ef service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:24.631938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb323b5-6f00-493e-ada4-80122ea62744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:24.632588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb323b5-6f00-493e-ada4-80122ea62744 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:24.632895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb323b5-6f00-493e-ada4-80122ea62744 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:24.633182 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb323b5-6f00-493e-ada4-80122ea62744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:24.637260 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-ddb323b5-6f00-493e-ada4-80122ea62744 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:24.737364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb323b5-6f00-493e-ada4-80122ea62744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:24.738814 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb323b5-6f00-493e-ada4-80122ea62744 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:24.759243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1025/2091] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:25.123998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:25.785375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:26.453203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:27.322293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:27.881895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:28.468101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ea86-6922-4c1b-b843-724b92b867fc None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:28.554434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:28.560975 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ea86-6922-4c1b-b843-724b92b867fc None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:28.566457 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:28.567467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:28.567753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:28.568028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] PATH_INFO: `/v3/users/97e7fc393ff14e1c9c1c4632db3acc3b` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:28.569461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e7fc393ff14e1c9c1c4632db3acc3b)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:28.572185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:28.754438 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:28.755590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e7fc393ff14e1c9c1c4632db3acc3b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:28.839162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e7fc393ff14e1c9c1c4632db3acc3b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:28.839798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e7fc393ff14e1c9c1c4632db3acc3b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:28.852429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e7fc393ff14e1c9c1c4632db3acc3b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:28.859379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e7fc393ff14e1c9c1c4632db3acc3b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:28.865477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1067/2092] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:28 2022] DELETE /identity/v3/users/97e7fc393ff14e1c9c1c4632db3acc3b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:28.871948 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7740b-5bcb-4668-9554-8546639e5b9b None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:28.876938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7740b-5bcb-4668-9554-8546639e5b9b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:28.876938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7740b-5bcb-4668-9554-8546639e5b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:28.896194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e6b7740b-5bcb-4668-9554-8546639e5b9b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:28.897461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e6b7740b-5bcb-4668-9554-8546639e5b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:28.965253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1026/2093] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:28.975177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:28.975177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:29.075680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1071715-9146-4f50-bf56-5b8afa11a28c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:29.090374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca91b9-d014-4835-8e0a-3997dae4924c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:29.092798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca91b9-d014-4835-8e0a-3997dae4924c service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:29.093089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca91b9-d014-4835-8e0a-3997dae4924c service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:29.093436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca91b9-d014-4835-8e0a-3997dae4924c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:29.105069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca91b9-d014-4835-8e0a-3997dae4924c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:29.107245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca91b9-d014-4835-8e0a-3997dae4924c service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:29.118837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1068/2094] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:30:29.188709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:29.716099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:29.798550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7740b-5bcb-4668-9554-8546639e5b9b None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:29.800031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e6b7740b-5bcb-4668-9554-8546639e5b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:29.820830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7740b-5bcb-4668-9554-8546639e5b9b None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:29.826507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:29.827540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:29.827994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:29.828276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] PATH_INFO: `/v3/projects/4a0df0da21e7467a9239ade6b4dc2fa6` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:29.829718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a0df0da21e7467a9239ade6b4dc2fa6)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:29.831632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:29.955843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a0df0da21e7467a9239ade6b4dc2fa6', 'request_id': 'req-1c13be85-5e5e-43c3-93ea-927f89ad960c'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:30.039704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a0df0da21e7467a9239ade6b4dc2fa6', 'request_id': 'req-1c13be85-5e5e-43c3-93ea-927f89ad960c'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:30.047140 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a0df0da21e7467a9239ade6b4dc2fa6', 'request_id': 'req-1c13be85-5e5e-43c3-93ea-927f89ad960c'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:30.058737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] The token cache is being invalidate because project 4a0df0da21e7467a9239ade6b4dc2fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:30.059024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:30.060102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:30.061791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1027/2095] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:29 2022] DELETE /identity/v3/projects/4a0df0da21e7467a9239ade6b4dc2fa6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:30.066376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca91b9-d014-4835-8e0a-3997dae4924c service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:30.075854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca91b9-d014-4835-8e0a-3997dae4924c service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:30.133014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:30.137817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5f8f-5222-4504-8369-10945bb0339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:30.142550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5f8f-5222-4504-8369-10945bb0339e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:30.142550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5f8f-5222-4504-8369-10945bb0339e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:30.142550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5f8f-5222-4504-8369-10945bb0339e admin admin] PATH_INFO: `/v3/users/d883ae9316fa413aa6579b15b93cf6ac` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:30.142550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe5f8f-5222-4504-8369-10945bb0339e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d883ae9316fa413aa6579b15b93cf6ac)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:30.142550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe5f8f-5222-4504-8369-10945bb0339e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:30.324808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1dfe5f8f-5222-4504-8369-10945bb0339e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd883ae9316fa413aa6579b15b93cf6ac'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:30.419170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1dfe5f8f-5222-4504-8369-10945bb0339e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd883ae9316fa413aa6579b15b93cf6ac'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:30.420126 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1dfe5f8f-5222-4504-8369-10945bb0339e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd883ae9316fa413aa6579b15b93cf6ac'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:30.432683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1dfe5f8f-5222-4504-8369-10945bb0339e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd883ae9316fa413aa6579b15b93cf6ac'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:30.439925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1dfe5f8f-5222-4504-8369-10945bb0339e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd883ae9316fa413aa6579b15b93cf6ac'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:30.445784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1069/2096] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:30 2022] DELETE /identity/v3/users/d883ae9316fa413aa6579b15b93cf6ac => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:30.521888 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:30.670113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:30.847151 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:30.900380 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:30.901884 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:30.917904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13be85-5e5e-43c3-93ea-927f89ad960c admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:30.979772 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0780c-137a-48ab-826b-b8e24cd74aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:30.980639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0780c-137a-48ab-826b-b8e24cd74aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:30.980928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0780c-137a-48ab-826b-b8e24cd74aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:30.981242 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0780c-137a-48ab-826b-b8e24cd74aa9 admin admin] PATH_INFO: `/v3/projects/0917e67dc369432dbc29c30ba3a3b880` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:30.982450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0780c-137a-48ab-826b-b8e24cd74aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0917e67dc369432dbc29c30ba3a3b880)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:30.984366 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0780c-137a-48ab-826b-b8e24cd74aa9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:31.028726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:31.110968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-67d0780c-137a-48ab-826b-b8e24cd74aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0917e67dc369432dbc29c30ba3a3b880', 'request_id': 'req-67d0780c-137a-48ab-826b-b8e24cd74aa9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:31.199089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-67d0780c-137a-48ab-826b-b8e24cd74aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0917e67dc369432dbc29c30ba3a3b880', 'request_id': 'req-67d0780c-137a-48ab-826b-b8e24cd74aa9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:31.206706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-67d0780c-137a-48ab-826b-b8e24cd74aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0917e67dc369432dbc29c30ba3a3b880', 'request_id': 'req-67d0780c-137a-48ab-826b-b8e24cd74aa9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:31.217801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-67d0780c-137a-48ab-826b-b8e24cd74aa9 admin admin] The token cache is being invalidate because project 0917e67dc369432dbc29c30ba3a3b880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:31.218084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-67d0780c-137a-48ab-826b-b8e24cd74aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:31.218714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-67d0780c-137a-48ab-826b-b8e24cd74aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:31.220286 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1028/2097] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:30 2022] DELETE /identity/v3/projects/0917e67dc369432dbc29c30ba3a3b880 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:31.225140 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d6ffa-aa0a-46f5-a701-cf2eb6040bf9 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:31.225607 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d6ffa-aa0a-46f5-a701-cf2eb6040bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:31.225697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d6ffa-aa0a-46f5-a701-cf2eb6040bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:31.244340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-5c4d6ffa-aa0a-46f5-a701-cf2eb6040bf9 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:31.245582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-5c4d6ffa-aa0a-46f5-a701-cf2eb6040bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:31.305340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1070/2098] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:30:31.313732 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047379d-07d5-4123-8fb5-c6a9859a3108 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:31.314167 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047379d-07d5-4123-8fb5-c6a9859a3108 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:31.314454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047379d-07d5-4123-8fb5-c6a9859a3108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:31.332984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-3047379d-07d5-4123-8fb5-c6a9859a3108 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:31.334398 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3047379d-07d5-4123-8fb5-c6a9859a3108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:31.344516 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1029/2099] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:31.348682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d6ffa-aa0a-46f5-a701-cf2eb6040bf9 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:31.358796 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d6ffa-aa0a-46f5-a701-cf2eb6040bf9 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:31.364012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86bc5d-5c8f-4a28-a0cd-ef1132d3f0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:31.364672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86bc5d-5c8f-4a28-a0cd-ef1132d3f0bb admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:31.364985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86bc5d-5c8f-4a28-a0cd-ef1132d3f0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:31.365283 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86bc5d-5c8f-4a28-a0cd-ef1132d3f0bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:31.365991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86bc5d-5c8f-4a28-a0cd-ef1132d3f0bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:30:31.366296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86bc5d-5c8f-4a28-a0cd-ef1132d3f0bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:31.367927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86bc5d-5c8f-4a28-a0cd-ef1132d3f0bb admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:31.380360 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1071/2100] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:30:31.384397 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047379d-07d5-4123-8fb5-c6a9859a3108 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:31.393723 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047379d-07d5-4123-8fb5-c6a9859a3108 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:31.398405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310a468-536f-4456-8180-b1654c65bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:31.399075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310a468-536f-4456-8180-b1654c65bd5a admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:31.399343 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310a468-536f-4456-8180-b1654c65bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:31.399618 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310a468-536f-4456-8180-b1654c65bd5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:31.400467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310a468-536f-4456-8180-b1654c65bd5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:31.402461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310a468-536f-4456-8180-b1654c65bd5a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:31.507765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1030/2101] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:31 2022] POST /identity/v3/projects => generated 399 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:30:31.513378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86bc5d-5c8f-4a28-a0cd-ef1132d3f0bb admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:31.519735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86bc5d-5c8f-4a28-a0cd-ef1132d3f0bb admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:31.579643 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f5cf8-2306-4bf5-a3ad-db45aee3be90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:31.580321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5cf8-2306-4bf5-a3ad-db45aee3be90 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:31.580611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5cf8-2306-4bf5-a3ad-db45aee3be90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:31.580891 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5cf8-2306-4bf5-a3ad-db45aee3be90 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:31.581624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f5cf8-2306-4bf5-a3ad-db45aee3be90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:31.583627 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f5cf8-2306-4bf5-a3ad-db45aee3be90 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:31.590257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:31.665635 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1072/2102] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:31 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:31.671677 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310a468-536f-4456-8180-b1654c65bd5a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:31.674745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:31.693365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310a468-536f-4456-8180-b1654c65bd5a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:31.698355 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13311bcd-7e51-4961-9750-5ee8a6bdf08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:31.699093 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13311bcd-7e51-4961-9750-5ee8a6bdf08a admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:31.699381 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13311bcd-7e51-4961-9750-5ee8a6bdf08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:31.699665 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13311bcd-7e51-4961-9750-5ee8a6bdf08a admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:31.700396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13311bcd-7e51-4961-9750-5ee8a6bdf08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:31.702026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13311bcd-7e51-4961-9750-5ee8a6bdf08a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:31.715231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1031/2103] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:31.719908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f5cf8-2306-4bf5-a3ad-db45aee3be90 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:31.730306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f5cf8-2306-4bf5-a3ad-db45aee3be90 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:31.735870 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201e253-fbcb-4de5-b6e8-721d36647253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:31.736592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201e253-fbcb-4de5-b6e8-721d36647253 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:31.740646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201e253-fbcb-4de5-b6e8-721d36647253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:31.740646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201e253-fbcb-4de5-b6e8-721d36647253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:31.740646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201e253-fbcb-4de5-b6e8-721d36647253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:31.740646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201e253-fbcb-4de5-b6e8-721d36647253 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:31.751067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1073/2104] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:30:31.754953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13311bcd-7e51-4961-9750-5ee8a6bdf08a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:31.765280 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13311bcd-7e51-4961-9750-5ee8a6bdf08a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:31.770059 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e01cce-df8a-4fbd-9cd4-cf61b55630a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:31.770933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e01cce-df8a-4fbd-9cd4-cf61b55630a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:31.771222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e01cce-df8a-4fbd-9cd4-cf61b55630a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:31.771501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e01cce-df8a-4fbd-9cd4-cf61b55630a5 admin admin] PATH_INFO: `/v3/projects/eef8766cb8744eba804ede01685c7325/users/e6fc1128f4c84836b854c841be8cf220/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:31.797046 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e01cce-df8a-4fbd-9cd4-cf61b55630a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef8766cb8744eba804ede01685c7325, user_id=e6fc1128f4c84836b854c841be8cf220, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:31.800669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e01cce-df8a-4fbd-9cd4-cf61b55630a5 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:31.933707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:31.940073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1032/2105] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:31 2022] PUT /identity/v3/projects/eef8766cb8744eba804ede01685c7325/users/e6fc1128f4c84836b854c841be8cf220/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:31.950361 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831fc02-4417-4fef-b830-f5b0a22fbec0 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:31.950660 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831fc02-4417-4fef-b830-f5b0a22fbec0 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:31.950943 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831fc02-4417-4fef-b830-f5b0a22fbec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:31.977812 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a831fc02-4417-4fef-b830-f5b0a22fbec0 None None] MFA Rules not processed for user `e6fc1128f4c84836b854c841be8cf220`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:31.979060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a831fc02-4417-4fef-b830-f5b0a22fbec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:32.057458 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1074/2106] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:32.062123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e01cce-df8a-4fbd-9cd4-cf61b55630a5 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:32.107995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:32.129009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e01cce-df8a-4fbd-9cd4-cf61b55630a5 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:32.133827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328526d7-575e-44af-87e9-da86ffd69852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:32.134430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328526d7-575e-44af-87e9-da86ffd69852 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:32.134748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328526d7-575e-44af-87e9-da86ffd69852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:32.135029 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328526d7-575e-44af-87e9-da86ffd69852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:32.135733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328526d7-575e-44af-87e9-da86ffd69852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:32.137672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328526d7-575e-44af-87e9-da86ffd69852 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:32.209051 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:32.218053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1033/2107] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:32 2022] POST /identity/v3/projects => generated 399 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:32.222064 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831fc02-4417-4fef-b830-f5b0a22fbec0 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:32.233681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831fc02-4417-4fef-b830-f5b0a22fbec0 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:32.306587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3e4f3-7b5b-4f71-a79c-4d8eab14bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:32.307306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3e4f3-7b5b-4f71-a79c-4d8eab14bd32 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:32.307614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3e4f3-7b5b-4f71-a79c-4d8eab14bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:32.308000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3e4f3-7b5b-4f71-a79c-4d8eab14bd32 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:32.308978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3e4f3-7b5b-4f71-a79c-4d8eab14bd32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:32.311025 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3e4f3-7b5b-4f71-a79c-4d8eab14bd32 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:32.459377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1075/2108] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:32 2022] POST /identity/v3/users => generated 306 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:32.463016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328526d7-575e-44af-87e9-da86ffd69852 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:32.473816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328526d7-575e-44af-87e9-da86ffd69852 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:32.478281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42520961-a884-4fc3-a03d-3238d61d2339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:32.478956 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42520961-a884-4fc3-a03d-3238d61d2339 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:32.479218 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42520961-a884-4fc3-a03d-3238d61d2339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:32.479490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42520961-a884-4fc3-a03d-3238d61d2339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:32.480207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42520961-a884-4fc3-a03d-3238d61d2339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:32.481840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42520961-a884-4fc3-a03d-3238d61d2339 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:32.492909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1034/2109] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:32.496945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3e4f3-7b5b-4f71-a79c-4d8eab14bd32 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:32.507252 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3e4f3-7b5b-4f71-a79c-4d8eab14bd32 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:32.512711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5af4bf-3676-49d2-a924-8850fee9aca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:32.513667 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5af4bf-3676-49d2-a924-8850fee9aca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:32.518040 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5af4bf-3676-49d2-a924-8850fee9aca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:32.518040 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5af4bf-3676-49d2-a924-8850fee9aca9 admin admin] PATH_INFO: `/v3/projects/a9e8c104cdca4142aab31cb5969f9b29/users/933762eb47c94cabbc8fe9f83c98d6fc/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:32.530973 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5af4bf-3676-49d2-a924-8850fee9aca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e8c104cdca4142aab31cb5969f9b29, user_id=933762eb47c94cabbc8fe9f83c98d6fc, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:32.534196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5af4bf-3676-49d2-a924-8850fee9aca9 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:32.629606 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1076/2110] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:32 2022] PUT /identity/v3/projects/a9e8c104cdca4142aab31cb5969f9b29/users/933762eb47c94cabbc8fe9f83c98d6fc/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:30:32.633433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42520961-a884-4fc3-a03d-3238d61d2339 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:32.643869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42520961-a884-4fc3-a03d-3238d61d2339 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:32.708711 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c039d5d-c9aa-4edf-b4dd-0625d5daf655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:32.709472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c039d5d-c9aa-4edf-b4dd-0625d5daf655 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:32.709705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c039d5d-c9aa-4edf-b4dd-0625d5daf655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:32.709983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c039d5d-c9aa-4edf-b4dd-0625d5daf655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:32.710709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c039d5d-c9aa-4edf-b4dd-0625d5daf655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:32.712311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c039d5d-c9aa-4edf-b4dd-0625d5daf655 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:32.724620 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1035/2111] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:30:32.728112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5af4bf-3676-49d2-a924-8850fee9aca9 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:32.739809 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5af4bf-3676-49d2-a924-8850fee9aca9 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:32.754330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa9c85-e1ec-4dd9-b17a-8a93b6f5a6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:32.754330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa9c85-e1ec-4dd9-b17a-8a93b6f5a6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:32.754330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa9c85-e1ec-4dd9-b17a-8a93b6f5a6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:32.754330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa9c85-e1ec-4dd9-b17a-8a93b6f5a6f6 admin admin] PATH_INFO: `/v3/projects/a9e8c104cdca4142aab31cb5969f9b29/users/933762eb47c94cabbc8fe9f83c98d6fc/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:32.754704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa9c85-e1ec-4dd9-b17a-8a93b6f5a6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e8c104cdca4142aab31cb5969f9b29, user_id=933762eb47c94cabbc8fe9f83c98d6fc, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:32.756661 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa9c85-e1ec-4dd9-b17a-8a93b6f5a6f6 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:32.769355 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1077/2112] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:32 2022] PUT /identity/v3/projects/a9e8c104cdca4142aab31cb5969f9b29/users/933762eb47c94cabbc8fe9f83c98d6fc/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:32.782174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4990d3-4bed-4cc9-9038-3d0cbcfc582c None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:32.782174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4990d3-4bed-4cc9-9038-3d0cbcfc582c None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:32.782174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4990d3-4bed-4cc9-9038-3d0cbcfc582c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:32.810329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-0a4990d3-4bed-4cc9-9038-3d0cbcfc582c None None] MFA Rules not processed for user `933762eb47c94cabbc8fe9f83c98d6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:32.811610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0a4990d3-4bed-4cc9-9038-3d0cbcfc582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:32.847916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:32.881309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1036/2113] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:32 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:32.923519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa9c85-e1ec-4dd9-b17a-8a93b6f5a6f6 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:32.926826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0dfa9c85-e1ec-4dd9-b17a-8a93b6f5a6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:32.984663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa9c85-e1ec-4dd9-b17a-8a93b6f5a6f6 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:32.988480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48955a80-04bc-41fe-bf85-0bb412cec424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:32.989256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48955a80-04bc-41fe-bf85-0bb412cec424 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:32.989455 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48955a80-04bc-41fe-bf85-0bb412cec424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:32.989739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48955a80-04bc-41fe-bf85-0bb412cec424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:32.999091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48955a80-04bc-41fe-bf85-0bb412cec424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:33.000527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48955a80-04bc-41fe-bf85-0bb412cec424 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:33.010581 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1078/2114] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:33.285806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4990d3-4bed-4cc9-9038-3d0cbcfc582c None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:33.287272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0a4990d3-4bed-4cc9-9038-3d0cbcfc582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:33.299798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4990d3-4bed-4cc9-9038-3d0cbcfc582c None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:33.303478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1283a-86df-4dfa-af17-4fe79e0db78c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:33.304124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1283a-86df-4dfa-af17-4fe79e0db78c service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:33.307936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1283a-86df-4dfa-af17-4fe79e0db78c service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:33.307936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1283a-86df-4dfa-af17-4fe79e0db78c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:33.379364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1283a-86df-4dfa-af17-4fe79e0db78c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:33.381601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1283a-86df-4dfa-af17-4fe79e0db78c service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:33.393787 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1037/2115] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:33.578935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:34.168044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:34.424575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:34.636312 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48955a80-04bc-41fe-bf85-0bb412cec424 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:34.637780 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-48955a80-04bc-41fe-bf85-0bb412cec424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:34.712215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48955a80-04bc-41fe-bf85-0bb412cec424 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:34.717219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:34.717994 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:34.718281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:34.718558 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] PATH_INFO: `/v3/users/e791c5c80730422381db57191a45323b` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:34.719876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e791c5c80730422381db57191a45323b)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:34.721905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:34.889218 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e791c5c80730422381db57191a45323b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:34.983914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e791c5c80730422381db57191a45323b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:34.984365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:34.984671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e791c5c80730422381db57191a45323b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:34.997505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e791c5c80730422381db57191a45323b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:35.004704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e791c5c80730422381db57191a45323b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:35.010575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1079/2116] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:34 2022] DELETE /identity/v3/users/e791c5c80730422381db57191a45323b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:35.015253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141041-a828-4f42-9d20-f72ad5f3af64 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:35.015578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141041-a828-4f42-9d20-f72ad5f3af64 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:35.015856 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141041-a828-4f42-9d20-f72ad5f3af64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:35.035389 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-31141041-a828-4f42-9d20-f72ad5f3af64 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:35.036608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-31141041-a828-4f42-9d20-f72ad5f3af64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:35.068063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:35.095672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1038/2117] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:35.109976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:35.112141 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:35.175042 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a7f8e-812f-435e-9fae-b69e7d2efe87 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:35.178811 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1d3b-d781-4040-9ec8-0694ad8035cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:35.179483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1d3b-d781-4040-9ec8-0694ad8035cc service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:35.187356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1d3b-d781-4040-9ec8-0694ad8035cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:35.187356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1d3b-d781-4040-9ec8-0694ad8035cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:35.190494 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a1d3b-d781-4040-9ec8-0694ad8035cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:35.191938 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a1d3b-d781-4040-9ec8-0694ad8035cc service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:35.202114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1080/2118] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:35.832422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31141041-a828-4f42-9d20-f72ad5f3af64 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:35.834552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-31141041-a828-4f42-9d20-f72ad5f3af64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:35.856475 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31141041-a828-4f42-9d20-f72ad5f3af64 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:35.865943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce518c-2556-4525-8c52-0a3a29d1f0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:35.866604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce518c-2556-4525-8c52-0a3a29d1f0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:35.867069 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce518c-2556-4525-8c52-0a3a29d1f0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:35.867478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce518c-2556-4525-8c52-0a3a29d1f0d1 admin admin] PATH_INFO: `/v3/projects/5c56846e91b54939b14e8c831cd75b30` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:35.870087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce518c-2556-4525-8c52-0a3a29d1f0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c56846e91b54939b14e8c831cd75b30)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:35.872211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce518c-2556-4525-8c52-0a3a29d1f0d1 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:36.007977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dbce518c-2556-4525-8c52-0a3a29d1f0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c56846e91b54939b14e8c831cd75b30', 'request_id': 'req-dbce518c-2556-4525-8c52-0a3a29d1f0d1'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:36.073162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dbce518c-2556-4525-8c52-0a3a29d1f0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c56846e91b54939b14e8c831cd75b30', 'request_id': 'req-dbce518c-2556-4525-8c52-0a3a29d1f0d1'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:36.082566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dbce518c-2556-4525-8c52-0a3a29d1f0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c56846e91b54939b14e8c831cd75b30', 'request_id': 'req-dbce518c-2556-4525-8c52-0a3a29d1f0d1'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:36.096211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dbce518c-2556-4525-8c52-0a3a29d1f0d1 admin admin] The token cache is being invalidate because project 5c56846e91b54939b14e8c831cd75b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:36.096502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dbce518c-2556-4525-8c52-0a3a29d1f0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:36.097222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dbce518c-2556-4525-8c52-0a3a29d1f0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:36.098801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1039/2119] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:35 2022] DELETE /identity/v3/projects/5c56846e91b54939b14e8c831cd75b30 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:36.103950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ebfdf-9ffc-4230-a084-60e58de7e9c7 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:36.104246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ebfdf-9ffc-4230-a084-60e58de7e9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:36.104529 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ebfdf-9ffc-4230-a084-60e58de7e9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:36.107705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:36.124381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-6e5ebfdf-9ffc-4230-a084-60e58de7e9c7 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:36.125774 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-6e5ebfdf-9ffc-4230-a084-60e58de7e9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:36.186201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1081/2120] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:36.195019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15652252-8e7f-46c5-8f99-5af206a62264 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:36.195312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15652252-8e7f-46c5-8f99-5af206a62264 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:36.195594 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15652252-8e7f-46c5-8f99-5af206a62264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:36.215278 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-15652252-8e7f-46c5-8f99-5af206a62264 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:36.216413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-15652252-8e7f-46c5-8f99-5af206a62264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:36.224870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1040/2121] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:36.229587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ebfdf-9ffc-4230-a084-60e58de7e9c7 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:36.240194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ebfdf-9ffc-4230-a084-60e58de7e9c7 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:36.244766 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c723-cd4c-4351-a5b5-390842b521ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:36.245452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c723-cd4c-4351-a5b5-390842b521ac admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:36.245739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c723-cd4c-4351-a5b5-390842b521ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:36.246017 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c723-cd4c-4351-a5b5-390842b521ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:36.246746 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70c723-cd4c-4351-a5b5-390842b521ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:30:36.247060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70c723-cd4c-4351-a5b5-390842b521ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:36.248825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70c723-cd4c-4351-a5b5-390842b521ac admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:36.260894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1082/2122] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:30:36.265173 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15652252-8e7f-46c5-8f99-5af206a62264 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:36.275469 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15652252-8e7f-46c5-8f99-5af206a62264 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:36.280530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b8c08-71d5-46ff-b032-b64f2836f822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:36.281332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b8c08-71d5-46ff-b032-b64f2836f822 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:36.281621 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b8c08-71d5-46ff-b032-b64f2836f822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:36.281899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b8c08-71d5-46ff-b032-b64f2836f822 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:36.282634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b8c08-71d5-46ff-b032-b64f2836f822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:36.284550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b8c08-71d5-46ff-b032-b64f2836f822 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:36.297073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:36.397571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1041/2123] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:36 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:30:36.401391 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c723-cd4c-4351-a5b5-390842b521ac admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:36.412626 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c723-cd4c-4351-a5b5-390842b521ac admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:36.474824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f11613-a26a-4658-89f7-114b9eafb695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:36.475421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f11613-a26a-4658-89f7-114b9eafb695 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:36.475705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f11613-a26a-4658-89f7-114b9eafb695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:36.475980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f11613-a26a-4658-89f7-114b9eafb695 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:36.476683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f11613-a26a-4658-89f7-114b9eafb695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:36.478634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f11613-a26a-4658-89f7-114b9eafb695 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:36.596219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1083/2124] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:36 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:36.600318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b8c08-71d5-46ff-b032-b64f2836f822 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:36.611273 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b8c08-71d5-46ff-b032-b64f2836f822 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:36.615844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c54c7-da44-4a1d-b108-d416504693d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:36.616497 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c54c7-da44-4a1d-b108-d416504693d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:36.616841 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c54c7-da44-4a1d-b108-d416504693d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:36.617064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c54c7-da44-4a1d-b108-d416504693d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:36.617824 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c54c7-da44-4a1d-b108-d416504693d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:36.619415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c54c7-da44-4a1d-b108-d416504693d4 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:36.631068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1042/2125] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:36.635142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f11613-a26a-4658-89f7-114b9eafb695 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:36.645674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f11613-a26a-4658-89f7-114b9eafb695 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:36.650849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a92e16-ef40-496b-b5c5-cc841df5ca09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:36.651673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a92e16-ef40-496b-b5c5-cc841df5ca09 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:36.651970 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a92e16-ef40-496b-b5c5-cc841df5ca09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:36.652355 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a92e16-ef40-496b-b5c5-cc841df5ca09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:36.653232 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a92e16-ef40-496b-b5c5-cc841df5ca09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:36.655906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a92e16-ef40-496b-b5c5-cc841df5ca09 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:36.666913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1084/2126] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:36.671392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c54c7-da44-4a1d-b108-d416504693d4 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:36.682146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c54c7-da44-4a1d-b108-d416504693d4 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:36.686733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6347855-6341-45d2-a87f-e55ecf9532eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:36.687631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6347855-6341-45d2-a87f-e55ecf9532eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:36.687916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6347855-6341-45d2-a87f-e55ecf9532eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:36.688196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6347855-6341-45d2-a87f-e55ecf9532eb admin admin] PATH_INFO: `/v3/projects/6b958858cb6e4cbeab53f96ea30fe18a/users/724a8baed416444aa0de4df59375a9fd/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:36.702313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6347855-6341-45d2-a87f-e55ecf9532eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b958858cb6e4cbeab53f96ea30fe18a, user_id=724a8baed416444aa0de4df59375a9fd, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:36.704995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6347855-6341-45d2-a87f-e55ecf9532eb admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:36.807326 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1043/2127] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:36 2022] PUT /identity/v3/projects/6b958858cb6e4cbeab53f96ea30fe18a/users/724a8baed416444aa0de4df59375a9fd/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:36.817742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c073d-0e83-4af9-ae5a-5a00ec01c706 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:36.818037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c073d-0e83-4af9-ae5a-5a00ec01c706 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:36.818319 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c073d-0e83-4af9-ae5a-5a00ec01c706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:36.848528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-4b3c073d-0e83-4af9-ae5a-5a00ec01c706 None None] MFA Rules not processed for user `724a8baed416444aa0de4df59375a9fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:36.849773 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4b3c073d-0e83-4af9-ae5a-5a00ec01c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:36.913751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:36.929504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1085/2128] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:36.934212 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6347855-6341-45d2-a87f-e55ecf9532eb admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:36.971431 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:37.021472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6347855-6341-45d2-a87f-e55ecf9532eb admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:37.033345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f936d1-4690-440f-adfb-ad9e93f556d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:37.034027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f936d1-4690-440f-adfb-ad9e93f556d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:37.039004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f936d1-4690-440f-adfb-ad9e93f556d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:37.039004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f936d1-4690-440f-adfb-ad9e93f556d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:37.039004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f936d1-4690-440f-adfb-ad9e93f556d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:37.039004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f936d1-4690-440f-adfb-ad9e93f556d3 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:37.163057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1044/2129] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:36 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:37.171277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c073d-0e83-4af9-ae5a-5a00ec01c706 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:37.182420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c073d-0e83-4af9-ae5a-5a00ec01c706 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:37.240409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161384d-fc4c-42f6-946a-141e299660aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:37.241031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161384d-fc4c-42f6-946a-141e299660aa admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:37.241310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161384d-fc4c-42f6-946a-141e299660aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:37.241591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161384d-fc4c-42f6-946a-141e299660aa admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:37.242282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161384d-fc4c-42f6-946a-141e299660aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:37.244220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161384d-fc4c-42f6-946a-141e299660aa admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:37.279518 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:37.468179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1086/2130] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:37 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:37.472985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f936d1-4690-440f-adfb-ad9e93f556d3 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:37.490138 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f936d1-4690-440f-adfb-ad9e93f556d3 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:37.505626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a1031-2a81-48c7-ac6a-dc29e10ceeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:37.506435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a1031-2a81-48c7-ac6a-dc29e10ceeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:37.506721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a1031-2a81-48c7-ac6a-dc29e10ceeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:37.506994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a1031-2a81-48c7-ac6a-dc29e10ceeb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:37.507916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a1031-2a81-48c7-ac6a-dc29e10ceeb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:37.509617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a1031-2a81-48c7-ac6a-dc29e10ceeb9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:37.521311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1045/2131] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:37.525489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161384d-fc4c-42f6-946a-141e299660aa admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:37.535778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161384d-fc4c-42f6-946a-141e299660aa admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:37.540490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c564a-21c5-4e37-9588-2f54d47028ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:37.541260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c564a-21c5-4e37-9588-2f54d47028ce admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:37.541545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c564a-21c5-4e37-9588-2f54d47028ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:37.541816 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c564a-21c5-4e37-9588-2f54d47028ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:37.542545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c564a-21c5-4e37-9588-2f54d47028ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:37.544434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c564a-21c5-4e37-9588-2f54d47028ce admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:37.555283 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1087/2132] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:30:37.559626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a1031-2a81-48c7-ac6a-dc29e10ceeb9 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:37.566527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:37.570479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a1031-2a81-48c7-ac6a-dc29e10ceeb9 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:37.575020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a42ae1-db31-47e1-93c0-ee7301f5e3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:37.575977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a42ae1-db31-47e1-93c0-ee7301f5e3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:37.576258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a42ae1-db31-47e1-93c0-ee7301f5e3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:37.576534 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a42ae1-db31-47e1-93c0-ee7301f5e3bf admin admin] PATH_INFO: `/v3/projects/a8e112ba29bb42c58c6104e339ee5a23/users/3e51ceeda6d6462589f0e2bfdbd640a8/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:37.595497 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a42ae1-db31-47e1-93c0-ee7301f5e3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e112ba29bb42c58c6104e339ee5a23, user_id=3e51ceeda6d6462589f0e2bfdbd640a8, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:37.598793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a42ae1-db31-47e1-93c0-ee7301f5e3bf admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:37.667820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1046/2133] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:37 2022] PUT /identity/v3/projects/a8e112ba29bb42c58c6104e339ee5a23/users/3e51ceeda6d6462589f0e2bfdbd640a8/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:37.736011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697661-5535-442c-8f0e-33020cdafbcd None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:37.736309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697661-5535-442c-8f0e-33020cdafbcd None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:37.736639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697661-5535-442c-8f0e-33020cdafbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:37.761860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:37.764511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-20697661-5535-442c-8f0e-33020cdafbcd None None] MFA Rules not processed for user `3e51ceeda6d6462589f0e2bfdbd640a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:37.765815 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-20697661-5535-442c-8f0e-33020cdafbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:37.829911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1088/2134] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:37.834750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a42ae1-db31-47e1-93c0-ee7301f5e3bf admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:37.898961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a42ae1-db31-47e1-93c0-ee7301f5e3bf admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:37.903817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a496538-b170-4ee7-a468-fe5583b839c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:37.904482 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a496538-b170-4ee7-a468-fe5583b839c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:37.904768 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a496538-b170-4ee7-a468-fe5583b839c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:37.905075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a496538-b170-4ee7-a468-fe5583b839c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:37.905809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a496538-b170-4ee7-a468-fe5583b839c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:37.907731 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a496538-b170-4ee7-a468-fe5583b839c7 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:38.092988 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1047/2135] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:37 2022] POST /identity/v3/projects => generated 385 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:38.097839 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20697661-5535-442c-8f0e-33020cdafbcd None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:38.109540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20697661-5535-442c-8f0e-33020cdafbcd None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:38.166896 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968f5ea-62c2-4ef5-bdb0-e374af0741ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:38.167592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968f5ea-62c2-4ef5-bdb0-e374af0741ff admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:38.167859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968f5ea-62c2-4ef5-bdb0-e374af0741ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:38.168133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968f5ea-62c2-4ef5-bdb0-e374af0741ff admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:38.169139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968f5ea-62c2-4ef5-bdb0-e374af0741ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:38.171059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968f5ea-62c2-4ef5-bdb0-e374af0741ff admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:38.328122 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1089/2136] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:38 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:38.329390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a496538-b170-4ee7-a468-fe5583b839c7 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:38.340198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a496538-b170-4ee7-a468-fe5583b839c7 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:38.344928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9773347-8575-4536-986e-f654eac1876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:38.345625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9773347-8575-4536-986e-f654eac1876f admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:38.347030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9773347-8575-4536-986e-f654eac1876f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:38.347030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9773347-8575-4536-986e-f654eac1876f admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:38.347480 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9773347-8575-4536-986e-f654eac1876f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:38.349081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9773347-8575-4536-986e-f654eac1876f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:38.361039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1048/2137] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:38.364918 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968f5ea-62c2-4ef5-bdb0-e374af0741ff admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:38.375480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968f5ea-62c2-4ef5-bdb0-e374af0741ff admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:38.380988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd4078-ba49-40a0-b780-a4aa3fe4121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:38.381912 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd4078-ba49-40a0-b780-a4aa3fe4121b admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:38.382326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd4078-ba49-40a0-b780-a4aa3fe4121b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:38.382470 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd4078-ba49-40a0-b780-a4aa3fe4121b admin admin] PATH_INFO: `/v3/projects/ee2f2a8005824e66ab004fa045aee357/users/509a3fac4b854d7dab81289e14683d37/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:38.399665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd4078-ba49-40a0-b780-a4aa3fe4121b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee2f2a8005824e66ab004fa045aee357, user_id=509a3fac4b854d7dab81289e14683d37, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:38.402406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd4078-ba49-40a0-b780-a4aa3fe4121b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:38.510576 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1090/2138] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:38 2022] PUT /identity/v3/projects/ee2f2a8005824e66ab004fa045aee357/users/509a3fac4b854d7dab81289e14683d37/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:38.514505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9773347-8575-4536-986e-f654eac1876f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:38.525140 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9773347-8575-4536-986e-f654eac1876f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:38.603957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c2655-6237-4727-8176-ec58d055a6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:38.604817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2655-6237-4727-8176-ec58d055a6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:38.605281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2655-6237-4727-8176-ec58d055a6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:38.605610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2655-6237-4727-8176-ec58d055a6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:38.606473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2655-6237-4727-8176-ec58d055a6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:38.608388 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2655-6237-4727-8176-ec58d055a6c6 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:38.632643 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1049/2139] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:38.635616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:38.637586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd4078-ba49-40a0-b780-a4aa3fe4121b admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:38.650415 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd4078-ba49-40a0-b780-a4aa3fe4121b admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:38.654496 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02440009-4d70-4d70-95a8-57bbdd785b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:38.655386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02440009-4d70-4d70-95a8-57bbdd785b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:38.661424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02440009-4d70-4d70-95a8-57bbdd785b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:38.661424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02440009-4d70-4d70-95a8-57bbdd785b1a admin admin] PATH_INFO: `/v3/projects/ee2f2a8005824e66ab004fa045aee357/users/509a3fac4b854d7dab81289e14683d37/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:38.661424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02440009-4d70-4d70-95a8-57bbdd785b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee2f2a8005824e66ab004fa045aee357, user_id=509a3fac4b854d7dab81289e14683d37, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:38.661424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02440009-4d70-4d70-95a8-57bbdd785b1a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:38.677793 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1091/2140] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:38 2022] PUT /identity/v3/projects/ee2f2a8005824e66ab004fa045aee357/users/509a3fac4b854d7dab81289e14683d37/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:38.688220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdf3e9-5356-4d68-8735-b9f049fa234a None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:38.688490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdf3e9-5356-4d68-8735-b9f049fa234a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:38.688769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdf3e9-5356-4d68-8735-b9f049fa234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:38.717006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-8dbdf3e9-5356-4d68-8735-b9f049fa234a None None] MFA Rules not processed for user `509a3fac4b854d7dab81289e14683d37`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:38.718270 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8dbdf3e9-5356-4d68-8735-b9f049fa234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:38.761228 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:38.787985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:38.797207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1050/2141] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:38.847170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02440009-4d70-4d70-95a8-57bbdd785b1a admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:38.849588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-02440009-4d70-4d70-95a8-57bbdd785b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:38.850957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdf3e9-5356-4d68-8735-b9f049fa234a None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:38.852419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8dbdf3e9-5356-4d68-8735-b9f049fa234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:38.916488 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02440009-4d70-4d70-95a8-57bbdd785b1a admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:38.918325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdf3e9-5356-4d68-8735-b9f049fa234a None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:38.921404 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:38.922267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:38.922447 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2092716-9868-46c7-9e36-f75b19d629ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:38.922597 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:38.923056 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] PATH_INFO: `/v3/users/e6fc1128f4c84836b854c841be8cf220` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:38.923168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092716-9868-46c7-9e36-f75b19d629ed service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:38.923369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092716-9868-46c7-9e36-f75b19d629ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:38.923651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092716-9868-46c7-9e36-f75b19d629ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:38.924797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6fc1128f4c84836b854c841be8cf220)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:38.926757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:38.980527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2092716-9868-46c7-9e36-f75b19d629ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:38.982044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2092716-9868-46c7-9e36-f75b19d629ed service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:38.992211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1051/2142] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:30:39.118928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6fc1128f4c84836b854c841be8cf220'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:39.142114 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:39.222351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6fc1128f4c84836b854c841be8cf220'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:39.222989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6fc1128f4c84836b854c841be8cf220'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:39.235456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6fc1128f4c84836b854c841be8cf220'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:39.243878 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6fc1128f4c84836b854c841be8cf220'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:39.249981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1092/2143] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:38 2022] DELETE /identity/v3/users/e6fc1128f4c84836b854c841be8cf220 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:39.254940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cc6be-4736-4385-b84a-e3844f7e1885 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:39.255410 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cc6be-4736-4385-b84a-e3844f7e1885 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:39.261315 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cc6be-4736-4385-b84a-e3844f7e1885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:39.273064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-269cc6be-4736-4385-b84a-e3844f7e1885 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:39.274489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-269cc6be-4736-4385-b84a-e3844f7e1885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:39.354818 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1052/2144] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:39.364486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:39.365974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:39.450297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187b3f9-e0fd-4758-b9d6-c37213c50485 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:39.458686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3bf55-c4f3-4071-a39c-e8c1463ef7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:39.460404 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3bf55-c4f3-4071-a39c-e8c1463ef7bb service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:39.463106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3bf55-c4f3-4071-a39c-e8c1463ef7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:39.463106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3bf55-c4f3-4071-a39c-e8c1463ef7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:39.476603 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3bf55-c4f3-4071-a39c-e8c1463ef7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:39.478699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3bf55-c4f3-4071-a39c-e8c1463ef7bb service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:39.499638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1093/2145] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:39.510279 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:39.765453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:39.942426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:39.999403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cc6be-4736-4385-b84a-e3844f7e1885 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:40.000937 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-269cc6be-4736-4385-b84a-e3844f7e1885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:40.014759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cc6be-4736-4385-b84a-e3844f7e1885 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:40.029238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:40.030532 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:40.032712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:40.032712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] PATH_INFO: `/v3/projects/eef8766cb8744eba804ede01685c7325` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:40.034152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef8766cb8744eba804ede01685c7325)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:40.036357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:40.180527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:40.197494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef8766cb8744eba804ede01685c7325', 'request_id': 'req-3f21b85a-292f-449e-8019-04dae2616b9a'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:40.307317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef8766cb8744eba804ede01685c7325', 'request_id': 'req-3f21b85a-292f-449e-8019-04dae2616b9a'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:40.315043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef8766cb8744eba804ede01685c7325', 'request_id': 'req-3f21b85a-292f-449e-8019-04dae2616b9a'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:40.326511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] The token cache is being invalidate because project eef8766cb8744eba804ede01685c7325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:40.326800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:40.327635 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:40.329507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1053/2146] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:39 2022] DELETE /identity/v3/projects/eef8766cb8744eba804ede01685c7325 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:40.333513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3bf55-c4f3-4071-a39c-e8c1463ef7bb service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:40.348330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3bf55-c4f3-4071-a39c-e8c1463ef7bb service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:40.414205 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:40.415116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:40.415402 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:40.415679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] PATH_INFO: `/v3/users/933762eb47c94cabbc8fe9f83c98d6fc` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:40.416904 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] RBAC: Authorizing `identity:delete_user(user_id=933762eb47c94cabbc8fe9f83c98d6fc)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:40.419177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:40.566595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933762eb47c94cabbc8fe9f83c98d6fc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:40.648475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933762eb47c94cabbc8fe9f83c98d6fc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:40.649289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933762eb47c94cabbc8fe9f83c98d6fc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:40.676319 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933762eb47c94cabbc8fe9f83c98d6fc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:40.689937 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933762eb47c94cabbc8fe9f83c98d6fc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:40.697151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1094/2147] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:40 2022] DELETE /identity/v3/users/933762eb47c94cabbc8fe9f83c98d6fc => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:41.164666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:41.168986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:41.187080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21b85a-292f-449e-8019-04dae2616b9a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:41.224320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:41.226734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:41.316154 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8f007-29be-4bf5-9a48-3c2558c27a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:41.316154 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8f007-29be-4bf5-9a48-3c2558c27a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:41.316154 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8f007-29be-4bf5-9a48-3c2558c27a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:41.316154 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8f007-29be-4bf5-9a48-3c2558c27a76 admin admin] PATH_INFO: `/v3/projects/a9e8c104cdca4142aab31cb5969f9b29` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:41.317017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8f007-29be-4bf5-9a48-3c2558c27a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e8c104cdca4142aab31cb5969f9b29)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:41.317017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8f007-29be-4bf5-9a48-3c2558c27a76 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:41.323484 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:41.351807 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a3c0e-8a08-4e61-9bc4-b3d76169157c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:41.356584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaa2c2-017d-40c2-be90-4c9da77df2e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:41.357647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaa2c2-017d-40c2-be90-4c9da77df2e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:41.358632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaa2c2-017d-40c2-be90-4c9da77df2e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:41.360436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaa2c2-017d-40c2-be90-4c9da77df2e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:41.366611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0acaa2c2-017d-40c2-be90-4c9da77df2e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:41.430331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaa2c2-017d-40c2-be90-4c9da77df2e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:41.432450 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaa2c2-017d-40c2-be90-4c9da77df2e6 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:41.442176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1095/2148] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:41.549201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d3b8f007-29be-4bf5-9a48-3c2558c27a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e8c104cdca4142aab31cb5969f9b29', 'request_id': 'req-d3b8f007-29be-4bf5-9a48-3c2558c27a76'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:41.676843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d3b8f007-29be-4bf5-9a48-3c2558c27a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e8c104cdca4142aab31cb5969f9b29', 'request_id': 'req-d3b8f007-29be-4bf5-9a48-3c2558c27a76'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:41.694659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d3b8f007-29be-4bf5-9a48-3c2558c27a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e8c104cdca4142aab31cb5969f9b29', 'request_id': 'req-d3b8f007-29be-4bf5-9a48-3c2558c27a76'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:41.712565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d3b8f007-29be-4bf5-9a48-3c2558c27a76 admin admin] The token cache is being invalidate because project a9e8c104cdca4142aab31cb5969f9b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:41.712970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d3b8f007-29be-4bf5-9a48-3c2558c27a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:41.713709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d3b8f007-29be-4bf5-9a48-3c2558c27a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:41.715774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1054/2149] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:41 2022] DELETE /identity/v3/projects/a9e8c104cdca4142aab31cb5969f9b29 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:41.720715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8d94c-3a68-4e73-a569-5bee2e12f9ca None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:41.721006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8d94c-3a68-4e73-a569-5bee2e12f9ca None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:41.721401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8d94c-3a68-4e73-a569-5bee2e12f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:41.753010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-48b8d94c-3a68-4e73-a569-5bee2e12f9ca None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:41.754295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-48b8d94c-3a68-4e73-a569-5bee2e12f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:41.874758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1096/2150] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:30:41.880404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df2a6c-32d6-4721-9fc7-4c11c0f5aeac None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:41.880760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df2a6c-32d6-4721-9fc7-4c11c0f5aeac None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:41.884419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df2a6c-32d6-4721-9fc7-4c11c0f5aeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:41.917474 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-61df2a6c-32d6-4721-9fc7-4c11c0f5aeac None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:41.919888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-61df2a6c-32d6-4721-9fc7-4c11c0f5aeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:41.930578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1055/2151] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:41.934590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8d94c-3a68-4e73-a569-5bee2e12f9ca None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:41.945792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8d94c-3a68-4e73-a569-5bee2e12f9ca None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:41.952045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a1a95-ac48-4733-973f-10bbe65b322b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:41.952730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a1a95-ac48-4733-973f-10bbe65b322b admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:41.953018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a1a95-ac48-4733-973f-10bbe65b322b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:41.953361 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a1a95-ac48-4733-973f-10bbe65b322b admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:41.954104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a1a95-ac48-4733-973f-10bbe65b322b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:30:41.954411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a1a95-ac48-4733-973f-10bbe65b322b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:41.956708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a1a95-ac48-4733-973f-10bbe65b322b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:41.974339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1097/2152] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:30:41.977990 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df2a6c-32d6-4721-9fc7-4c11c0f5aeac None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:41.991315 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df2a6c-32d6-4721-9fc7-4c11c0f5aeac None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:42.013483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815c80a-1dc6-4ce8-8749-5c7fa07a5554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:42.014424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815c80a-1dc6-4ce8-8749-5c7fa07a5554 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:42.014818 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815c80a-1dc6-4ce8-8749-5c7fa07a5554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:42.015199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815c80a-1dc6-4ce8-8749-5c7fa07a5554 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:42.016090 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815c80a-1dc6-4ce8-8749-5c7fa07a5554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:42.019713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815c80a-1dc6-4ce8-8749-5c7fa07a5554 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:42.156325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1056/2153] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:41 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:42.160898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a1a95-ac48-4733-973f-10bbe65b322b admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:42.174521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a1a95-ac48-4733-973f-10bbe65b322b admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:42.245520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04bde-b96f-4fa6-bca7-fa06e7f4ca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:42.246336 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04bde-b96f-4fa6-bca7-fa06e7f4ca89 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:42.246661 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04bde-b96f-4fa6-bca7-fa06e7f4ca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:42.247137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04bde-b96f-4fa6-bca7-fa06e7f4ca89 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:42.247916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f04bde-b96f-4fa6-bca7-fa06e7f4ca89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:42.251094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f04bde-b96f-4fa6-bca7-fa06e7f4ca89 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:42.341273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1098/2154] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:42 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:30:42.346644 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815c80a-1dc6-4ce8-8749-5c7fa07a5554 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:42.363956 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815c80a-1dc6-4ce8-8749-5c7fa07a5554 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:42.370926 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52679dfb-1e72-40e8-b540-dca39b7e38a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:42.371669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52679dfb-1e72-40e8-b540-dca39b7e38a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:42.371998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52679dfb-1e72-40e8-b540-dca39b7e38a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:42.372241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52679dfb-1e72-40e8-b540-dca39b7e38a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:42.373009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52679dfb-1e72-40e8-b540-dca39b7e38a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:42.377408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52679dfb-1e72-40e8-b540-dca39b7e38a6 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:42.418781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1057/2155] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:42.419211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04bde-b96f-4fa6-bca7-fa06e7f4ca89 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:42.435762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04bde-b96f-4fa6-bca7-fa06e7f4ca89 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:42.447742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11f607-f758-487f-a30b-e228d1089bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:42.448611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11f607-f758-487f-a30b-e228d1089bab admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:42.449050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11f607-f758-487f-a30b-e228d1089bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:42.450398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11f607-f758-487f-a30b-e228d1089bab admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:42.451537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11f607-f758-487f-a30b-e228d1089bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:42.458536 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11f607-f758-487f-a30b-e228d1089bab admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:42.477348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:42.488557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1099/2156] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:42.490110 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52679dfb-1e72-40e8-b540-dca39b7e38a6 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:42.499048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:42.505550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52679dfb-1e72-40e8-b540-dca39b7e38a6 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:42.513458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e387a2-2be9-4059-8a0f-2edb52ad7089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:42.514477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e387a2-2be9-4059-8a0f-2edb52ad7089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:42.516381 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e387a2-2be9-4059-8a0f-2edb52ad7089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:42.516871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e387a2-2be9-4059-8a0f-2edb52ad7089 admin admin] PATH_INFO: `/v3/projects/bbe6786bbe0647aaa4bddc49e2ea9495/users/8a203f7fd05f4838ab984f608765f79a/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:42.536245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e387a2-2be9-4059-8a0f-2edb52ad7089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe6786bbe0647aaa4bddc49e2ea9495, user_id=8a203f7fd05f4838ab984f608765f79a, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:42.539566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e387a2-2be9-4059-8a0f-2edb52ad7089 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:42.636354 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1058/2157] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:42 2022] PUT /identity/v3/projects/bbe6786bbe0647aaa4bddc49e2ea9495/users/8a203f7fd05f4838ab984f608765f79a/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:42.647198 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba128f-fd24-4fbb-bf4a-793307e67fda None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:42.647498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba128f-fd24-4fbb-bf4a-793307e67fda None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:42.647784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba128f-fd24-4fbb-bf4a-793307e67fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:42.682716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-f2ba128f-fd24-4fbb-bf4a-793307e67fda None None] MFA Rules not processed for user `8a203f7fd05f4838ab984f608765f79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:42.683958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f2ba128f-fd24-4fbb-bf4a-793307e67fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:42.765202 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1100/2158] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:42.769253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e387a2-2be9-4059-8a0f-2edb52ad7089 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:42.865256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e387a2-2be9-4059-8a0f-2edb52ad7089 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:42.870496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bf306-9d8d-4299-b0d6-891e5de33af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:42.872134 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bf306-9d8d-4299-b0d6-891e5de33af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:42.872419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bf306-9d8d-4299-b0d6-891e5de33af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:42.872696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bf306-9d8d-4299-b0d6-891e5de33af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:42.873494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bf306-9d8d-4299-b0d6-891e5de33af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:42.875446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bf306-9d8d-4299-b0d6-891e5de33af3 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:42.987773 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1059/2159] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:42 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:42.992521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba128f-fd24-4fbb-bf4a-793307e67fda None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:43.007505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba128f-fd24-4fbb-bf4a-793307e67fda None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:43.106417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4873295-4adc-48a8-9083-85c3ccee533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:43.107232 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4873295-4adc-48a8-9083-85c3ccee533e admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:43.107519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4873295-4adc-48a8-9083-85c3ccee533e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:43.107797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4873295-4adc-48a8-9083-85c3ccee533e admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:43.109346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4873295-4adc-48a8-9083-85c3ccee533e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:43.112621 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4873295-4adc-48a8-9083-85c3ccee533e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:43.215976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1101/2160] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:42 2022] POST /identity/v3/users => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:43.217962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bf306-9d8d-4299-b0d6-891e5de33af3 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:43.237304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bf306-9d8d-4299-b0d6-891e5de33af3 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:43.242821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e09459-c7a9-45c9-b44c-121c453650bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:43.243540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e09459-c7a9-45c9-b44c-121c453650bd admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:43.243827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e09459-c7a9-45c9-b44c-121c453650bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:43.244151 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e09459-c7a9-45c9-b44c-121c453650bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:43.245155 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e09459-c7a9-45c9-b44c-121c453650bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:43.247134 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e09459-c7a9-45c9-b44c-121c453650bd admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:43.258803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1060/2161] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:43.263276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4873295-4adc-48a8-9083-85c3ccee533e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:43.276547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4873295-4adc-48a8-9083-85c3ccee533e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:43.281292 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e80bd-9818-4087-a074-0fe51e59bcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:43.282309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e80bd-9818-4087-a074-0fe51e59bcc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:43.282598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e80bd-9818-4087-a074-0fe51e59bcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:43.282997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e80bd-9818-4087-a074-0fe51e59bcc8 admin admin] PATH_INFO: `/v3/projects/b3c2f1022fd84743ba7aab4c38c24a35/users/279e5ce41bba4d8a9c20fed40db5378e/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:43.301560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e80bd-9818-4087-a074-0fe51e59bcc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c2f1022fd84743ba7aab4c38c24a35, user_id=279e5ce41bba4d8a9c20fed40db5378e, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:43.311446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e80bd-9818-4087-a074-0fe51e59bcc8 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:43.400454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1102/2162] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:43 2022] PUT /identity/v3/projects/b3c2f1022fd84743ba7aab4c38c24a35/users/279e5ce41bba4d8a9c20fed40db5378e/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:43.404633 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e09459-c7a9-45c9-b44c-121c453650bd admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:43.415897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e09459-c7a9-45c9-b44c-121c453650bd admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:43.485416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248461f-832d-4d4f-875c-203a89d215cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:43.486097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248461f-832d-4d4f-875c-203a89d215cc admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:43.486417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248461f-832d-4d4f-875c-203a89d215cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:43.486675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248461f-832d-4d4f-875c-203a89d215cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:43.487758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248461f-832d-4d4f-875c-203a89d215cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:43.489568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248461f-832d-4d4f-875c-203a89d215cc admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:43.503140 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1061/2163] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:43.507469 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e80bd-9818-4087-a074-0fe51e59bcc8 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:43.520097 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e80bd-9818-4087-a074-0fe51e59bcc8 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:43.525799 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef3e81-7f8e-41cc-bc61-deaaf0ed9ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:43.526700 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef3e81-7f8e-41cc-bc61-deaaf0ed9ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:43.526988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef3e81-7f8e-41cc-bc61-deaaf0ed9ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:43.527268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef3e81-7f8e-41cc-bc61-deaaf0ed9ccc admin admin] PATH_INFO: `/v3/projects/b3c2f1022fd84743ba7aab4c38c24a35/users/279e5ce41bba4d8a9c20fed40db5378e/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:43.529316 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef3e81-7f8e-41cc-bc61-deaaf0ed9ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c2f1022fd84743ba7aab4c38c24a35, user_id=279e5ce41bba4d8a9c20fed40db5378e, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:43.531961 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef3e81-7f8e-41cc-bc61-deaaf0ed9ccc admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:43.592646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1103/2164] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:43 2022] PUT /identity/v3/projects/b3c2f1022fd84743ba7aab4c38c24a35/users/279e5ce41bba4d8a9c20fed40db5378e/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:43.600331 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17060-aebc-459b-bbed-a48a7be579cf None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:43.601997 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17060-aebc-459b-bbed-a48a7be579cf None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:43.602513 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17060-aebc-459b-bbed-a48a7be579cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:43.638518 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef3e81-7f8e-41cc-bc61-deaaf0ed9ccc admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:43.640882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f3ef3e81-7f8e-41cc-bc61-deaaf0ed9ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:43.643601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-eea17060-aebc-459b-bbed-a48a7be579cf None None] MFA Rules not processed for user `279e5ce41bba4d8a9c20fed40db5378e`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:43.644910 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-eea17060-aebc-459b-bbed-a48a7be579cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:43.703051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:43.718895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef3e81-7f8e-41cc-bc61-deaaf0ed9ccc admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:43.723022 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf939c-ff51-4d94-9293-b74714742a69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:43.723861 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf939c-ff51-4d94-9293-b74714742a69 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:43.724249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf939c-ff51-4d94-9293-b74714742a69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:43.724631 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf939c-ff51-4d94-9293-b74714742a69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:43.726096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1062/2165] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:43.730466 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-47bf939c-ff51-4d94-9293-b74714742a69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:43.737557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea17060-aebc-459b-bbed-a48a7be579cf None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:43.739058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-eea17060-aebc-459b-bbed-a48a7be579cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:43.753006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea17060-aebc-459b-bbed-a48a7be579cf None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:43.757779 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbba7e2-6182-4bd2-9a67-a6ccb148ece4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:43.758444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbba7e2-6182-4bd2-9a67-a6ccb148ece4 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:43.758737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbba7e2-6182-4bd2-9a67-a6ccb148ece4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:43.759016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbba7e2-6182-4bd2-9a67-a6ccb148ece4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:43.766320 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:43.773961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbba7e2-6182-4bd2-9a67-a6ccb148ece4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:43.775865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbba7e2-6182-4bd2-9a67-a6ccb148ece4 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:43.787357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1063/2166] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:30:43.809337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf939c-ff51-4d94-9293-b74714742a69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:43.812895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf939c-ff51-4d94-9293-b74714742a69 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:43.824175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1104/2167] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:30:44.178281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbba7e2-6182-4bd2-9a67-a6ccb148ece4 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:44.187300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbba7e2-6182-4bd2-9a67-a6ccb148ece4 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:44.191703 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925a245-699b-421f-bb91-4c405d52d63d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:44.192273 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925a245-699b-421f-bb91-4c405d52d63d service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:44.192556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925a245-699b-421f-bb91-4c405d52d63d service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:44.192855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925a245-699b-421f-bb91-4c405d52d63d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:44.279793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925a245-699b-421f-bb91-4c405d52d63d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:44.282750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925a245-699b-421f-bb91-4c405d52d63d service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:44.300435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1064/2168] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:30:48.213089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf939c-ff51-4d94-9293-b74714742a69 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:48.280368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf939c-ff51-4d94-9293-b74714742a69 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:48.285047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:48.286057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:48.286343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:48.286623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] PATH_INFO: `/v3/users/8a203f7fd05f4838ab984f608765f79a` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:48.287845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a203f7fd05f4838ab984f608765f79a)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:48.289865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:48.819150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a203f7fd05f4838ab984f608765f79a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:48.877146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd36897-8e68-46be-b855-fccab9ad2bb0 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:48.882751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd36897-8e68-46be-b855-fccab9ad2bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:48.882751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd36897-8e68-46be-b855-fccab9ad2bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:48.901636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-8cd36897-8e68-46be-b855-fccab9ad2bb0 None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:48.906157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8cd36897-8e68-46be-b855-fccab9ad2bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:48.956608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a203f7fd05f4838ab984f608765f79a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:48.957288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a203f7fd05f4838ab984f608765f79a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:48.979463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a203f7fd05f4838ab984f608765f79a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:48.983265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1065/2169] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:30:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:48.989034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a203f7fd05f4838ab984f608765f79a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:49.001609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1105/2170] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:48 2022] DELETE /identity/v3/users/8a203f7fd05f4838ab984f608765f79a => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:49.006283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b2541-abf1-45cd-989a-f0cefc722a4f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:49.006632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b2541-abf1-45cd-989a-f0cefc722a4f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:49.006730 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b2541-abf1-45cd-989a-f0cefc722a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:49.039012 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-553b2541-abf1-45cd-989a-f0cefc722a4f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:49.040303 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-553b2541-abf1-45cd-989a-f0cefc722a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:49.059848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:49.061351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:49.095209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:49.150931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1066/2171] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:49.162420 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b2541-abf1-45cd-989a-f0cefc722a4f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:49.163924 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-553b2541-abf1-45cd-989a-f0cefc722a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:49.182075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:49.203639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9d4b5-d094-4d0a-846a-87f4bf7664d0 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:49.210475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727311b-7a37-4398-ac9a-e937c3b1e568 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:49.211480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727311b-7a37-4398-ac9a-e937c3b1e568 service swift] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:49.211943 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727311b-7a37-4398-ac9a-e937c3b1e568 service swift] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:49.212408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727311b-7a37-4398-ac9a-e937c3b1e568 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:49.251424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b2541-abf1-45cd-989a-f0cefc722a4f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:49.256229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a9f38-2b8e-4f4e-8933-ce5b5137af52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:49.256888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a9f38-2b8e-4f4e-8933-ce5b5137af52 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:49.257530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a9f38-2b8e-4f4e-8933-ce5b5137af52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:49.257954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a9f38-2b8e-4f4e-8933-ce5b5137af52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:49.271305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a9f38-2b8e-4f4e-8933-ce5b5137af52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:49.272886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a9f38-2b8e-4f4e-8933-ce5b5137af52 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:49.295706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1067/2172] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:49.311370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727311b-7a37-4398-ac9a-e937c3b1e568 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:49.313340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727311b-7a37-4398-ac9a-e937c3b1e568 service swift] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:49.327795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1106/2173] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:30:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 16:30:49.907283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a9f38-2b8e-4f4e-8933-ce5b5137af52 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:49.909484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8e1a9f38-2b8e-4f4e-8933-ce5b5137af52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:49.960736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a9f38-2b8e-4f4e-8933-ce5b5137af52 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:49.974023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf30ce4-22f7-40d0-b840-952ec3970742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:49.975676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf30ce4-22f7-40d0-b840-952ec3970742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:49.976123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf30ce4-22f7-40d0-b840-952ec3970742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:49.976605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf30ce4-22f7-40d0-b840-952ec3970742 admin admin] PATH_INFO: `/v3/users/724a8baed416444aa0de4df59375a9fd` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:49.978971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf30ce4-22f7-40d0-b840-952ec3970742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=724a8baed416444aa0de4df59375a9fd)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:49.981138 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf30ce4-22f7-40d0-b840-952ec3970742 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:50.180048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-abf30ce4-22f7-40d0-b840-952ec3970742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724a8baed416444aa0de4df59375a9fd'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:50.310297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-abf30ce4-22f7-40d0-b840-952ec3970742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724a8baed416444aa0de4df59375a9fd'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:50.326966 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727311b-7a37-4398-ac9a-e937c3b1e568 service swift] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:50.329231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d727311b-7a37-4398-ac9a-e937c3b1e568 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:50.381079 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727311b-7a37-4398-ac9a-e937c3b1e568 service swift] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:50.419449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-abf30ce4-22f7-40d0-b840-952ec3970742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724a8baed416444aa0de4df59375a9fd'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:50.422661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-abf30ce4-22f7-40d0-b840-952ec3970742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724a8baed416444aa0de4df59375a9fd'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:50.435190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:50.439271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:50.440205 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:50.440741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] PATH_INFO: `/v3/projects/bbe6786bbe0647aaa4bddc49e2ea9495` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:50.443676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe6786bbe0647aaa4bddc49e2ea9495)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:50.447807 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:50.452542 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-abf30ce4-22f7-40d0-b840-952ec3970742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724a8baed416444aa0de4df59375a9fd'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:50.470787 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1068/2174] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:49 2022] DELETE /identity/v3/users/724a8baed416444aa0de4df59375a9fd => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:50.472511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a9b16-ce7a-462a-afd1-03bc88ea3746 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:50.473955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a9b16-ce7a-462a-afd1-03bc88ea3746 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:50.475341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a9b16-ce7a-462a-afd1-03bc88ea3746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:50.512297 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-6d9a9b16-ce7a-462a-afd1-03bc88ea3746 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:50.516076 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6d9a9b16-ce7a-462a-afd1-03bc88ea3746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:50.766394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe6786bbe0647aaa4bddc49e2ea9495', 'request_id': 'req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:50.799377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1069/2175] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:50.808855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a9b16-ce7a-462a-afd1-03bc88ea3746 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:50.810907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6d9a9b16-ce7a-462a-afd1-03bc88ea3746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:50.843832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:50.889522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a9b16-ce7a-462a-afd1-03bc88ea3746 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:50.923484 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe6786bbe0647aaa4bddc49e2ea9495', 'request_id': 'req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:50.957401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe6786bbe0647aaa4bddc49e2ea9495', 'request_id': 'req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:50.957525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d0076-af9d-4dd3-8ab4-a81839b32070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:50.957525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d0076-af9d-4dd3-8ab4-a81839b32070 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:50.957525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d0076-af9d-4dd3-8ab4-a81839b32070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:50.957525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d0076-af9d-4dd3-8ab4-a81839b32070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:50.984945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] The token cache is being invalidate because project bbe6786bbe0647aaa4bddc49e2ea9495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:50.991284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:50.991284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:50.991284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1107/2176] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:50 2022] DELETE /identity/v3/projects/bbe6786bbe0647aaa4bddc49e2ea9495 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:30:50.998190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:51.003633 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:51.150556 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:51.161337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d0076-af9d-4dd3-8ab4-a81839b32070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:51.162861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d0076-af9d-4dd3-8ab4-a81839b32070 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:51.186842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1070/2177] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:30:51.219233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81d6fe-d0cb-40eb-89bd-1351b8d3b174 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:51.233615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:51.234845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:51.235197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:51.235561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] PATH_INFO: `/v3/users/279e5ce41bba4d8a9c20fed40db5378e` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:51.236998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=279e5ce41bba4d8a9c20fed40db5378e)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:51.239249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:51.541820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '279e5ce41bba4d8a9c20fed40db5378e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:51.624368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '279e5ce41bba4d8a9c20fed40db5378e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:51.625462 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '279e5ce41bba4d8a9c20fed40db5378e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:51.664575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '279e5ce41bba4d8a9c20fed40db5378e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:51.690660 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '279e5ce41bba4d8a9c20fed40db5378e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:51.725366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1108/2178] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:50 2022] DELETE /identity/v3/users/279e5ce41bba4d8a9c20fed40db5378e => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:30:52.048081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d0076-af9d-4dd3-8ab4-a81839b32070 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:52.050730 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-971d0076-af9d-4dd3-8ab4-a81839b32070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:52.071114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d0076-af9d-4dd3-8ab4-a81839b32070 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:52.175461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:52.177781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:52.178187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:52.178771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] PATH_INFO: `/v3/projects/6b958858cb6e4cbeab53f96ea30fe18a` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:52.180397 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b958858cb6e4cbeab53f96ea30fe18a)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:52.182890 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:52.292679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:52.312517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b958858cb6e4cbeab53f96ea30fe18a', 'request_id': 'req-e821518c-bc30-4d50-a6d8-e4c8946de6c9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.346682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:52.348288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:52.373264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b958858cb6e4cbeab53f96ea30fe18a', 'request_id': 'req-e821518c-bc30-4d50-a6d8-e4c8946de6c9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.375492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac18f6e-d439-4474-ab30-b51b85d93639 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:52.386413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b958858cb6e4cbeab53f96ea30fe18a', 'request_id': 'req-e821518c-bc30-4d50-a6d8-e4c8946de6c9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.401149 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] The token cache is being invalidate because project 6b958858cb6e4cbeab53f96ea30fe18a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:52.401468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.402231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.406971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1071/2179] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:52 2022] DELETE /identity/v3/projects/6b958858cb6e4cbeab53f96ea30fe18a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:52.411418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:52.411418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:52.479970 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93aefd-dc0c-499a-bd10-6339f50477de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:52.480868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93aefd-dc0c-499a-bd10-6339f50477de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:52.481166 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93aefd-dc0c-499a-bd10-6339f50477de admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:52.486860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93aefd-dc0c-499a-bd10-6339f50477de admin admin] PATH_INFO: `/v3/projects/b3c2f1022fd84743ba7aab4c38c24a35` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:52.489979 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93aefd-dc0c-499a-bd10-6339f50477de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c2f1022fd84743ba7aab4c38c24a35)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:52.492220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93aefd-dc0c-499a-bd10-6339f50477de admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:52.528789 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821518c-bc30-4d50-a6d8-e4c8946de6c9 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:52.537377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b137fd6-b11f-4e2b-81bd-92b7d18dba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:52.538626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b137fd6-b11f-4e2b-81bd-92b7d18dba90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:52.538922 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b137fd6-b11f-4e2b-81bd-92b7d18dba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:52.539340 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b137fd6-b11f-4e2b-81bd-92b7d18dba90 admin admin] PATH_INFO: `/v3/users/3e51ceeda6d6462589f0e2bfdbd640a8` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:52.540848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b137fd6-b11f-4e2b-81bd-92b7d18dba90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e51ceeda6d6462589f0e2bfdbd640a8)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:52.543508 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b137fd6-b11f-4e2b-81bd-92b7d18dba90 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:52.651105 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6a93aefd-dc0c-499a-bd10-6339f50477de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c2f1022fd84743ba7aab4c38c24a35', 'request_id': 'req-6a93aefd-dc0c-499a-bd10-6339f50477de'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.731179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6a93aefd-dc0c-499a-bd10-6339f50477de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c2f1022fd84743ba7aab4c38c24a35', 'request_id': 'req-6a93aefd-dc0c-499a-bd10-6339f50477de'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.733809 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:52.751046 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6a93aefd-dc0c-499a-bd10-6339f50477de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c2f1022fd84743ba7aab4c38c24a35', 'request_id': 'req-6a93aefd-dc0c-499a-bd10-6339f50477de'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.809069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6a93aefd-dc0c-499a-bd10-6339f50477de admin admin] The token cache is being invalidate because project b3c2f1022fd84743ba7aab4c38c24a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:52.809510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6a93aefd-dc0c-499a-bd10-6339f50477de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.810276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6a93aefd-dc0c-499a-bd10-6339f50477de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.821230 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1109/2180] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:52 2022] DELETE /identity/v3/projects/b3c2f1022fd84743ba7aab4c38c24a35 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:52.821923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1b137fd6-b11f-4e2b-81bd-92b7d18dba90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e51ceeda6d6462589f0e2bfdbd640a8'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.824608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b27432-1d01-44d9-960c-b19ff4709b3f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:52.824835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b27432-1d01-44d9-960c-b19ff4709b3f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:52.825090 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b27432-1d01-44d9-960c-b19ff4709b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:52.863347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a8b27432-1d01-44d9-960c-b19ff4709b3f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:52.865389 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a8b27432-1d01-44d9-960c-b19ff4709b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:52.946785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1b137fd6-b11f-4e2b-81bd-92b7d18dba90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e51ceeda6d6462589f0e2bfdbd640a8'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.975810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1b137fd6-b11f-4e2b-81bd-92b7d18dba90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e51ceeda6d6462589f0e2bfdbd640a8'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.986410 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1b137fd6-b11f-4e2b-81bd-92b7d18dba90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e51ceeda6d6462589f0e2bfdbd640a8'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.986612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1110/2181] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:52.988995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1b137fd6-b11f-4e2b-81bd-92b7d18dba90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e51ceeda6d6462589f0e2bfdbd640a8'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:52.992824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ccd6c-619b-46b7-9526-6c7b9d7a935c None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:52.994945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ccd6c-619b-46b7-9526-6c7b9d7a935c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:52.995452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ccd6c-619b-46b7-9526-6c7b9d7a935c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:53.015498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1072/2182] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:52 2022] DELETE /identity/v3/users/3e51ceeda6d6462589f0e2bfdbd640a8 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:53.021929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-034ccd6c-619b-46b7-9526-6c7b9d7a935c None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:53.023467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-034ccd6c-619b-46b7-9526-6c7b9d7a935c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:53.140734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1111/2183] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:53.142305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b137fd6-b11f-4e2b-81bd-92b7d18dba90 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:53.156497 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b137fd6-b11f-4e2b-81bd-92b7d18dba90 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:53.172936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ffc4f-8415-4001-bf5d-198004b37cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:53.175352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ffc4f-8415-4001-bf5d-198004b37cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:53.175828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ffc4f-8415-4001-bf5d-198004b37cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:53.177376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ffc4f-8415-4001-bf5d-198004b37cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:53.179150 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ffc4f-8415-4001-bf5d-198004b37cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:30:53.179768 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ffc4f-8415-4001-bf5d-198004b37cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:53.187197 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ffc4f-8415-4001-bf5d-198004b37cb8 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:53.236533 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1073/2184] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:30:53.236645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ccd6c-619b-46b7-9526-6c7b9d7a935c None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:53.249681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ccd6c-619b-46b7-9526-6c7b9d7a935c None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:53.261726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ae018-7c41-471c-8300-1ddec01c593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:53.262782 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ae018-7c41-471c-8300-1ddec01c593b admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:53.263203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ae018-7c41-471c-8300-1ddec01c593b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:53.263322 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ae018-7c41-471c-8300-1ddec01c593b admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:53.264083 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ae018-7c41-471c-8300-1ddec01c593b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:53.266464 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ae018-7c41-471c-8300-1ddec01c593b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:53.370625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1112/2185] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:53 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:53.375041 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ffc4f-8415-4001-bf5d-198004b37cb8 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:53.390952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ffc4f-8415-4001-bf5d-198004b37cb8 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:53.444051 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:53.535327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e642b-a939-411b-a311-345f5cf52c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:53.536587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e642b-a939-411b-a311-345f5cf52c2b admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:53.536587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e642b-a939-411b-a311-345f5cf52c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:53.536802 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e642b-a939-411b-a311-345f5cf52c2b admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:53.537672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e642b-a939-411b-a311-345f5cf52c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:53.540106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e642b-a939-411b-a311-345f5cf52c2b admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:53.737921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ae018-7c41-471c-8300-1ddec01c593b admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:53.740108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f49ae018-7c41-471c-8300-1ddec01c593b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:53.742210 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1074/2186] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:53 2022] POST /identity/v3/users => generated 294 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:30:53.749270 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e642b-a939-411b-a311-345f5cf52c2b admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:53.762898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ae018-7c41-471c-8300-1ddec01c593b admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:53.765747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e642b-a939-411b-a311-345f5cf52c2b admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:53.768617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:53.769660 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:53.769817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:53.770183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] PATH_INFO: `/v3/projects/a8e112ba29bb42c58c6104e339ee5a23` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:53.771500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e112ba29bb42c58c6104e339ee5a23)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:53.771585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539f006-6885-4644-b910-2d0951d1da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:53.772274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539f006-6885-4644-b910-2d0951d1da7f admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:53.772450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539f006-6885-4644-b910-2d0951d1da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:53.772706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539f006-6885-4644-b910-2d0951d1da7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:53.773472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:53.773596 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539f006-6885-4644-b910-2d0951d1da7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:53.775169 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539f006-6885-4644-b910-2d0951d1da7f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:53.789235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1075/2187] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:53.790361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539f006-6885-4644-b910-2d0951d1da7f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:53.800730 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539f006-6885-4644-b910-2d0951d1da7f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:53.807392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f911c-2de7-45ee-89e2-cc1733894cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:53.807392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f911c-2de7-45ee-89e2-cc1733894cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:53.807392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f911c-2de7-45ee-89e2-cc1733894cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:53.807392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f911c-2de7-45ee-89e2-cc1733894cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:53.809396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f911c-2de7-45ee-89e2-cc1733894cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:53.809727 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f911c-2de7-45ee-89e2-cc1733894cd1 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:53.821907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1076/2188] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:53.826220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f911c-2de7-45ee-89e2-cc1733894cd1 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:53.838701 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f911c-2de7-45ee-89e2-cc1733894cd1 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:53.845949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d053de4-039e-4dff-abf0-3078118a2b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:53.847212 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d053de4-039e-4dff-abf0-3078118a2b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:53.847665 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d053de4-039e-4dff-abf0-3078118a2b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:53.847954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d053de4-039e-4dff-abf0-3078118a2b9d admin admin] PATH_INFO: `/v3/projects/903dfc9980cf4ce18fc1c06dd4f9caf2/users/33c3096d59cb49c185e27e738f28e052/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:53.870111 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d053de4-039e-4dff-abf0-3078118a2b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=903dfc9980cf4ce18fc1c06dd4f9caf2, user_id=33c3096d59cb49c185e27e738f28e052, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:53.873227 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d053de4-039e-4dff-abf0-3078118a2b9d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:54.012037 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1077/2189] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:53 2022] PUT /identity/v3/projects/903dfc9980cf4ce18fc1c06dd4f9caf2/users/33c3096d59cb49c185e27e738f28e052/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:30:54.032867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94bca1-29d7-4bd0-a115-6782061c277f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:54.032867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94bca1-29d7-4bd0-a115-6782061c277f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:54.032867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94bca1-29d7-4bd0-a115-6782061c277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:54.046447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e112ba29bb42c58c6104e339ee5a23', 'request_id': 'req-5d37e869-59ac-4b58-a276-c28e8a0a60bb'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:54.079562 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-0e94bca1-29d7-4bd0-a115-6782061c277f None None] MFA Rules not processed for user `33c3096d59cb49c185e27e738f28e052`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:54.081733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0e94bca1-29d7-4bd0-a115-6782061c277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:54.154825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e112ba29bb42c58c6104e339ee5a23', 'request_id': 'req-5d37e869-59ac-4b58-a276-c28e8a0a60bb'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:54.157466 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:54.162502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e112ba29bb42c58c6104e339ee5a23', 'request_id': 'req-5d37e869-59ac-4b58-a276-c28e8a0a60bb'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:54.188928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] The token cache is being invalidate because project a8e112ba29bb42c58c6104e339ee5a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:54.189944 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:54.190684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:54.193044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1113/2190] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:53 2022] DELETE /identity/v3/projects/a8e112ba29bb42c58c6104e339ee5a23 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:54.196862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:54.199668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:54.205005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1078/2191] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:54.209272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94bca1-29d7-4bd0-a115-6782061c277f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:54.324206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37e869-59ac-4b58-a276-c28e8a0a60bb admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:54.335865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:54.336921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de21a1-d3f1-4fb8-943b-71d0b155708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:54.340623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de21a1-d3f1-4fb8-943b-71d0b155708d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:54.351415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94bca1-29d7-4bd0-a115-6782061c277f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:54.352169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de21a1-d3f1-4fb8-943b-71d0b155708d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:54.352169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de21a1-d3f1-4fb8-943b-71d0b155708d admin admin] PATH_INFO: `/v3/users/509a3fac4b854d7dab81289e14683d37` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:54.352169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de21a1-d3f1-4fb8-943b-71d0b155708d admin admin] RBAC: Authorizing `identity:delete_user(user_id=509a3fac4b854d7dab81289e14683d37)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:54.352540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aea9f-09cb-4f10-9dd7-286eefa65aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:54.352540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aea9f-09cb-4f10-9dd7-286eefa65aed admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:54.352540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aea9f-09cb-4f10-9dd7-286eefa65aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:54.352540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aea9f-09cb-4f10-9dd7-286eefa65aed admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:54.352906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de21a1-d3f1-4fb8-943b-71d0b155708d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:54.353003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222aea9f-09cb-4f10-9dd7-286eefa65aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:54.353003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222aea9f-09cb-4f10-9dd7-286eefa65aed admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:54.474667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1079/2192] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:54 2022] POST /identity/v3/projects => generated 389 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:54.476145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aea9f-09cb-4f10-9dd7-286eefa65aed admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:54.478015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-222aea9f-09cb-4f10-9dd7-286eefa65aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:54.589207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aea9f-09cb-4f10-9dd7-286eefa65aed admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:54.590065 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5de21a1-d3f1-4fb8-943b-71d0b155708d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509a3fac4b854d7dab81289e14683d37'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:54.598754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b351e0f-6786-4c7a-97e3-9aa0bc565e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:54.599416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351e0f-6786-4c7a-97e3-9aa0bc565e87 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:54.599710 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351e0f-6786-4c7a-97e3-9aa0bc565e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:54.599994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351e0f-6786-4c7a-97e3-9aa0bc565e87 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:54.600701 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b351e0f-6786-4c7a-97e3-9aa0bc565e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:54.603053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b351e0f-6786-4c7a-97e3-9aa0bc565e87 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:54.713448 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5de21a1-d3f1-4fb8-943b-71d0b155708d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509a3fac4b854d7dab81289e14683d37'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:54.714508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5de21a1-d3f1-4fb8-943b-71d0b155708d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509a3fac4b854d7dab81289e14683d37'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:54.725558 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1080/2193] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:54 2022] POST /identity/v3/users => generated 301 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:54.728473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b351e0f-6786-4c7a-97e3-9aa0bc565e87 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:54.731915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9b351e0f-6786-4c7a-97e3-9aa0bc565e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:54.741664 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5de21a1-d3f1-4fb8-943b-71d0b155708d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509a3fac4b854d7dab81289e14683d37'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:54.765982 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b351e0f-6786-4c7a-97e3-9aa0bc565e87 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:54.772583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d27851-6dd1-4e7e-ae82-fb5c4029d15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:54.773424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d27851-6dd1-4e7e-ae82-fb5c4029d15a admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:54.773717 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d27851-6dd1-4e7e-ae82-fb5c4029d15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:54.774010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d27851-6dd1-4e7e-ae82-fb5c4029d15a admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:54.774749 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d27851-6dd1-4e7e-ae82-fb5c4029d15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:54.775199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f5de21a1-d3f1-4fb8-943b-71d0b155708d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509a3fac4b854d7dab81289e14683d37'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:54.776525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d27851-6dd1-4e7e-ae82-fb5c4029d15a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:54.790750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1114/2194] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:54 2022] DELETE /identity/v3/users/509a3fac4b854d7dab81289e14683d37 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:54.801237 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1081/2195] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:54.806213 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de21a1-d3f1-4fb8-943b-71d0b155708d admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:54.963540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de21a1-d3f1-4fb8-943b-71d0b155708d admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:54.978306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948075e-a1fc-4e6d-b4d9-c68bccab4500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:54.980156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948075e-a1fc-4e6d-b4d9-c68bccab4500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:54.982045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948075e-a1fc-4e6d-b4d9-c68bccab4500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:54.984411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948075e-a1fc-4e6d-b4d9-c68bccab4500 admin admin] PATH_INFO: `/v3/projects/57b6939627264a048b1f6f2c976d32d0/users/6d3830d77ea64255a2372b3a84f85515/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:55.010311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:55.024645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948075e-a1fc-4e6d-b4d9-c68bccab4500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b6939627264a048b1f6f2c976d32d0, user_id=6d3830d77ea64255a2372b3a84f85515, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:55.029466 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948075e-a1fc-4e6d-b4d9-c68bccab4500 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:55.130866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1115/2196] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:54 2022] PUT /identity/v3/projects/57b6939627264a048b1f6f2c976d32d0/users/6d3830d77ea64255a2372b3a84f85515/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:55.135753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d27851-6dd1-4e7e-ae82-fb5c4029d15a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:55.151766 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d27851-6dd1-4e7e-ae82-fb5c4029d15a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:55.219757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948075e-a1fc-4e6d-b4d9-c68bccab4500 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:55.223177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b948075e-a1fc-4e6d-b4d9-c68bccab4500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:55.259651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469212e-10cb-4a55-bcbd-eb5dd7d67022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:55.261501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469212e-10cb-4a55-bcbd-eb5dd7d67022 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:55.262524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469212e-10cb-4a55-bcbd-eb5dd7d67022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:55.262960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469212e-10cb-4a55-bcbd-eb5dd7d67022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:55.263937 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469212e-10cb-4a55-bcbd-eb5dd7d67022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:55.266656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469212e-10cb-4a55-bcbd-eb5dd7d67022 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:55.282402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1082/2197] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:55.292461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469212e-10cb-4a55-bcbd-eb5dd7d67022 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:55.314859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469212e-10cb-4a55-bcbd-eb5dd7d67022 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:55.322952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c77673-ae21-46b2-ae99-babc5d7de638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:55.323876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77673-ae21-46b2-ae99-babc5d7de638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:55.324310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77673-ae21-46b2-ae99-babc5d7de638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:55.324752 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77673-ae21-46b2-ae99-babc5d7de638 admin admin] PATH_INFO: `/v3/projects/57b6939627264a048b1f6f2c976d32d0/users/6d3830d77ea64255a2372b3a84f85515/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:55.328521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c77673-ae21-46b2-ae99-babc5d7de638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b6939627264a048b1f6f2c976d32d0, user_id=6d3830d77ea64255a2372b3a84f85515, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:55.345649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c77673-ae21-46b2-ae99-babc5d7de638 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:55.351296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1083/2198] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:55 2022] PUT /identity/v3/projects/57b6939627264a048b1f6f2c976d32d0/users/6d3830d77ea64255a2372b3a84f85515/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:55.357704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948075e-a1fc-4e6d-b4d9-c68bccab4500 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:55.362425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ee0c-cc0e-4860-aa27-bb796ccfb9b6 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:55.368746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ee0c-cc0e-4860-aa27-bb796ccfb9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:55.368746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ee0c-cc0e-4860-aa27-bb796ccfb9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:55.413981 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-90b6ee0c-cc0e-4860-aa27-bb796ccfb9b6 None None] MFA Rules not processed for user `6d3830d77ea64255a2372b3a84f85515`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:55.415315 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-90b6ee0c-cc0e-4860-aa27-bb796ccfb9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:55.453774 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be35da-2804-4b90-a5da-d855d0e4fa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:55.460977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be35da-2804-4b90-a5da-d855d0e4fa3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:55.461610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be35da-2804-4b90-a5da-d855d0e4fa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:55.465038 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be35da-2804-4b90-a5da-d855d0e4fa3d admin admin] PATH_INFO: `/v3/users/04e9e7b10de8416f80d6b6f86b1885fc` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:55.469103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be35da-2804-4b90-a5da-d855d0e4fa3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e9e7b10de8416f80d6b6f86b1885fc)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:55.474511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be35da-2804-4b90-a5da-d855d0e4fa3d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:55.476288 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:55.556559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1084/2199] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:30:55.568506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6ee0c-cc0e-4860-aa27-bb796ccfb9b6 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:55.569649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-90b6ee0c-cc0e-4860-aa27-bb796ccfb9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:55.700605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6ee0c-cc0e-4860-aa27-bb796ccfb9b6 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:55.711705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee6ef-aeeb-4ad7-b613-5e040b78f778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:55.726587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee6ef-aeeb-4ad7-b613-5e040b78f778 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:55.728416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee6ef-aeeb-4ad7-b613-5e040b78f778 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:55.729921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee6ef-aeeb-4ad7-b613-5e040b78f778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:55.741012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f9be35da-2804-4b90-a5da-d855d0e4fa3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e9e7b10de8416f80d6b6f86b1885fc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:55.752315 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aee6ef-aeeb-4ad7-b613-5e040b78f778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:55.758771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aee6ef-aeeb-4ad7-b613-5e040b78f778 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:55.819809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1085/2200] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:30:55.822543 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee6ef-aeeb-4ad7-b613-5e040b78f778 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:55.826204 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f0aee6ef-aeeb-4ad7-b613-5e040b78f778 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:55.835550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f9be35da-2804-4b90-a5da-d855d0e4fa3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e9e7b10de8416f80d6b6f86b1885fc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:55.836501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f9be35da-2804-4b90-a5da-d855d0e4fa3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e9e7b10de8416f80d6b6f86b1885fc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:55.866021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee6ef-aeeb-4ad7-b613-5e040b78f778 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:55.876394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f9be35da-2804-4b90-a5da-d855d0e4fa3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e9e7b10de8416f80d6b6f86b1885fc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:55.883492 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:55.884456 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:55.886841 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:55.887293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] PATH_INFO: `/v3/projects/ee2f2a8005824e66ab004fa045aee357` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:55.889981 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee2f2a8005824e66ab004fa045aee357)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:55.896137 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:55.896293 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f9be35da-2804-4b90-a5da-d855d0e4fa3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e9e7b10de8416f80d6b6f86b1885fc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:55.916355 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1116/2201] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:55 2022] DELETE /identity/v3/users/04e9e7b10de8416f80d6b6f86b1885fc => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:55.918482 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a037d9-8caa-4d53-89b5-3ceac936c94f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:55.919122 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a037d9-8caa-4d53-89b5-3ceac936c94f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:55.919449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a037d9-8caa-4d53-89b5-3ceac936c94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:55.983117 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-78a037d9-8caa-4d53-89b5-3ceac936c94f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:55.983117 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-78a037d9-8caa-4d53-89b5-3ceac936c94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:55.995151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:56.071134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1117/2202] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:56.072517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a037d9-8caa-4d53-89b5-3ceac936c94f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:56.074291 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-78a037d9-8caa-4d53-89b5-3ceac936c94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:56.112987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a037d9-8caa-4d53-89b5-3ceac936c94f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:56.113859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee2f2a8005824e66ab004fa045aee357', 'request_id': 'req-26ae4fff-5db2-441a-b787-9fa1919f4e12'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:56.202130 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee2f2a8005824e66ab004fa045aee357', 'request_id': 'req-26ae4fff-5db2-441a-b787-9fa1919f4e12'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:56.215416 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d1fef-7311-4b64-b88d-c8f70a2afaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:56.216483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1fef-7311-4b64-b88d-c8f70a2afaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:56.216920 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1fef-7311-4b64-b88d-c8f70a2afaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:56.217348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1fef-7311-4b64-b88d-c8f70a2afaf5 admin admin] PATH_INFO: `/v3/users/33c3096d59cb49c185e27e738f28e052` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:56.218484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee2f2a8005824e66ab004fa045aee357', 'request_id': 'req-26ae4fff-5db2-441a-b787-9fa1919f4e12'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:56.219364 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d1fef-7311-4b64-b88d-c8f70a2afaf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33c3096d59cb49c185e27e738f28e052)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:56.223947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d1fef-7311-4b64-b88d-c8f70a2afaf5 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:56.268268 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] The token cache is being invalidate because project ee2f2a8005824e66ab004fa045aee357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:56.268777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:56.270154 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:56.277108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1086/2203] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:55 2022] DELETE /identity/v3/projects/ee2f2a8005824e66ab004fa045aee357 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:56.277108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:56.284031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:56.373647 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae4fff-5db2-441a-b787-9fa1919f4e12 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:56.378457 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323fd81-8194-4d33-a25b-6dd89ca75552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:56.383539 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323fd81-8194-4d33-a25b-6dd89ca75552 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:56.383998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323fd81-8194-4d33-a25b-6dd89ca75552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:56.384827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323fd81-8194-4d33-a25b-6dd89ca75552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:56.387205 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7323fd81-8194-4d33-a25b-6dd89ca75552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:56.413584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323fd81-8194-4d33-a25b-6dd89ca75552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:56.415134 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323fd81-8194-4d33-a25b-6dd89ca75552 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:56.420685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:56.435796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1087/2204] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:56.437284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c1434-b03c-4d1c-b9cc-1b24dc03441d None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:56.437519 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c1434-b03c-4d1c-b9cc-1b24dc03441d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:56.442345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c1434-b03c-4d1c-b9cc-1b24dc03441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:56.469417 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-128c1434-b03c-4d1c-b9cc-1b24dc03441d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:56.478143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-128c1434-b03c-4d1c-b9cc-1b24dc03441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:56.499065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1088/2205] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:56.500185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b30d1fef-7311-4b64-b88d-c8f70a2afaf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33c3096d59cb49c185e27e738f28e052'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:56.508851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8567b-4197-4d1c-849d-73c9475f9d0a None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:56.511225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8567b-4197-4d1c-849d-73c9475f9d0a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:56.511225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8567b-4197-4d1c-849d-73c9475f9d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:56.537702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-d2a8567b-4197-4d1c-849d-73c9475f9d0a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:56.540405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d2a8567b-4197-4d1c-849d-73c9475f9d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:56.567583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1089/2206] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:30:56.568508 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8567b-4197-4d1c-849d-73c9475f9d0a None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:56.585972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8567b-4197-4d1c-849d-73c9475f9d0a None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:56.599057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b30d1fef-7311-4b64-b88d-c8f70a2afaf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33c3096d59cb49c185e27e738f28e052'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:56.599760 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b30d1fef-7311-4b64-b88d-c8f70a2afaf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33c3096d59cb49c185e27e738f28e052'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:56.617489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b30d1fef-7311-4b64-b88d-c8f70a2afaf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33c3096d59cb49c185e27e738f28e052'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:56.629931 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b30d1fef-7311-4b64-b88d-c8f70a2afaf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33c3096d59cb49c185e27e738f28e052'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:56.632221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9dc0b-85d5-4fa3-853e-5985fef058b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:56.635691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9dc0b-85d5-4fa3-853e-5985fef058b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:56.638143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9dc0b-85d5-4fa3-853e-5985fef058b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:56.638559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9dc0b-85d5-4fa3-853e-5985fef058b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:56.638801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1118/2207] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:56 2022] DELETE /identity/v3/users/33c3096d59cb49c185e27e738f28e052 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:56.639431 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9dc0b-85d5-4fa3-853e-5985fef058b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:30:56.639742 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9dc0b-85d5-4fa3-853e-5985fef058b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:56.641400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9dc0b-85d5-4fa3-853e-5985fef058b5 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:56.643905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8fd93-7880-406e-869b-a6637eb08a34 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:56.644287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8fd93-7880-406e-869b-a6637eb08a34 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:56.644574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8fd93-7880-406e-869b-a6637eb08a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:56.663370 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1090/2208] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:30:56.667882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9dc0b-85d5-4fa3-853e-5985fef058b5 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:56.675199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-73b9dc0b-85d5-4fa3-853e-5985fef058b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:56.675379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-0cd8fd93-7880-406e-869b-a6637eb08a34 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:56.676694 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0cd8fd93-7880-406e-869b-a6637eb08a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:56.715651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9dc0b-85d5-4fa3-853e-5985fef058b5 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:56.745997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:56.782195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1119/2209] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:56.796508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8fd93-7880-406e-869b-a6637eb08a34 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:56.798059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0cd8fd93-7880-406e-869b-a6637eb08a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:56.843549 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1a88d-012a-4518-8bbf-ce0dc0138b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:56.844629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a88d-012a-4518-8bbf-ce0dc0138b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:56.845810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a88d-012a-4518-8bbf-ce0dc0138b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:56.846336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a88d-012a-4518-8bbf-ce0dc0138b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:56.847268 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1a88d-012a-4518-8bbf-ce0dc0138b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:56.849515 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1a88d-012a-4518-8bbf-ce0dc0138b8e admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:56.901825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8fd93-7880-406e-869b-a6637eb08a34 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:56.910375 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377156b9-8382-4a7f-934f-f70a91ebf30f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:56.911133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377156b9-8382-4a7f-934f-f70a91ebf30f service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:56.912088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377156b9-8382-4a7f-934f-f70a91ebf30f service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:56.912662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377156b9-8382-4a7f-934f-f70a91ebf30f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:56.926662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377156b9-8382-4a7f-934f-f70a91ebf30f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:56.928451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377156b9-8382-4a7f-934f-f70a91ebf30f service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:56.941501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1120/2210] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:56.992096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1091/2211] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:56 2022] POST /identity/v3/projects => generated 375 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:56.992257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377156b9-8382-4a7f-934f-f70a91ebf30f service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:56.999658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377156b9-8382-4a7f-934f-f70a91ebf30f service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:57.025979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1a88d-012a-4518-8bbf-ce0dc0138b8e admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:57.027777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-51b1a88d-012a-4518-8bbf-ce0dc0138b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:57.182601 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc20cd-3069-4821-8ee5-39b44f18fbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:57.185286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc20cd-3069-4821-8ee5-39b44f18fbfb admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:57.185647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc20cd-3069-4821-8ee5-39b44f18fbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:57.186193 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc20cd-3069-4821-8ee5-39b44f18fbfb admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:57.188711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc20cd-3069-4821-8ee5-39b44f18fbfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:57.191469 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1a88d-012a-4518-8bbf-ce0dc0138b8e admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:57.192444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc20cd-3069-4821-8ee5-39b44f18fbfb admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:57.212814 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:57.213947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:57.214317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:57.214649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] PATH_INFO: `/v3/users/26029c0563b6474bb256653826e9a779` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:57.215936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=26029c0563b6474bb256653826e9a779)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:57.217983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:57.309338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1121/2212] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:56 2022] POST /identity/v3/users => generated 288 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:57.310274 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc20cd-3069-4821-8ee5-39b44f18fbfb admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:57.313238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-63bc20cd-3069-4821-8ee5-39b44f18fbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:57.340427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc20cd-3069-4821-8ee5-39b44f18fbfb admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:57.349970 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:57.350860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:57.351183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:57.351471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7 admin admin] PATH_INFO: `/v3/projects/71e8cee1cb6c4300abf38d1907fbca20` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:57.352882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e8cee1cb6c4300abf38d1907fbca20)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:57.369856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:57.530673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26029c0563b6474bb256653826e9a779'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:57.532120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e8cee1cb6c4300abf38d1907fbca20', 'request_id': 'req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:57.623787 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26029c0563b6474bb256653826e9a779'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:57.644513 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26029c0563b6474bb256653826e9a779'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:57.645608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26029c0563b6474bb256653826e9a779'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:57.661085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26029c0563b6474bb256653826e9a779'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:57.669930 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e8cee1cb6c4300abf38d1907fbca20', 'request_id': 'req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:57.674826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1092/2213] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:57 2022] DELETE /identity/v3/users/26029c0563b6474bb256653826e9a779 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:30:57.678063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:57.678575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:57.693446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e8cee1cb6c4300abf38d1907fbca20', 'request_id': 'req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:57.725988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7 admin admin] The token cache is being invalidate because project 71e8cee1cb6c4300abf38d1907fbca20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:57.726281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:57.732345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-03f0d07f-430e-4cae-8cfd-d3a1e36cc1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:57.737630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1122/2214] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:57 2022] DELETE /identity/v3/projects/71e8cee1cb6c4300abf38d1907fbca20 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:57.742324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5395a-19a3-4f25-872f-5c86772fe431 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:57.742618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5395a-19a3-4f25-872f-5c86772fe431 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:57.742898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5395a-19a3-4f25-872f-5c86772fe431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:57.779295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-1ad5395a-19a3-4f25-872f-5c86772fe431 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:57.780864 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1ad5395a-19a3-4f25-872f-5c86772fe431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:57.820276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b78a26-c94a-462a-8ae0-6f942c58e2bc admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:57.840172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ba8dd-3085-42f4-8baf-14316b51971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:57.841805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ba8dd-3085-42f4-8baf-14316b51971a admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:57.842115 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ba8dd-3085-42f4-8baf-14316b51971a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:57.842403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ba8dd-3085-42f4-8baf-14316b51971a admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:57.853869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ba8dd-3085-42f4-8baf-14316b51971a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:57.861569 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ba8dd-3085-42f4-8baf-14316b51971a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:57.894758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1123/2215] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:30:57.895882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5395a-19a3-4f25-872f-5c86772fe431 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:57.896815 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1093/2216] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:57.898611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1ad5395a-19a3-4f25-872f-5c86772fe431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:57.905187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ba8dd-3085-42f4-8baf-14316b51971a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:57.907378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-492ba8dd-3085-42f4-8baf-14316b51971a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:57.914764 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5395a-19a3-4f25-872f-5c86772fe431 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:57.921721 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:57.922887 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:57.923910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:57.924914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4 admin admin] PATH_INFO: `/v3/projects/903dfc9980cf4ce18fc1c06dd4f9caf2` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:57.928177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=903dfc9980cf4ce18fc1c06dd4f9caf2)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:57.932383 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:57.946692 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ba8dd-3085-42f4-8baf-14316b51971a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:57.961326 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bf20a-bc91-4a0c-b404-3b39fb4207fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:57.962249 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bf20a-bc91-4a0c-b404-3b39fb4207fa admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:57.962375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bf20a-bc91-4a0c-b404-3b39fb4207fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:57.962563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bf20a-bc91-4a0c-b404-3b39fb4207fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:57.964848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bf20a-bc91-4a0c-b404-3b39fb4207fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:57.964996 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bf20a-bc91-4a0c-b404-3b39fb4207fa admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:57.984567 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1094/2217] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:57.986628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993690c5-009e-484d-9c35-30e7e47fcacc None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:57.987219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993690c5-009e-484d-9c35-30e7e47fcacc None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:57.987219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993690c5-009e-484d-9c35-30e7e47fcacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:58.012445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-993690c5-009e-484d-9c35-30e7e47fcacc None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:58.014469 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-993690c5-009e-484d-9c35-30e7e47fcacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:58.029156 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1095/2218] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:58.030049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993690c5-009e-484d-9c35-30e7e47fcacc None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:58.041855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993690c5-009e-484d-9c35-30e7e47fcacc None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:58.051101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47ef70-a580-47b5-8049-8c17364e5b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:58.052008 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47ef70-a580-47b5-8049-8c17364e5b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:58.052292 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47ef70-a580-47b5-8049-8c17364e5b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:58.052570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47ef70-a580-47b5-8049-8c17364e5b15 admin admin] PATH_INFO: `/v3/projects/da925424882944f595b4a6b5af728629/users/21dae936bfcf462982bf8aa9275d56c5/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:58.070363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47ef70-a580-47b5-8049-8c17364e5b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da925424882944f595b4a6b5af728629, user_id=21dae936bfcf462982bf8aa9275d56c5, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:58.074460 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47ef70-a580-47b5-8049-8c17364e5b15 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:58.138162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1096/2219] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:58 2022] PUT /identity/v3/projects/da925424882944f595b4a6b5af728629/users/21dae936bfcf462982bf8aa9275d56c5/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:58.139459 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47ef70-a580-47b5-8049-8c17364e5b15 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:58.153752 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903dfc9980cf4ce18fc1c06dd4f9caf2', 'request_id': 'req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:58.246495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47ef70-a580-47b5-8049-8c17364e5b15 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:58.340132 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdd058-f667-4edf-a610-cb17717c698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:58.340132 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd058-f667-4edf-a610-cb17717c698d admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:58.340132 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd058-f667-4edf-a610-cb17717c698d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:58.340132 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd058-f667-4edf-a610-cb17717c698d admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:58.340604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdd058-f667-4edf-a610-cb17717c698d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:30:58.340604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdd058-f667-4edf-a610-cb17717c698d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:58.340604 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdd058-f667-4edf-a610-cb17717c698d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:58.357567 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1097/2220] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:30:58.358471 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdd058-f667-4edf-a610-cb17717c698d admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:58.360496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a7bdd058-f667-4edf-a610-cb17717c698d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:58.361626 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903dfc9980cf4ce18fc1c06dd4f9caf2', 'request_id': 'req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:58.379976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903dfc9980cf4ce18fc1c06dd4f9caf2', 'request_id': 'req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:58.399271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:58.404460 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdd058-f667-4edf-a610-cb17717c698d admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:58.410272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4 admin admin] The token cache is being invalidate because project 903dfc9980cf4ce18fc1c06dd4f9caf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:58.410656 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:58.414779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c6e4a66c-0d12-45af-ae92-f7b58e4fcbb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:58.429256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:58.433662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:58.433662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:58.433662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] PATH_INFO: `/v3/projects/f0743d3e1cd44d39bd99e1444e9cc92c` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:58.433910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1124/2221] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:57 2022] DELETE /identity/v3/projects/903dfc9980cf4ce18fc1c06dd4f9caf2 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:58.433910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89b22d-6331-4dc5-9b77-a8c7b4f60f96 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:58.433910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89b22d-6331-4dc5-9b77-a8c7b4f60f96 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:58.434136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0743d3e1cd44d39bd99e1444e9cc92c)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:58.434215 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89b22d-6331-4dc5-9b77-a8c7b4f60f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:58.436113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:58.516778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-8f89b22d-6331-4dc5-9b77-a8c7b4f60f96 None None] MFA Rules not processed for user `21dae936bfcf462982bf8aa9275d56c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:58.518165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8f89b22d-6331-4dc5-9b77-a8c7b4f60f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:58.601078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1125/2222] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:30:58.603768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89b22d-6331-4dc5-9b77-a8c7b4f60f96 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:58.623874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8f89b22d-6331-4dc5-9b77-a8c7b4f60f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:58.631231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0743d3e1cd44d39bd99e1444e9cc92c', 'request_id': 'req-fc0d9988-a179-4395-b740-9135db0d9cc9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:58.646731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89b22d-6331-4dc5-9b77-a8c7b4f60f96 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:58.719336 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e15c68-c90a-4f4d-bf64-b44c6a660742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:58.722488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0743d3e1cd44d39bd99e1444e9cc92c', 'request_id': 'req-fc0d9988-a179-4395-b740-9135db0d9cc9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:58.733762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e15c68-c90a-4f4d-bf64-b44c6a660742 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:58.734134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e15c68-c90a-4f4d-bf64-b44c6a660742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:58.734337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e15c68-c90a-4f4d-bf64-b44c6a660742 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:58.746498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e15c68-c90a-4f4d-bf64-b44c6a660742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:58.748398 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0743d3e1cd44d39bd99e1444e9cc92c', 'request_id': 'req-fc0d9988-a179-4395-b740-9135db0d9cc9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:58.749873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e15c68-c90a-4f4d-bf64-b44c6a660742 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:58.781483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] The token cache is being invalidate because project f0743d3e1cd44d39bd99e1444e9cc92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:30:58.782016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:58.782577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:58.791347 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1098/2223] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:30:58 2022] DELETE /identity/v3/projects/f0743d3e1cd44d39bd99e1444e9cc92c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:58.792221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:58.795715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:58.820837 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d9988-a179-4395-b740-9135db0d9cc9 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:58.830843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:58.832128 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:58.832408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:58.832685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] PATH_INFO: `/v3/users/6d3830d77ea64255a2372b3a84f85515` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:58.835547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d3830d77ea64255a2372b3a84f85515)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:58.837545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:30:58.839496 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:58.854386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1126/2224] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:30:58 2022] POST /identity/v3/projects => generated 371 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:58.855880 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e15c68-c90a-4f4d-bf64-b44c6a660742 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:58.858325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-04e15c68-c90a-4f4d-bf64-b44c6a660742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:58.947023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e15c68-c90a-4f4d-bf64-b44c6a660742 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:58.951016 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284f43c-be5d-438d-adde-637d0c5ce598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:58.951681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284f43c-be5d-438d-adde-637d0c5ce598 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:58.951965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284f43c-be5d-438d-adde-637d0c5ce598 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:58.952684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284f43c-be5d-438d-adde-637d0c5ce598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:58.955107 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c284f43c-be5d-438d-adde-637d0c5ce598 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:59.027260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284f43c-be5d-438d-adde-637d0c5ce598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:59.028730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284f43c-be5d-438d-adde-637d0c5ce598 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:59.040871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1127/2225] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:30:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:30:59.042754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284f43c-be5d-438d-adde-637d0c5ce598 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:59.047328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c284f43c-be5d-438d-adde-637d0c5ce598 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:59.087877 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d3830d77ea64255a2372b3a84f85515'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:59.175889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284f43c-be5d-438d-adde-637d0c5ce598 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:59.185607 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8bbea-51c6-4f67-b732-1a90899b2bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:59.186802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8bbea-51c6-4f67-b732-1a90899b2bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:59.187203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8bbea-51c6-4f67-b732-1a90899b2bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:59.187556 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8bbea-51c6-4f67-b732-1a90899b2bb8 admin admin] PATH_INFO: `/v3/users/005e68a8a58b49c5983461025c73d172` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:59.190567 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8bbea-51c6-4f67-b732-1a90899b2bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=005e68a8a58b49c5983461025c73d172)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:59.195448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d3830d77ea64255a2372b3a84f85515'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:59.202680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8bbea-51c6-4f67-b732-1a90899b2bb8 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:59.216725 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d3830d77ea64255a2372b3a84f85515'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:59.218031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d3830d77ea64255a2372b3a84f85515'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:59.242084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d3830d77ea64255a2372b3a84f85515'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:59.254819 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1099/2226] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:58 2022] DELETE /identity/v3/users/6d3830d77ea64255a2372b3a84f85515 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:59.255772 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:59.261922 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:30:59.359488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48969183-0c9e-44b1-8cef-87b407738c0a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:59.365305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e354d0-7d5b-4c3a-aaab-5cc2970acc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:59.366216 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e354d0-7d5b-4c3a-aaab-5cc2970acc69 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:59.366895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e354d0-7d5b-4c3a-aaab-5cc2970acc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:59.367479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e354d0-7d5b-4c3a-aaab-5cc2970acc69 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:59.368392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e354d0-7d5b-4c3a-aaab-5cc2970acc69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:59.370634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e354d0-7d5b-4c3a-aaab-5cc2970acc69 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:59.520538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1100/2227] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:30:59 2022] POST /identity/v3/users => generated 286 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:30:59.522894 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e354d0-7d5b-4c3a-aaab-5cc2970acc69 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:59.541919 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e354d0-7d5b-4c3a-aaab-5cc2970acc69 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:59.551367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6396d8e-6578-499f-b129-7ec681dc2ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:59.558021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6396d8e-6578-499f-b129-7ec681dc2ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:59.560206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6396d8e-6578-499f-b129-7ec681dc2ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:59.560602 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6396d8e-6578-499f-b129-7ec681dc2ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:59.561628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6396d8e-6578-499f-b129-7ec681dc2ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:59.564526 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6396d8e-6578-499f-b129-7ec681dc2ed9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:59.602712 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-09b8bbea-51c6-4f67-b732-1a90899b2bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '005e68a8a58b49c5983461025c73d172'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:59.605463 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1101/2228] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:59.611501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6396d8e-6578-499f-b129-7ec681dc2ed9 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:59.624786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6396d8e-6578-499f-b129-7ec681dc2ed9 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:59.632179 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf86b71-ebcf-4083-96bf-824ac95466ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:59.637615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf86b71-ebcf-4083-96bf-824ac95466ab admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:59.637615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf86b71-ebcf-4083-96bf-824ac95466ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:59.637615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf86b71-ebcf-4083-96bf-824ac95466ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:59.637615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf86b71-ebcf-4083-96bf-824ac95466ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:59.638928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf86b71-ebcf-4083-96bf-824ac95466ab admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:59.652545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1102/2229] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:30:59.657804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf86b71-ebcf-4083-96bf-824ac95466ab admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:30:59.673702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf86b71-ebcf-4083-96bf-824ac95466ab admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:30:59.679970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508f543-32be-4d27-929f-51e3163c83f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:30:59.681107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508f543-32be-4d27-929f-51e3163c83f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:59.681587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508f543-32be-4d27-929f-51e3163c83f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:59.682352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508f543-32be-4d27-929f-51e3163c83f1 admin admin] PATH_INFO: `/v3/projects/dcd006535e0749be87dd6328128f9afb/users/d432c2b91af149ed8e9661292baa486a/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:59.716156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-09b8bbea-51c6-4f67-b732-1a90899b2bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '005e68a8a58b49c5983461025c73d172'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:59.716964 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-09b8bbea-51c6-4f67-b732-1a90899b2bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '005e68a8a58b49c5983461025c73d172'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:59.765731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-09b8bbea-51c6-4f67-b732-1a90899b2bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '005e68a8a58b49c5983461025c73d172'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:59.794043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508f543-32be-4d27-929f-51e3163c83f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd006535e0749be87dd6328128f9afb, user_id=d432c2b91af149ed8e9661292baa486a, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:30:59.796770 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508f543-32be-4d27-929f-51e3163c83f1 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:30:59.799826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-09b8bbea-51c6-4f67-b732-1a90899b2bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '005e68a8a58b49c5983461025c73d172'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:30:59.825074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1128/2230] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:30:59 2022] DELETE /identity/v3/users/005e68a8a58b49c5983461025c73d172 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:59.918433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1103/2231] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:30:59 2022] PUT /identity/v3/projects/dcd006535e0749be87dd6328128f9afb/users/d432c2b91af149ed8e9661292baa486a/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:30:59.937933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b0301-6538-4f48-a2aa-84321875ff9b None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:30:59.938930 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b0301-6538-4f48-a2aa-84321875ff9b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:30:59.943357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b0301-6538-4f48-a2aa-84321875ff9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:30:59.973162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-624b0301-6538-4f48-a2aa-84321875ff9b None None] MFA Rules not processed for user `d432c2b91af149ed8e9661292baa486a`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:30:59.974436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-624b0301-6538-4f48-a2aa-84321875ff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:00.080178 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1129/2232] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:30:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:00.096671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508f543-32be-4d27-929f-51e3163c83f1 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:00.098895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3508f543-32be-4d27-929f-51e3163c83f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:00.207099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:00.247997 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508f543-32be-4d27-929f-51e3163c83f1 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:00.270384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33b746-1424-4579-85f6-78a4d06b5980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:00.274758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33b746-1424-4579-85f6-78a4d06b5980 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:00.275217 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33b746-1424-4579-85f6-78a4d06b5980 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:00.275830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33b746-1424-4579-85f6-78a4d06b5980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:00.308064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33b746-1424-4579-85f6-78a4d06b5980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:00.311586 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33b746-1424-4579-85f6-78a4d06b5980 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:00.337214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1104/2233] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:31:00.359317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b0301-6538-4f48-a2aa-84321875ff9b None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:00.361683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-624b0301-6538-4f48-a2aa-84321875ff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:00.423041 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33b746-1424-4579-85f6-78a4d06b5980 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:00.425047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2e33b746-1424-4579-85f6-78a4d06b5980 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:00.508471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b0301-6538-4f48-a2aa-84321875ff9b None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:00.514354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef24ce-994d-48b6-a9cd-df811bf3566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:00.515519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef24ce-994d-48b6-a9cd-df811bf3566f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:00.515806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef24ce-994d-48b6-a9cd-df811bf3566f admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:00.516136 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef24ce-994d-48b6-a9cd-df811bf3566f admin admin] PATH_INFO: `/v3/users/d432c2b91af149ed8e9661292baa486a` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:00.517512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef24ce-994d-48b6-a9cd-df811bf3566f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d432c2b91af149ed8e9661292baa486a)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:00.519512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef24ce-994d-48b6-a9cd-df811bf3566f admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:00.564369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33b746-1424-4579-85f6-78a4d06b5980 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:00.569314 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:00.570407 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:00.570778 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:00.571126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] PATH_INFO: `/v3/projects/57b6939627264a048b1f6f2c976d32d0` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:00.572578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b6939627264a048b1f6f2c976d32d0)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:00.574571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:00.724114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b6939627264a048b1f6f2c976d32d0', 'request_id': 'req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:00.725267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-11ef24ce-994d-48b6-a9cd-df811bf3566f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd432c2b91af149ed8e9661292baa486a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:00.806100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b6939627264a048b1f6f2c976d32d0', 'request_id': 'req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:00.813887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b6939627264a048b1f6f2c976d32d0', 'request_id': 'req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:00.832048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] The token cache is being invalidate because project 57b6939627264a048b1f6f2c976d32d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:31:00.832341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:00.833208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:00.836572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1105/2234] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:31:00 2022] DELETE /identity/v3/projects/57b6939627264a048b1f6f2c976d32d0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:31:00.837595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:00.838944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:00.925989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:00.926651 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-11ef24ce-994d-48b6-a9cd-df811bf3566f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd432c2b91af149ed8e9661292baa486a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:00.927355 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-11ef24ce-994d-48b6-a9cd-df811bf3566f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd432c2b91af149ed8e9661292baa486a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:00.935601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c1c0f-6cf8-4ac3-a7f5-2f16161f4504 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:00.941746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:00.944354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-11ef24ce-994d-48b6-a9cd-df811bf3566f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd432c2b91af149ed8e9661292baa486a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:00.945747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:00.946214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:00.946584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] PATH_INFO: `/v3/projects/408a62a83e4042498f9d9bcacf0fc1bc` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:00.957137 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] RBAC: Authorizing `identity:delete_project(project_id=408a62a83e4042498f9d9bcacf0fc1bc)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:00.957137 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:00.964334 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-11ef24ce-994d-48b6-a9cd-df811bf3566f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd432c2b91af149ed8e9661292baa486a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:00.972843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1130/2235] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:31:00 2022] DELETE /identity/v3/users/d432c2b91af149ed8e9661292baa486a => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:00.974637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722965c2-5fe9-4038-8a44-d66aad9c9e8b None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:00.975696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722965c2-5fe9-4038-8a44-d66aad9c9e8b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:00.976551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722965c2-5fe9-4038-8a44-d66aad9c9e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:00.998592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-722965c2-5fe9-4038-8a44-d66aad9c9e8b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:01.000372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-722965c2-5fe9-4038-8a44-d66aad9c9e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:01.076903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1131/2236] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:01.078143 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea47a1-d031-409d-8407-16cd59e0ce73 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.078515 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea47a1-d031-409d-8407-16cd59e0ce73 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.078761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea47a1-d031-409d-8407-16cd59e0ce73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.101544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-aeea47a1-d031-409d-8407-16cd59e0ce73 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:01.102777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-aeea47a1-d031-409d-8407-16cd59e0ce73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:01.103869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408a62a83e4042498f9d9bcacf0fc1bc', 'request_id': 'req-b010e083-0a98-4802-a6bc-e4960108623e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:01.179305 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1132/2237] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:01.180762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb53f8-36db-4a3c-a733-56e1e0949954 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.181061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb53f8-36db-4a3c-a733-56e1e0949954 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.181373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb53f8-36db-4a3c-a733-56e1e0949954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.184432 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408a62a83e4042498f9d9bcacf0fc1bc', 'request_id': 'req-b010e083-0a98-4802-a6bc-e4960108623e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:01.192325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408a62a83e4042498f9d9bcacf0fc1bc', 'request_id': 'req-b010e083-0a98-4802-a6bc-e4960108623e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:01.212238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] The token cache is being invalidate because project 408a62a83e4042498f9d9bcacf0fc1bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:31:01.212819 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:01.213438 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-0ceb53f8-36db-4a3c-a733-56e1e0949954 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:01.215018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:01.215142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0ceb53f8-36db-4a3c-a733-56e1e0949954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:01.217605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1106/2238] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:31:00 2022] DELETE /identity/v3/projects/408a62a83e4042498f9d9bcacf0fc1bc => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:01.219790 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:01.220672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:01.238310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1133/2239] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:01.239651 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19339b77-55ca-48ce-a487-4a78b342fceb None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.240493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19339b77-55ca-48ce-a487-4a78b342fceb None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.240493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19339b77-55ca-48ce-a487-4a78b342fceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.271644 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-19339b77-55ca-48ce-a487-4a78b342fceb None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:01.273606 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-19339b77-55ca-48ce-a487-4a78b342fceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:01.303577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1134/2240] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:01.304976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19339b77-55ca-48ce-a487-4a78b342fceb None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:01.305363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010e083-0a98-4802-a6bc-e4960108623e admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:01.309210 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769092d-ce49-458f-bbcf-76d1665e4c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:01.310084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769092d-ce49-458f-bbcf-76d1665e4c81 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.310360 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769092d-ce49-458f-bbcf-76d1665e4c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.312921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769092d-ce49-458f-bbcf-76d1665e4c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.315652 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0769092d-ce49-458f-bbcf-76d1665e4c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:01.322502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19339b77-55ca-48ce-a487-4a78b342fceb None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:01.328216 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006aa17e-52a8-44cb-a3c4-f219a94827a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:01.328962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aa17e-52a8-44cb-a3c4-f219a94827a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.329275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769092d-ce49-458f-bbcf-76d1665e4c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:01.329428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aa17e-52a8-44cb-a3c4-f219a94827a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.331335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769092d-ce49-458f-bbcf-76d1665e4c81 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:01.337655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aa17e-52a8-44cb-a3c4-f219a94827a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.338783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006aa17e-52a8-44cb-a3c4-f219a94827a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:31:01.338783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006aa17e-52a8-44cb-a3c4-f219a94827a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:01.340173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006aa17e-52a8-44cb-a3c4-f219a94827a8 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:01.347654 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1107/2241] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:31:01.348803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e06bd-d3ce-4b53-98cc-eab1046c08dc None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.349090 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e06bd-d3ce-4b53-98cc-eab1046c08dc None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.349397 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e06bd-d3ce-4b53-98cc-eab1046c08dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.366220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1135/2242] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:31:01.367676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03b4b7-11a3-44bd-a13d-d6e085e728c2 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.367903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03b4b7-11a3-44bd-a13d-d6e085e728c2 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.368185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03b4b7-11a3-44bd-a13d-d6e085e728c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.388322 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-5a03b4b7-11a3-44bd-a13d-d6e085e728c2 None None] MFA Rules not processed for user `21dae936bfcf462982bf8aa9275d56c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:01.389611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-5a03b4b7-11a3-44bd-a13d-d6e085e728c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:01.409016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-232e06bd-d3ce-4b53-98cc-eab1046c08dc None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:01.410616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-232e06bd-d3ce-4b53-98cc-eab1046c08dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:01.431630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1108/2243] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:01.436628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e06bd-d3ce-4b53-98cc-eab1046c08dc None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:01.448265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e06bd-d3ce-4b53-98cc-eab1046c08dc None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:01.460467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97229c97-02a0-4814-8529-38d502eb16ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:01.465446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97229c97-02a0-4814-8529-38d502eb16ec admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.465816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97229c97-02a0-4814-8529-38d502eb16ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.466184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97229c97-02a0-4814-8529-38d502eb16ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.467489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97229c97-02a0-4814-8529-38d502eb16ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:01.470736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97229c97-02a0-4814-8529-38d502eb16ec admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:01.480424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1136/2244] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:01.486445 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03b4b7-11a3-44bd-a13d-d6e085e728c2 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:01.500258 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03b4b7-11a3-44bd-a13d-d6e085e728c2 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:01.505808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6f997-6397-4ddb-936c-56c6653ab6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:01.506601 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6f997-6397-4ddb-936c-56c6653ab6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.506986 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6f997-6397-4ddb-936c-56c6653ab6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.507381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6f997-6397-4ddb-936c-56c6653ab6a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.508473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6f997-6397-4ddb-936c-56c6653ab6a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:31:01.508883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6f997-6397-4ddb-936c-56c6653ab6a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:01.510740 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6f997-6397-4ddb-936c-56c6653ab6a5 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:01.531188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1137/2245] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:31:01.532370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6f997-6397-4ddb-936c-56c6653ab6a5 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:01.543252 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6f997-6397-4ddb-936c-56c6653ab6a5 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:01.551434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e5b49-76a6-4d16-8f48-814c63b9147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:01.552715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e5b49-76a6-4d16-8f48-814c63b9147a admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.553099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e5b49-76a6-4d16-8f48-814c63b9147a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.553520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e5b49-76a6-4d16-8f48-814c63b9147a admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.555034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e5b49-76a6-4d16-8f48-814c63b9147a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:01.557233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e5b49-76a6-4d16-8f48-814c63b9147a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:01.624115 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1109/2246] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:31:01 2022] POST /identity/v3/projects => generated 399 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:31:01.625150 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97229c97-02a0-4814-8529-38d502eb16ec admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:01.648336 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1138/2247] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:31:01 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:31:01.653413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e5b49-76a6-4d16-8f48-814c63b9147a admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:01.733329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:01.773698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97229c97-02a0-4814-8529-38d502eb16ec admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:01.775792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e5b49-76a6-4d16-8f48-814c63b9147a admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:01.780947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e81c1-3695-4054-9457-6480e913cda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:01.781106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c02e21-6ba3-40ce-ab13-830dc7c3c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:01.781685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02e21-6ba3-40ce-ab13-830dc7c3c113 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.781981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02e21-6ba3-40ce-ab13-830dc7c3c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.782501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e81c1-3695-4054-9457-6480e913cda3 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.783179 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e81c1-3695-4054-9457-6480e913cda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.783644 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e81c1-3695-4054-9457-6480e913cda3 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.784537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e81c1-3695-4054-9457-6480e913cda3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:01.787434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e81c1-3695-4054-9457-6480e913cda3 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:01.788846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02e21-6ba3-40ce-ab13-830dc7c3c113 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.799140 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c02e21-6ba3-40ce-ab13-830dc7c3c113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:01.801236 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c02e21-6ba3-40ce-ab13-830dc7c3c113 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:01.833924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:01.915549 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1110/2248] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:31:01 2022] POST /identity/v3/users => generated 300 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:31:01.916797 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e81c1-3695-4054-9457-6480e913cda3 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:01.935170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e81c1-3695-4054-9457-6480e913cda3 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:01.940230 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1139/2249] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:31:01 2022] POST /identity/v3/users => generated 288 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:31:01.943309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc6a6-1713-4320-a890-57a2cb869518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:01.943579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c02e21-6ba3-40ce-ab13-830dc7c3c113 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:01.944513 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc6a6-1713-4320-a890-57a2cb869518 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.945026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc6a6-1713-4320-a890-57a2cb869518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.945532 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc6a6-1713-4320-a890-57a2cb869518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.946691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6dc6a6-1713-4320-a890-57a2cb869518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:01.949053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6dc6a6-1713-4320-a890-57a2cb869518 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:01.967776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c02e21-6ba3-40ce-ab13-830dc7c3c113 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:01.980330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2612c78-9a3f-4eab-acaf-609da980b687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:01.981003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2612c78-9a3f-4eab-acaf-609da980b687 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:01.981323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2612c78-9a3f-4eab-acaf-609da980b687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:01.981605 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2612c78-9a3f-4eab-acaf-609da980b687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:01.983117 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2612c78-9a3f-4eab-acaf-609da980b687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:01.984244 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2612c78-9a3f-4eab-acaf-609da980b687 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:02.002544 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1111/2250] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:02.007916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc6a6-1713-4320-a890-57a2cb869518 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:02.057475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1140/2251] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:02.058879 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2612c78-9a3f-4eab-acaf-609da980b687 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:02.063874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc6a6-1713-4320-a890-57a2cb869518 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:02.077999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305e309-cdd9-402a-b710-4bf08425dcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:02.078651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e309-cdd9-402a-b710-4bf08425dcc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:02.078949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e309-cdd9-402a-b710-4bf08425dcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:02.079605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e309-cdd9-402a-b710-4bf08425dcc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:02.080361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305e309-cdd9-402a-b710-4bf08425dcc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:02.082003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2612c78-9a3f-4eab-acaf-609da980b687 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:02.085235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305e309-cdd9-402a-b710-4bf08425dcc5 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:02.088873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1557a-99c7-4966-8881-be5397074eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:02.090835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1557a-99c7-4966-8881-be5397074eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:02.100806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1557a-99c7-4966-8881-be5397074eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:02.100806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1557a-99c7-4966-8881-be5397074eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:02.100806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1557a-99c7-4966-8881-be5397074eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:02.100806 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1557a-99c7-4966-8881-be5397074eaa admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:02.115135 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1141/2252] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:02.119837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1557a-99c7-4966-8881-be5397074eaa admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:02.121172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1112/2253] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:02.125876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305e309-cdd9-402a-b710-4bf08425dcc5 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:02.126056 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:02.140324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1557a-99c7-4966-8881-be5397074eaa admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:02.143334 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305e309-cdd9-402a-b710-4bf08425dcc5 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:02.147281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cf4d9-245c-4bf0-b3a8-f034c4188891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:02.148375 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cf4d9-245c-4bf0-b3a8-f034c4188891 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:02.149474 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cf4d9-245c-4bf0-b3a8-f034c4188891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:02.149638 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:02.150081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cf4d9-245c-4bf0-b3a8-f034c4188891 admin admin] PATH_INFO: `/v3/projects/8ec1a6173ded4173baf166fb9a6f1dfd/users/d8346d0369ea47a3bb90fba22a737579/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:02.158467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cee01f-210b-4cc0-9c21-f11fe8c797a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:02.159471 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cee01f-210b-4cc0-9c21-f11fe8c797a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:02.159708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cee01f-210b-4cc0-9c21-f11fe8c797a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:02.160283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cee01f-210b-4cc0-9c21-f11fe8c797a9 admin admin] PATH_INFO: `/v3/projects/a97f923d8eb949f38c44932f88339e86/users/a0c4b09d8e2046c3a6d37ed2c0f94f2c/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:02.182556 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cf4d9-245c-4bf0-b3a8-f034c4188891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec1a6173ded4173baf166fb9a6f1dfd, user_id=d8346d0369ea47a3bb90fba22a737579, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:02.187607 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cf4d9-245c-4bf0-b3a8-f034c4188891 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:02.193867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cee01f-210b-4cc0-9c21-f11fe8c797a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97f923d8eb949f38c44932f88339e86, user_id=a0c4b09d8e2046c3a6d37ed2c0f94f2c, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:02.207008 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cee01f-210b-4cc0-9c21-f11fe8c797a9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:02.291222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1113/2254] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:31:02 2022] PUT /identity/v3/projects/a97f923d8eb949f38c44932f88339e86/users/a0c4b09d8e2046c3a6d37ed2c0f94f2c/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:31:02.302190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1142/2255] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:31:02 2022] PUT /identity/v3/projects/8ec1a6173ded4173baf166fb9a6f1dfd/users/d8346d0369ea47a3bb90fba22a737579/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:02.306032 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cee01f-210b-4cc0-9c21-f11fe8c797a9 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:02.308009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7d8f0-1758-40b2-8a61-605a8941c825 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:02.308155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7d8f0-1758-40b2-8a61-605a8941c825 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:02.308730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7d8f0-1758-40b2-8a61-605a8941c825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:02.318336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-10cee01f-210b-4cc0-9c21-f11fe8c797a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:02.340129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:02.390207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:02.392420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-09e7d8f0-1758-40b2-8a61-605a8941c825 None None] MFA Rules not processed for user `a0c4b09d8e2046c3a6d37ed2c0f94f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:02.395562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-09e7d8f0-1758-40b2-8a61-605a8941c825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:02.421434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cee01f-210b-4cc0-9c21-f11fe8c797a9 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:02.496682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:02.497716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:02.498118 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:02.498408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] PATH_INFO: `/v3/projects/dcd006535e0749be87dd6328128f9afb` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:02.499644 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd006535e0749be87dd6328128f9afb)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:02.501777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:02.507563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1143/2256] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:02.509236 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae6787-92a4-4ead-9e4d-c3213e4b7649 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:02.509750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae6787-92a4-4ead-9e4d-c3213e4b7649 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:02.510660 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae6787-92a4-4ead-9e4d-c3213e4b7649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:02.542860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-b4ae6787-92a4-4ead-9e4d-c3213e4b7649 None None] MFA Rules not processed for user `d8346d0369ea47a3bb90fba22a737579`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:02.544171 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b4ae6787-92a4-4ead-9e4d-c3213e4b7649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:02.776161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1144/2257] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:02.776161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae6787-92a4-4ead-9e4d-c3213e4b7649 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:02.776374 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd006535e0749be87dd6328128f9afb', 'request_id': 'req-805b429f-c167-4875-ad5f-6be1391d2a90'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:02.776845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b4ae6787-92a4-4ead-9e4d-c3213e4b7649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:02.795548 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:02.878631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd006535e0749be87dd6328128f9afb', 'request_id': 'req-805b429f-c167-4875-ad5f-6be1391d2a90'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:02.887988 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd006535e0749be87dd6328128f9afb', 'request_id': 'req-805b429f-c167-4875-ad5f-6be1391d2a90'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:02.891729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae6787-92a4-4ead-9e4d-c3213e4b7649 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:02.906742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:02.937108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] The token cache is being invalidate because project dcd006535e0749be87dd6328128f9afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:31:02.940032 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:02.940032 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:02.940704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1114/2258] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:31:02 2022] DELETE /identity/v3/projects/dcd006535e0749be87dd6328128f9afb => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:02.950782 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:02.967629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:02.986894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fff9c-d93d-482a-bcb7-30e58e0b25d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:02.988353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fff9c-d93d-482a-bcb7-30e58e0b25d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:02.988903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fff9c-d93d-482a-bcb7-30e58e0b25d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:02.989433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fff9c-d93d-482a-bcb7-30e58e0b25d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:02.993339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9b3fff9c-d93d-482a-bcb7-30e58e0b25d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:03.086147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fff9c-d93d-482a-bcb7-30e58e0b25d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:03.088832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fff9c-d93d-482a-bcb7-30e58e0b25d3 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:03.099842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b429f-c167-4875-ad5f-6be1391d2a90 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:03.106923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697293a1-9256-4005-9a32-60ca17dae858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:03.107673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697293a1-9256-4005-9a32-60ca17dae858 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:03.120860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697293a1-9256-4005-9a32-60ca17dae858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:03.120860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697293a1-9256-4005-9a32-60ca17dae858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:03.120860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697293a1-9256-4005-9a32-60ca17dae858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:03.120860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697293a1-9256-4005-9a32-60ca17dae858 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:03.122056 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1145/2259] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:31:03.219107 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:03.253398 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1115/2260] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:31:02 2022] POST /identity/v3/projects => generated 373 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:31:03.257221 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fff9c-d93d-482a-bcb7-30e58e0b25d3 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:03.275897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fff9c-d93d-482a-bcb7-30e58e0b25d3 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:03.382082 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc3c41-414d-4681-a056-ad50ba3ae296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:03.382784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc3c41-414d-4681-a056-ad50ba3ae296 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:03.383210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc3c41-414d-4681-a056-ad50ba3ae296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:03.384361 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc3c41-414d-4681-a056-ad50ba3ae296 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:03.385451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc3c41-414d-4681-a056-ad50ba3ae296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:03.387987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc3c41-414d-4681-a056-ad50ba3ae296 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:03.496144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1146/2261] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:31:03 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:31:03.502081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697293a1-9256-4005-9a32-60ca17dae858 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:03.517223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697293a1-9256-4005-9a32-60ca17dae858 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:03.522754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17daab-d08d-42a0-8f85-43dac8ee1aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:03.527867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17daab-d08d-42a0-8f85-43dac8ee1aba admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:03.527867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17daab-d08d-42a0-8f85-43dac8ee1aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:03.527867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17daab-d08d-42a0-8f85-43dac8ee1aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:03.527867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17daab-d08d-42a0-8f85-43dac8ee1aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:03.527867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17daab-d08d-42a0-8f85-43dac8ee1aba admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:03.541418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1116/2262] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:03.542862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc3c41-414d-4681-a056-ad50ba3ae296 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:03.560846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc3c41-414d-4681-a056-ad50ba3ae296 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:03.567071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40affbc5-2bfe-43f9-8b79-aa6ee067e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:03.568428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40affbc5-2bfe-43f9-8b79-aa6ee067e0be admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:03.568929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40affbc5-2bfe-43f9-8b79-aa6ee067e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:03.569306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40affbc5-2bfe-43f9-8b79-aa6ee067e0be admin admin] PATH_INFO: `/v3/projects/a2e3ee5218c746aab4cdea11079f4f37/users/4918249fdff24b3e96b29aec2663b6cb/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:03.592343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40affbc5-2bfe-43f9-8b79-aa6ee067e0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e3ee5218c746aab4cdea11079f4f37, user_id=4918249fdff24b3e96b29aec2663b6cb, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:03.597303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40affbc5-2bfe-43f9-8b79-aa6ee067e0be admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:03.721347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1147/2263] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:31:03 2022] PUT /identity/v3/projects/a2e3ee5218c746aab4cdea11079f4f37/users/4918249fdff24b3e96b29aec2663b6cb/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:31:03.723137 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17daab-d08d-42a0-8f85-43dac8ee1aba admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:03.730009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:03.751085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17daab-d08d-42a0-8f85-43dac8ee1aba admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:03.858475 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac4d68-f08c-4d6b-8127-73584b10b247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:03.860420 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac4d68-f08c-4d6b-8127-73584b10b247 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:03.861004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac4d68-f08c-4d6b-8127-73584b10b247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:03.861511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac4d68-f08c-4d6b-8127-73584b10b247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:03.862773 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac4d68-f08c-4d6b-8127-73584b10b247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:03.864808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac4d68-f08c-4d6b-8127-73584b10b247 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:03.878998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1117/2264] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:03.882911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40affbc5-2bfe-43f9-8b79-aa6ee067e0be admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:03.898490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40affbc5-2bfe-43f9-8b79-aa6ee067e0be admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:03.905059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f80f02-b177-4ee1-934a-cf86cabe807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:03.907363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f80f02-b177-4ee1-934a-cf86cabe807c admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:03.908434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f80f02-b177-4ee1-934a-cf86cabe807c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:03.908885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f80f02-b177-4ee1-934a-cf86cabe807c admin admin] PATH_INFO: `/v3/projects/a2e3ee5218c746aab4cdea11079f4f37/users/4918249fdff24b3e96b29aec2663b6cb/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:03.911133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f80f02-b177-4ee1-934a-cf86cabe807c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e3ee5218c746aab4cdea11079f4f37, user_id=4918249fdff24b3e96b29aec2663b6cb, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:03.914172 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f80f02-b177-4ee1-934a-cf86cabe807c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:03.926073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1148/2265] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:31:03 2022] PUT /identity/v3/projects/a2e3ee5218c746aab4cdea11079f4f37/users/4918249fdff24b3e96b29aec2663b6cb/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:03.936507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24800-85fa-43e5-bc10-4c1c92a5ce70 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:03.936981 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24800-85fa-43e5-bc10-4c1c92a5ce70 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:03.937572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24800-85fa-43e5-bc10-4c1c92a5ce70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:03.975462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-08f24800-85fa-43e5-bc10-4c1c92a5ce70 None None] MFA Rules not processed for user `4918249fdff24b3e96b29aec2663b6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:03.976970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-08f24800-85fa-43e5-bc10-4c1c92a5ce70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:04.055259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1118/2266] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:04.066329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f80f02-b177-4ee1-934a-cf86cabe807c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:04.071239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e8f80f02-b177-4ee1-934a-cf86cabe807c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:04.160384 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:04.202218 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f80f02-b177-4ee1-934a-cf86cabe807c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:04.220432 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28dfb6-7220-48b3-81f0-50739cf06b98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:04.221337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28dfb6-7220-48b3-81f0-50739cf06b98 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:04.221713 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28dfb6-7220-48b3-81f0-50739cf06b98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:04.222050 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28dfb6-7220-48b3-81f0-50739cf06b98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:04.226898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-da28dfb6-7220-48b3-81f0-50739cf06b98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:04.312045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28dfb6-7220-48b3-81f0-50739cf06b98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:04.316436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28dfb6-7220-48b3-81f0-50739cf06b98 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:04.324989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1149/2267] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:31:07.671016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24800-85fa-43e5-bc10-4c1c92a5ce70 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:07.771112 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24800-85fa-43e5-bc10-4c1c92a5ce70 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:07.779729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:07.787077 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:07.787077 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:07.787077 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] PATH_INFO: `/v3/users/d8346d0369ea47a3bb90fba22a737579` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:07.791793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8346d0369ea47a3bb90fba22a737579)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:07.795388 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:07.974193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:08.096629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8346d0369ea47a3bb90fba22a737579'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:08.177964 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8346d0369ea47a3bb90fba22a737579'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:08.197520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8346d0369ea47a3bb90fba22a737579'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:08.198441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8346d0369ea47a3bb90fba22a737579'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:08.214582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8346d0369ea47a3bb90fba22a737579'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:08.228261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1119/2268] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:31:07 2022] DELETE /identity/v3/users/d8346d0369ea47a3bb90fba22a737579 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:08.230057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a147-b045-4f2c-b8cd-4806bebca13e None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:08.230540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a147-b045-4f2c-b8cd-4806bebca13e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:08.231318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a147-b045-4f2c-b8cd-4806bebca13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:08.257401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-4338a147-b045-4f2c-b8cd-4806bebca13e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:08.259929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4338a147-b045-4f2c-b8cd-4806bebca13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:08.357992 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1150/2269] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:08.368182 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:08.370480 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:08.536847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec5008-d0f5-4d81-be20-771fcb212c4a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:08.557364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aeab04-74a1-4129-ac70-0d3862dbfe8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:08.558289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aeab04-74a1-4129-ac70-0d3862dbfe8d service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:08.558751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aeab04-74a1-4129-ac70-0d3862dbfe8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:08.559185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aeab04-74a1-4129-ac70-0d3862dbfe8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:08.588724 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aeab04-74a1-4129-ac70-0d3862dbfe8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:08.590494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aeab04-74a1-4129-ac70-0d3862dbfe8d service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:08.604196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1120/2270] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:31:09.374355 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338a147-b045-4f2c-b8cd-4806bebca13e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:09.376666 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4338a147-b045-4f2c-b8cd-4806bebca13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:09.402214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338a147-b045-4f2c-b8cd-4806bebca13e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:09.428199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:09.428988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:09.429309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:09.429594 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] PATH_INFO: `/v3/projects/8ec1a6173ded4173baf166fb9a6f1dfd` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:09.433005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec1a6173ded4173baf166fb9a6f1dfd)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:09.435288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:09.597175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec1a6173ded4173baf166fb9a6f1dfd', 'request_id': 'req-81ab061f-0d3c-4ddb-89bd-5533266b9773'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:09.646836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aeab04-74a1-4129-ac70-0d3862dbfe8d service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:09.649085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b1aeab04-74a1-4129-ac70-0d3862dbfe8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:09.668611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aeab04-74a1-4129-ac70-0d3862dbfe8d service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:09.713239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec1a6173ded4173baf166fb9a6f1dfd', 'request_id': 'req-81ab061f-0d3c-4ddb-89bd-5533266b9773'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:09.722371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec1a6173ded4173baf166fb9a6f1dfd', 'request_id': 'req-81ab061f-0d3c-4ddb-89bd-5533266b9773'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:09.747551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] The token cache is being invalidate because project 8ec1a6173ded4173baf166fb9a6f1dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:31:09.748476 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:09.756738 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:09.761450 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1151/2271] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:31:09 2022] DELETE /identity/v3/projects/8ec1a6173ded4173baf166fb9a6f1dfd => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:09.764453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:09.766181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:09.826501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:09.886400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab061f-0d3c-4ddb-89bd-5533266b9773 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:09.893834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e1da2-bac3-4750-9e1f-9a64a23a58c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:09.894738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1da2-bac3-4750-9e1f-9a64a23a58c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:09.895095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1da2-bac3-4750-9e1f-9a64a23a58c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:09.895377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1da2-bac3-4750-9e1f-9a64a23a58c7 admin admin] PATH_INFO: `/v3/users/a0c4b09d8e2046c3a6d37ed2c0f94f2c` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:09.906869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e1da2-bac3-4750-9e1f-9a64a23a58c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c4b09d8e2046c3a6d37ed2c0f94f2c)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:09.910690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e1da2-bac3-4750-9e1f-9a64a23a58c7 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:09.917328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:09.918588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:09.918876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:09.919160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] PATH_INFO: `/v3/users/4918249fdff24b3e96b29aec2663b6cb` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:09.926257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4918249fdff24b3e96b29aec2663b6cb)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:09.929278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:10.152012 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-531e1da2-bac3-4750-9e1f-9a64a23a58c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c4b09d8e2046c3a6d37ed2c0f94f2c'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:10.160800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:10.178170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4918249fdff24b3e96b29aec2663b6cb'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:10.275383 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-531e1da2-bac3-4750-9e1f-9a64a23a58c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c4b09d8e2046c3a6d37ed2c0f94f2c'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:10.296592 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-531e1da2-bac3-4750-9e1f-9a64a23a58c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c4b09d8e2046c3a6d37ed2c0f94f2c'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:10.301244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-531e1da2-bac3-4750-9e1f-9a64a23a58c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c4b09d8e2046c3a6d37ed2c0f94f2c'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:10.308269 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-531e1da2-bac3-4750-9e1f-9a64a23a58c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c4b09d8e2046c3a6d37ed2c0f94f2c'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:10.332739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1121/2272] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:31:09 2022] DELETE /identity/v3/users/a0c4b09d8e2046c3a6d37ed2c0f94f2c => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:10.336373 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc713e-da7e-47ad-9355-b03e98921578 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:10.336373 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc713e-da7e-47ad-9355-b03e98921578 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:10.336373 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc713e-da7e-47ad-9355-b03e98921578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:10.356633 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-14dc713e-da7e-47ad-9355-b03e98921578 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:10.359431 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-14dc713e-da7e-47ad-9355-b03e98921578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:10.359613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4918249fdff24b3e96b29aec2663b6cb'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:10.359613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4918249fdff24b3e96b29aec2663b6cb'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:10.405961 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4918249fdff24b3e96b29aec2663b6cb'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:10.418109 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4918249fdff24b3e96b29aec2663b6cb'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:10.430347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1152/2273] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:31:09 2022] DELETE /identity/v3/users/4918249fdff24b3e96b29aec2663b6cb => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:10.494799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1122/2274] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:10.499371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:10.501628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:10.647136 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e41bca-e989-4da3-ad58-e21036b62f76 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:10.659520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fd078-d50e-4996-8cbb-37c0ce6407ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:10.660236 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fd078-d50e-4996-8cbb-37c0ce6407ef service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:10.660525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fd078-d50e-4996-8cbb-37c0ce6407ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:10.660803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fd078-d50e-4996-8cbb-37c0ce6407ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:10.720654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:10.737527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fd078-d50e-4996-8cbb-37c0ce6407ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:10.739797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fd078-d50e-4996-8cbb-37c0ce6407ef service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:10.751211 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1153/2275] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:31:11.233598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc713e-da7e-47ad-9355-b03e98921578 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:11.234825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-14dc713e-da7e-47ad-9355-b03e98921578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:11.250687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc713e-da7e-47ad-9355-b03e98921578 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:11.264531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70264901-e95b-40c7-9565-d7fc92ae8876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:11.265737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70264901-e95b-40c7-9565-d7fc92ae8876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:11.266189 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70264901-e95b-40c7-9565-d7fc92ae8876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:11.266638 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70264901-e95b-40c7-9565-d7fc92ae8876 admin admin] PATH_INFO: `/v3/projects/a2e3ee5218c746aab4cdea11079f4f37` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:11.268194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70264901-e95b-40c7-9565-d7fc92ae8876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e3ee5218c746aab4cdea11079f4f37)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:11.270514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70264901-e95b-40c7-9565-d7fc92ae8876 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:11.326309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fd078-d50e-4996-8cbb-37c0ce6407ef service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:11.328086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ae1fd078-d50e-4996-8cbb-37c0ce6407ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:11.342786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fd078-d50e-4996-8cbb-37c0ce6407ef service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:11.351028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:11.352513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:11.352865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:11.353256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0 admin admin] PATH_INFO: `/v3/projects/a97f923d8eb949f38c44932f88339e86` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:11.354582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97f923d8eb949f38c44932f88339e86)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:11.356661 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:11.419081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-70264901-e95b-40c7-9565-d7fc92ae8876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e3ee5218c746aab4cdea11079f4f37', 'request_id': 'req-70264901-e95b-40c7-9565-d7fc92ae8876'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:11.486028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-70264901-e95b-40c7-9565-d7fc92ae8876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e3ee5218c746aab4cdea11079f4f37', 'request_id': 'req-70264901-e95b-40c7-9565-d7fc92ae8876'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:11.494483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-70264901-e95b-40c7-9565-d7fc92ae8876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e3ee5218c746aab4cdea11079f4f37', 'request_id': 'req-70264901-e95b-40c7-9565-d7fc92ae8876'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:11.515395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-70264901-e95b-40c7-9565-d7fc92ae8876 admin admin] The token cache is being invalidate because project a2e3ee5218c746aab4cdea11079f4f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:31:11.523008 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-70264901-e95b-40c7-9565-d7fc92ae8876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:11.523008 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-70264901-e95b-40c7-9565-d7fc92ae8876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:11.523008 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1123/2276] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:31:11 2022] DELETE /identity/v3/projects/a2e3ee5218c746aab4cdea11079f4f37 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:11.525847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744db4f-7651-428e-965d-631ba0ce1ec9 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:11.526223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744db4f-7651-428e-965d-631ba0ce1ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:11.526547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744db4f-7651-428e-965d-631ba0ce1ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:11.526786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97f923d8eb949f38c44932f88339e86', 'request_id': 'req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:11.559996 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a744db4f-7651-428e-965d-631ba0ce1ec9 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:11.561247 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a744db4f-7651-428e-965d-631ba0ce1ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:11.599996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97f923d8eb949f38c44932f88339e86', 'request_id': 'req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:11.606543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97f923d8eb949f38c44932f88339e86', 'request_id': 'req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:11.621248 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0 admin admin] The token cache is being invalidate because project a97f923d8eb949f38c44932f88339e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:31:11.621808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:11.622970 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-668266ce-4ed4-4c51-b2ce-bd1fefb61cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:11.625648 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1154/2277] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:31:11 2022] DELETE /identity/v3/projects/a97f923d8eb949f38c44932f88339e86 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:11.627918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:11.636361 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9a0d-c52a-4c7d-ab02-872a48d276ae None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:11.636733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9a0d-c52a-4c7d-ab02-872a48d276ae None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:11.637144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9a0d-c52a-4c7d-ab02-872a48d276ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:11.649152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1124/2278] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:31:11.659311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909007d0-042a-414e-8eee-77e946f2cab4 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:11.659906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909007d0-042a-414e-8eee-77e946f2cab4 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:11.660408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909007d0-042a-414e-8eee-77e946f2cab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:11.664113 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-198f9a0d-c52a-4c7d-ab02-872a48d276ae None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:11.665467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-198f9a0d-c52a-4c7d-ab02-872a48d276ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:11.677981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1155/2279] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:31:11.685659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc15c-3592-4917-b561-26106a0df518 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:11.685956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc15c-3592-4917-b561-26106a0df518 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:11.686243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc15c-3592-4917-b561-26106a0df518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:11.688973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-909007d0-042a-414e-8eee-77e946f2cab4 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:11.690577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-909007d0-042a-414e-8eee-77e946f2cab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:11.706011 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1125/2280] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:11.706225 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e68fc15c-3592-4917-b561-26106a0df518 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:11.707131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909007d0-042a-414e-8eee-77e946f2cab4 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:11.707322 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e68fc15c-3592-4917-b561-26106a0df518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:11.716338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1156/2281] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:31:11.717396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909007d0-042a-414e-8eee-77e946f2cab4 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:11.722195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fc15c-3592-4917-b561-26106a0df518 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:11.724687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7e10-c406-489f-9c9d-f3b253e71836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:11.725509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7e10-c406-489f-9c9d-f3b253e71836 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:11.725858 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7e10-c406-489f-9c9d-f3b253e71836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:11.726135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7e10-c406-489f-9c9d-f3b253e71836 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:11.726928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec7e10-c406-489f-9c9d-f3b253e71836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:31:11.727244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec7e10-c406-489f-9c9d-f3b253e71836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:11.729826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec7e10-c406-489f-9c9d-f3b253e71836 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:11.741103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fc15c-3592-4917-b561-26106a0df518 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:11.753715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1126/2282] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:31:11.753715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7e10-c406-489f-9c9d-f3b253e71836 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:11.759078 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406414-1d63-4c70-9df2-61f28685ce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:11.759802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406414-1d63-4c70-9df2-61f28685ce69 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:11.760092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406414-1d63-4c70-9df2-61f28685ce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:11.760367 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406414-1d63-4c70-9df2-61f28685ce69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:11.761130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a406414-1d63-4c70-9df2-61f28685ce69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:31:11.761454 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a406414-1d63-4c70-9df2-61f28685ce69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:11.763128 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a406414-1d63-4c70-9df2-61f28685ce69 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:11.764553 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7e10-c406-489f-9c9d-f3b253e71836 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:11.772480 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a5780-a618-4f5e-8f97-e29db6b90a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:11.773352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a5780-a618-4f5e-8f97-e29db6b90a8d admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:11.773781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a5780-a618-4f5e-8f97-e29db6b90a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:11.774236 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a5780-a618-4f5e-8f97-e29db6b90a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:11.774931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a5780-a618-4f5e-8f97-e29db6b90a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:11.776986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a5780-a618-4f5e-8f97-e29db6b90a8d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:11.781254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1157/2283] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:31:11.783339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406414-1d63-4c70-9df2-61f28685ce69 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:11.794978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406414-1d63-4c70-9df2-61f28685ce69 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:11.802860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f68e17-67af-41c2-ac88-3c3d2e4ac364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:11.803559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f68e17-67af-41c2-ac88-3c3d2e4ac364 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:11.803845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f68e17-67af-41c2-ac88-3c3d2e4ac364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:11.804123 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f68e17-67af-41c2-ac88-3c3d2e4ac364 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:11.808804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f68e17-67af-41c2-ac88-3c3d2e4ac364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:11.808804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f68e17-67af-41c2-ac88-3c3d2e4ac364 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:11.868281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1127/2284] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:31:11 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:31:11.869680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a5780-a618-4f5e-8f97-e29db6b90a8d admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:11.901450 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1158/2285] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:31:11 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:31:11.917752 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f68e17-67af-41c2-ac88-3c3d2e4ac364 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:11.971047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a5780-a618-4f5e-8f97-e29db6b90a8d admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:11.999063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f68e17-67af-41c2-ac88-3c3d2e4ac364 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:12.004920 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16503888-8422-4e16-9f3b-ae08c3b5c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:12.007332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16503888-8422-4e16-9f3b-ae08c3b5c29b admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:12.007332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16503888-8422-4e16-9f3b-ae08c3b5c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:12.007332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16503888-8422-4e16-9f3b-ae08c3b5c29b admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:12.007332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16503888-8422-4e16-9f3b-ae08c3b5c29b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:12.021940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16503888-8422-4e16-9f3b-ae08c3b5c29b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:12.057458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01265e-e833-4134-a844-b6af1134d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:12.058149 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01265e-e833-4134-a844-b6af1134d907 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:12.058435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01265e-e833-4134-a844-b6af1134d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:12.058713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01265e-e833-4134-a844-b6af1134d907 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:12.059486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01265e-e833-4134-a844-b6af1134d907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:12.061465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01265e-e833-4134-a844-b6af1134d907 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:12.162665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1159/2286] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:31:11 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:31:12.162665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16503888-8422-4e16-9f3b-ae08c3b5c29b admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:12.165359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16503888-8422-4e16-9f3b-ae08c3b5c29b admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:12.170634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254552a0-f119-43f1-80fc-e6bf79a5c8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:12.171637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254552a0-f119-43f1-80fc-e6bf79a5c8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:12.172095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254552a0-f119-43f1-80fc-e6bf79a5c8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:12.172535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254552a0-f119-43f1-80fc-e6bf79a5c8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:12.173981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254552a0-f119-43f1-80fc-e6bf79a5c8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:12.175902 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254552a0-f119-43f1-80fc-e6bf79a5c8d2 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:12.191915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1128/2287] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:31:11 2022] POST /identity/v3/users => generated 287 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:31:12.192678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1160/2288] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:31:12.196887 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254552a0-f119-43f1-80fc-e6bf79a5c8d2 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:12.197640 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01265e-e833-4134-a844-b6af1134d907 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:12.206608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:12.209391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01265e-e833-4134-a844-b6af1134d907 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:12.214318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254552a0-f119-43f1-80fc-e6bf79a5c8d2 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:12.214691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bdc29-4935-47e9-a3fa-4a972d25cb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:12.215705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bdc29-4935-47e9-a3fa-4a972d25cb86 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:12.216298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bdc29-4935-47e9-a3fa-4a972d25cb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:12.216667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bdc29-4935-47e9-a3fa-4a972d25cb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:12.217622 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bdc29-4935-47e9-a3fa-4a972d25cb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:12.220038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bdc29-4935-47e9-a3fa-4a972d25cb86 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:12.222686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5dcd3-a19a-4246-8c8b-f3d539c5cc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:12.223939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5dcd3-a19a-4246-8c8b-f3d539c5cc08 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:12.224220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5dcd3-a19a-4246-8c8b-f3d539c5cc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:12.224509 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5dcd3-a19a-4246-8c8b-f3d539c5cc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:12.225304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5dcd3-a19a-4246-8c8b-f3d539c5cc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:12.227758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5dcd3-a19a-4246-8c8b-f3d539c5cc08 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:12.236696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1129/2289] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:12.241274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bdc29-4935-47e9-a3fa-4a972d25cb86 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:12.244043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1161/2290] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:12.248611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5dcd3-a19a-4246-8c8b-f3d539c5cc08 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:12.260142 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bdc29-4935-47e9-a3fa-4a972d25cb86 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:12.268649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74d4cf-8b65-4d44-8b86-b734f9b5ec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:12.268649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74d4cf-8b65-4d44-8b86-b734f9b5ec9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:12.268649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74d4cf-8b65-4d44-8b86-b734f9b5ec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:12.268930 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5dcd3-a19a-4246-8c8b-f3d539c5cc08 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:12.269023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74d4cf-8b65-4d44-8b86-b734f9b5ec9f admin admin] PATH_INFO: `/v3/projects/e1701b12b86645c482964c83f5cf7cc7/users/69b42355f861405898d6c4af8f24a75a/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:12.275604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc2bc3-0f3e-4602-add2-1e44dcc33e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:12.276389 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc2bc3-0f3e-4602-add2-1e44dcc33e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:12.276678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc2bc3-0f3e-4602-add2-1e44dcc33e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:12.276958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc2bc3-0f3e-4602-add2-1e44dcc33e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:12.278473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc2bc3-0f3e-4602-add2-1e44dcc33e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:12.280084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc2bc3-0f3e-4602-add2-1e44dcc33e79 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:12.285920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74d4cf-8b65-4d44-8b86-b734f9b5ec9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1701b12b86645c482964c83f5cf7cc7, user_id=69b42355f861405898d6c4af8f24a75a, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:12.289126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74d4cf-8b65-4d44-8b86-b734f9b5ec9f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:12.294067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1162/2291] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:31:12.297837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc2bc3-0f3e-4602-add2-1e44dcc33e79 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:12.308258 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc2bc3-0f3e-4602-add2-1e44dcc33e79 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:12.313355 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37f2f9-6ca2-47f9-8c2a-8a7bbc445feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:12.314856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37f2f9-6ca2-47f9-8c2a-8a7bbc445feb admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:12.315145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37f2f9-6ca2-47f9-8c2a-8a7bbc445feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:12.315420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37f2f9-6ca2-47f9-8c2a-8a7bbc445feb admin admin] PATH_INFO: `/v3/projects/4251d57fcbfb4c83861295a717500d21/users/a56850c0a3b04b1a9e47ce865118050e/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:12.331724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37f2f9-6ca2-47f9-8c2a-8a7bbc445feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4251d57fcbfb4c83861295a717500d21, user_id=a56850c0a3b04b1a9e47ce865118050e, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:12.334610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37f2f9-6ca2-47f9-8c2a-8a7bbc445feb admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:12.384244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1130/2292] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:31:12 2022] PUT /identity/v3/projects/e1701b12b86645c482964c83f5cf7cc7/users/69b42355f861405898d6c4af8f24a75a/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:12.389044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ec174-cdb5-4faf-b34a-999f5f1b5b98 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:12.389370 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ec174-cdb5-4faf-b34a-999f5f1b5b98 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:12.389654 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ec174-cdb5-4faf-b34a-999f5f1b5b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:12.408428 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-9e9ec174-cdb5-4faf-b34a-999f5f1b5b98 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:12.409774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9e9ec174-cdb5-4faf-b34a-999f5f1b5b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:12.413789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1163/2293] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:31:12 2022] PUT /identity/v3/projects/4251d57fcbfb4c83861295a717500d21/users/a56850c0a3b04b1a9e47ce865118050e/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:31:12.415896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:12.426542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e95e85-82a9-4544-be0a-cac742d1990c None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:12.427377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e95e85-82a9-4544-be0a-cac742d1990c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:12.427743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e95e85-82a9-4544-be0a-cac742d1990c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:12.472189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-19e95e85-82a9-4544-be0a-cac742d1990c None None] MFA Rules not processed for user `a56850c0a3b04b1a9e47ce865118050e`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:12.473593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-19e95e85-82a9-4544-be0a-cac742d1990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:12.482485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1131/2294] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:31:12.492950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ec174-cdb5-4faf-b34a-999f5f1b5b98 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:12.494469 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9e9ec174-cdb5-4faf-b34a-999f5f1b5b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:12.548478 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1164/2295] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:12.558155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e95e85-82a9-4544-be0a-cac742d1990c None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:12.559865 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-19e95e85-82a9-4544-be0a-cac742d1990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:12.571514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ec174-cdb5-4faf-b34a-999f5f1b5b98 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:12.576501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8ea1c-0a1c-4656-96fe-a4af7b64a048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:12.577191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ea1c-0a1c-4656-96fe-a4af7b64a048 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:12.577628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ea1c-0a1c-4656-96fe-a4af7b64a048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:12.578011 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ea1c-0a1c-4656-96fe-a4af7b64a048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:12.593308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8ea1c-0a1c-4656-96fe-a4af7b64a048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:12.596258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8ea1c-0a1c-4656-96fe-a4af7b64a048 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:12.609038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1132/2296] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:31:12.650942 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e95e85-82a9-4544-be0a-cac742d1990c None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:12.654980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf6eb9-de8a-4952-b8af-e02fb4239fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:12.655733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf6eb9-de8a-4952-b8af-e02fb4239fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:12.662647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf6eb9-de8a-4952-b8af-e02fb4239fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:12.662647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf6eb9-de8a-4952-b8af-e02fb4239fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:12.667486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf6eb9-de8a-4952-b8af-e02fb4239fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:12.669688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf6eb9-de8a-4952-b8af-e02fb4239fe6 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:12.682493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1165/2297] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:31:13.082118 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f01df-26ab-4b06-9f6c-72cea7d7b577 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:13.082414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f01df-26ab-4b06-9f6c-72cea7d7b577 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:13.083185 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f01df-26ab-4b06-9f6c-72cea7d7b577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:13.101256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-903f01df-26ab-4b06-9f6c-72cea7d7b577 None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:13.102566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-903f01df-26ab-4b06-9f6c-72cea7d7b577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:13.165274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1133/2298] 10.222.0.26 () {58 vars in 967 bytes} [Tue Jul 12 16:31:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:13.178394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf6eb9-de8a-4952-b8af-e02fb4239fe6 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:13.179915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a3bf6eb9-de8a-4952-b8af-e02fb4239fe6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:13.232820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:13.253420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf6eb9-de8a-4952-b8af-e02fb4239fe6 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:13.275436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b416f3-8b02-4bb9-b979-9a7b65bf2733 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:13.276150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b416f3-8b02-4bb9-b979-9a7b65bf2733 service swift] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:13.276496 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b416f3-8b02-4bb9-b979-9a7b65bf2733 service swift] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:13.276833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b416f3-8b02-4bb9-b979-9a7b65bf2733 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:13.289265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b416f3-8b02-4bb9-b979-9a7b65bf2733 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:13.291382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b416f3-8b02-4bb9-b979-9a7b65bf2733 service swift] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:13.302258 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1166/2299] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:31:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:31:17.238742 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f01df-26ab-4b06-9f6c-72cea7d7b577 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:17.253476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f01df-26ab-4b06-9f6c-72cea7d7b577 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:17.259271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bba88-5ef7-4183-92aa-9604c21318f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:17.260464 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bba88-5ef7-4183-92aa-9604c21318f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:17.260999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bba88-5ef7-4183-92aa-9604c21318f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:17.261540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bba88-5ef7-4183-92aa-9604c21318f7 admin admin] PATH_INFO: `/v3/users/a56850c0a3b04b1a9e47ce865118050e` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:17.263299 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bba88-5ef7-4183-92aa-9604c21318f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a56850c0a3b04b1a9e47ce865118050e)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:17.265760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bba88-5ef7-4183-92aa-9604c21318f7 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:17.490892 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b416f3-8b02-4bb9-b979-9a7b65bf2733 service swift] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:17.492412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-26b416f3-8b02-4bb9-b979-9a7b65bf2733 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:17.507355 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5e4bba88-5ef7-4183-92aa-9604c21318f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a56850c0a3b04b1a9e47ce865118050e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:17.513330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b416f3-8b02-4bb9-b979-9a7b65bf2733 service swift] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:17.513814 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:17.523627 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9bc34-47bd-469f-8372-39ce4ee46c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:17.524083 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9bc34-47bd-469f-8372-39ce4ee46c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:17.524552 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9bc34-47bd-469f-8372-39ce4ee46c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:17.525340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9bc34-47bd-469f-8372-39ce4ee46c74 admin admin] PATH_INFO: `/v3/users/04e6be5748904071b53931cd7714b6d2` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:17.527140 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9bc34-47bd-469f-8372-39ce4ee46c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e6be5748904071b53931cd7714b6d2)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:17.530764 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9bc34-47bd-469f-8372-39ce4ee46c74 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:17.628768 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5e4bba88-5ef7-4183-92aa-9604c21318f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a56850c0a3b04b1a9e47ce865118050e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:17.643030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5e4bba88-5ef7-4183-92aa-9604c21318f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a56850c0a3b04b1a9e47ce865118050e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:17.644436 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5e4bba88-5ef7-4183-92aa-9604c21318f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a56850c0a3b04b1a9e47ce865118050e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:17.652928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5e4bba88-5ef7-4183-92aa-9604c21318f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a56850c0a3b04b1a9e47ce865118050e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:17.660493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1134/2300] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:31:17 2022] DELETE /identity/v3/users/a56850c0a3b04b1a9e47ce865118050e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:17.664859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b4e28-c686-4fef-97b0-e8f2384490cf None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:17.665073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b4e28-c686-4fef-97b0-e8f2384490cf None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:17.665390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b4e28-c686-4fef-97b0-e8f2384490cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:17.686920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-be4b4e28-c686-4fef-97b0-e8f2384490cf None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:17.688778 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-be4b4e28-c686-4fef-97b0-e8f2384490cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:17.799515 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1135/2301] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:17.808492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-33d9bc34-47bd-469f-8372-39ce4ee46c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e6be5748904071b53931cd7714b6d2'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:17.818353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b4e28-c686-4fef-97b0-e8f2384490cf None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:17.824263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-be4b4e28-c686-4fef-97b0-e8f2384490cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:17.897625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b4e28-c686-4fef-97b0-e8f2384490cf None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:17.904854 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f19e13-fce5-47c8-b628-50eb00ecfc3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:17.905808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f19e13-fce5-47c8-b628-50eb00ecfc3d service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:17.906176 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f19e13-fce5-47c8-b628-50eb00ecfc3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:17.906585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f19e13-fce5-47c8-b628-50eb00ecfc3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:17.924866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f19e13-fce5-47c8-b628-50eb00ecfc3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:17.928118 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f19e13-fce5-47c8-b628-50eb00ecfc3d service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:17.932070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-33d9bc34-47bd-469f-8372-39ce4ee46c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e6be5748904071b53931cd7714b6d2'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:17.932982 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-33d9bc34-47bd-469f-8372-39ce4ee46c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e6be5748904071b53931cd7714b6d2'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:17.945393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1136/2302] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:31:17.954899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-33d9bc34-47bd-469f-8372-39ce4ee46c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e6be5748904071b53931cd7714b6d2'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:17.967564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-33d9bc34-47bd-469f-8372-39ce4ee46c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e6be5748904071b53931cd7714b6d2'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:17.979124 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1167/2303] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:31:17 2022] DELETE /identity/v3/users/04e6be5748904071b53931cd7714b6d2 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:31:18.313774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f19e13-fce5-47c8-b628-50eb00ecfc3d service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:18.315504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-67f19e13-fce5-47c8-b628-50eb00ecfc3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:18.340792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f19e13-fce5-47c8-b628-50eb00ecfc3d service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:18.558089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b1c66-a427-48d9-87c9-99305f9dc339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:18.560840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b1c66-a427-48d9-87c9-99305f9dc339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:18.561375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b1c66-a427-48d9-87c9-99305f9dc339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:18.561810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b1c66-a427-48d9-87c9-99305f9dc339 admin admin] PATH_INFO: `/v3/projects/5fba7b72484941bdb7d66ca4f8297181` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:18.564793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b1c66-a427-48d9-87c9-99305f9dc339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fba7b72484941bdb7d66ca4f8297181)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:18.567494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b1c66-a427-48d9-87c9-99305f9dc339 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:18.714383 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3e8b1c66-a427-48d9-87c9-99305f9dc339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fba7b72484941bdb7d66ca4f8297181', 'request_id': 'req-3e8b1c66-a427-48d9-87c9-99305f9dc339'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:18.800565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3e8b1c66-a427-48d9-87c9-99305f9dc339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fba7b72484941bdb7d66ca4f8297181', 'request_id': 'req-3e8b1c66-a427-48d9-87c9-99305f9dc339'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:18.814427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3e8b1c66-a427-48d9-87c9-99305f9dc339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fba7b72484941bdb7d66ca4f8297181', 'request_id': 'req-3e8b1c66-a427-48d9-87c9-99305f9dc339'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:18.828049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3e8b1c66-a427-48d9-87c9-99305f9dc339 admin admin] The token cache is being invalidate because project 5fba7b72484941bdb7d66ca4f8297181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:31:18.828551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3e8b1c66-a427-48d9-87c9-99305f9dc339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:18.830203 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3e8b1c66-a427-48d9-87c9-99305f9dc339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:18.832313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1137/2304] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:31:18 2022] DELETE /identity/v3/projects/5fba7b72484941bdb7d66ca4f8297181 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:18.837252 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b3e37-1a09-43fe-9317-8f80796e07e9 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:18.837752 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b3e37-1a09-43fe-9317-8f80796e07e9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:18.838043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b3e37-1a09-43fe-9317-8f80796e07e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:18.883561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-059b3e37-1a09-43fe-9317-8f80796e07e9 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:18.885270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-059b3e37-1a09-43fe-9317-8f80796e07e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:19.023617 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1168/2305] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:19.031345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4db9a0-8642-4910-b775-70b268a2bd9a None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:19.031641 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4db9a0-8642-4910-b775-70b268a2bd9a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:19.031921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4db9a0-8642-4910-b775-70b268a2bd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:19.092902 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b3e37-1a09-43fe-9317-8f80796e07e9 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:19.095360 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-059b3e37-1a09-43fe-9317-8f80796e07e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:19.106616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-2e4db9a0-8642-4910-b775-70b268a2bd9a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:19.108036 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2e4db9a0-8642-4910-b775-70b268a2bd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:19.130931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1138/2306] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:19.143021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4db9a0-8642-4910-b775-70b268a2bd9a None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:19.147354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b3e37-1a09-43fe-9317-8f80796e07e9 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:19.165358 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4db9a0-8642-4910-b775-70b268a2bd9a None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:19.183116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84d0ef-7ea1-4d39-afe8-463b559146df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:19.184409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84d0ef-7ea1-4d39-afe8-463b559146df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:19.187256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c0081-6e57-494c-9955-7945d6052080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:19.189946 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c0081-6e57-494c-9955-7945d6052080 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:19.190339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84d0ef-7ea1-4d39-afe8-463b559146df admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:19.191493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84d0ef-7ea1-4d39-afe8-463b559146df admin admin] PATH_INFO: `/v3/projects/4251d57fcbfb4c83861295a717500d21` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:19.191892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c0081-6e57-494c-9955-7945d6052080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:19.192251 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c0081-6e57-494c-9955-7945d6052080 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:19.194595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c0081-6e57-494c-9955-7945d6052080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:31:19.195656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c0081-6e57-494c-9955-7945d6052080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:19.196576 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84d0ef-7ea1-4d39-afe8-463b559146df admin admin] RBAC: Authorizing `identity:delete_project(project_id=4251d57fcbfb4c83861295a717500d21)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:19.201974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c0081-6e57-494c-9955-7945d6052080 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:19.207927 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84d0ef-7ea1-4d39-afe8-463b559146df admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:19.233570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1139/2307] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:31:19.237746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c0081-6e57-494c-9955-7945d6052080 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:19.260977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c0081-6e57-494c-9955-7945d6052080 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:19.278538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404cd77-e4e8-4f24-a204-1ae87c7ec85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:19.281279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404cd77-e4e8-4f24-a204-1ae87c7ec85e admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:19.281674 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404cd77-e4e8-4f24-a204-1ae87c7ec85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:19.282813 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404cd77-e4e8-4f24-a204-1ae87c7ec85e admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:19.283656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404cd77-e4e8-4f24-a204-1ae87c7ec85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:19.289168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404cd77-e4e8-4f24-a204-1ae87c7ec85e admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:19.300623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:19.466287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1140/2308] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:31:19 2022] POST /identity/v3/projects => generated 369 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:31:19.467308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404cd77-e4e8-4f24-a204-1ae87c7ec85e admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:19.505220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:19.512135 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6b84d0ef-7ea1-4d39-afe8-463b559146df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4251d57fcbfb4c83861295a717500d21', 'request_id': 'req-6b84d0ef-7ea1-4d39-afe8-463b559146df'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:19.597717 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404cd77-e4e8-4f24-a204-1ae87c7ec85e admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:19.603293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d6ec4-8f8c-4924-919b-8d8e63d15ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:19.609025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d6ec4-8f8c-4924-919b-8d8e63d15ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:19.609552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d6ec4-8f8c-4924-919b-8d8e63d15ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:19.609933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d6ec4-8f8c-4924-919b-8d8e63d15ae9 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:19.613700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d6ec4-8f8c-4924-919b-8d8e63d15ae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:19.613700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d6ec4-8f8c-4924-919b-8d8e63d15ae9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:19.663111 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6b84d0ef-7ea1-4d39-afe8-463b559146df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4251d57fcbfb4c83861295a717500d21', 'request_id': 'req-6b84d0ef-7ea1-4d39-afe8-463b559146df'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:19.670665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6b84d0ef-7ea1-4d39-afe8-463b559146df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4251d57fcbfb4c83861295a717500d21', 'request_id': 'req-6b84d0ef-7ea1-4d39-afe8-463b559146df'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:19.685540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6b84d0ef-7ea1-4d39-afe8-463b559146df admin admin] The token cache is being invalidate because project 4251d57fcbfb4c83861295a717500d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:31:19.685840 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6b84d0ef-7ea1-4d39-afe8-463b559146df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:19.686534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-6b84d0ef-7ea1-4d39-afe8-463b559146df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:19.689299 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1169/2309] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:31:19 2022] DELETE /identity/v3/projects/4251d57fcbfb4c83861295a717500d21 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:19.691099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c02c1-3cb1-4438-903f-bbd185b2c248 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:19.691406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c02c1-3cb1-4438-903f-bbd185b2c248 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:19.691723 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c02c1-3cb1-4438-903f-bbd185b2c248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:19.703879 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1141/2310] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:31:19 2022] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:31:19.703879 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3565a-e79d-4106-8478-ab4f8b987490 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:19.703879 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3565a-e79d-4106-8478-ab4f8b987490 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:19.705010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3565a-e79d-4106-8478-ab4f8b987490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:19.721154 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-4f1c02c1-3cb1-4438-903f-bbd185b2c248 None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:19.721895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4f1c02c1-3cb1-4438-903f-bbd185b2c248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:19.738665 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-d0a3565a-e79d-4106-8478-ab4f8b987490 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:19.741632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d0a3565a-e79d-4106-8478-ab4f8b987490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:19.764221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1142/2311] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:19.765145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3565a-e79d-4106-8478-ab4f8b987490 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:19.777885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d0a3565a-e79d-4106-8478-ab4f8b987490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:19.824602 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3565a-e79d-4106-8478-ab4f8b987490 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:19.831253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96b40-00bd-4a47-ab78-37effd137d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:19.831943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96b40-00bd-4a47-ab78-37effd137d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:19.832230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96b40-00bd-4a47-ab78-37effd137d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:19.832521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96b40-00bd-4a47-ab78-37effd137d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:19.833364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b96b40-00bd-4a47-ab78-37effd137d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:19.835146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b96b40-00bd-4a47-ab78-37effd137d64 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:19.845143 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1170/2312] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:31:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:19.849337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420e731-7fa6-4420-b240-9239dbd19147 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:19.849630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420e731-7fa6-4420-b240-9239dbd19147 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:19.849910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420e731-7fa6-4420-b240-9239dbd19147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:19.852181 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1143/2313] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:19.856300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96b40-00bd-4a47-ab78-37effd137d64 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:19.881037 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96b40-00bd-4a47-ab78-37effd137d64 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:19.901701 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca8f5c-5226-425b-9f55-7be2705c1c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:19.902134 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca8f5c-5226-425b-9f55-7be2705c1c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:19.902492 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca8f5c-5226-425b-9f55-7be2705c1c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:19.902713 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca8f5c-5226-425b-9f55-7be2705c1c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:19.911800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-2420e731-7fa6-4420-b240-9239dbd19147 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:19.913409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-2420e731-7fa6-4420-b240-9239dbd19147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:19.918073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca8f5c-5226-425b-9f55-7be2705c1c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:19.924399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca8f5c-5226-425b-9f55-7be2705c1c52 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:19.931912 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1171/2314] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:19.932780 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420e731-7fa6-4420-b240-9239dbd19147 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:19.936673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-2420e731-7fa6-4420-b240-9239dbd19147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:19.940266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1144/2315] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:19.944986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca8f5c-5226-425b-9f55-7be2705c1c52 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:19.958243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca8f5c-5226-425b-9f55-7be2705c1c52 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:19.966946 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922539a-d7bf-4265-be42-982ab03eb474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:19.968914 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922539a-d7bf-4265-be42-982ab03eb474 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:19.971033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922539a-d7bf-4265-be42-982ab03eb474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:19.973058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922539a-d7bf-4265-be42-982ab03eb474 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:19.973995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922539a-d7bf-4265-be42-982ab03eb474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:31:19.975059 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922539a-d7bf-4265-be42-982ab03eb474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:19.977760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922539a-d7bf-4265-be42-982ab03eb474 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:19.998066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1145/2316] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:31:19.999383 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922539a-d7bf-4265-be42-982ab03eb474 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:20.014909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922539a-d7bf-4265-be42-982ab03eb474 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:20.024596 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb75a42-87d4-4102-a668-fc22f1092f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:20.025615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb75a42-87d4-4102-a668-fc22f1092f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:20.025911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb75a42-87d4-4102-a668-fc22f1092f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:20.026801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb75a42-87d4-4102-a668-fc22f1092f80 admin admin] PATH_INFO: `/v3/projects/4148a8d6705f418cb415af9d6643cf52/users/9e0105083a8841e79dc1e71959c19c6d/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:20.072715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb75a42-87d4-4102-a668-fc22f1092f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4148a8d6705f418cb415af9d6643cf52, user_id=9e0105083a8841e79dc1e71959c19c6d, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:20.075804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb75a42-87d4-4102-a668-fc22f1092f80 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:20.098381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420e731-7fa6-4420-b240-9239dbd19147 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:20.104432 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97925b37-ff6b-486c-be4b-da40b310398c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:20.104932 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97925b37-ff6b-486c-be4b-da40b310398c service swift] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:20.105722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97925b37-ff6b-486c-be4b-da40b310398c service swift] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:20.106216 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97925b37-ff6b-486c-be4b-da40b310398c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:20.133434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97925b37-ff6b-486c-be4b-da40b310398c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:20.135889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97925b37-ff6b-486c-be4b-da40b310398c service swift] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:20.154161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1172/2317] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:31:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:31:20.154862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97925b37-ff6b-486c-be4b-da40b310398c service swift] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:20.172148 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97925b37-ff6b-486c-be4b-da40b310398c service swift] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:20.181987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc41e3-d68a-43de-9c21-3a26699469f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:20.182672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc41e3-d68a-43de-9c21-3a26699469f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:20.182955 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc41e3-d68a-43de-9c21-3a26699469f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:20.187407 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc41e3-d68a-43de-9c21-3a26699469f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:20.187407 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc41e3-d68a-43de-9c21-3a26699469f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:20.189053 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc41e3-d68a-43de-9c21-3a26699469f3 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:20.189678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1146/2318] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:31:19 2022] PUT /identity/v3/projects/4148a8d6705f418cb415af9d6643cf52/users/9e0105083a8841e79dc1e71959c19c6d/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:20.200668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b98a-5f78-47e6-95f3-de3910314390 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:20.201001 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b98a-5f78-47e6-95f3-de3910314390 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:20.201282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b98a-5f78-47e6-95f3-de3910314390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:20.289648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-4dd2b98a-5f78-47e6-95f3-de3910314390 None None] MFA Rules not processed for user `9e0105083a8841e79dc1e71959c19c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:20.294831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-4dd2b98a-5f78-47e6-95f3-de3910314390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:20.340771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1173/2319] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:31:20 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:31:20.346133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc41e3-d68a-43de-9c21-3a26699469f3 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:20.464126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1147/2320] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:20.486399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b98a-5f78-47e6-95f3-de3910314390 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:20.490381 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-4dd2b98a-5f78-47e6-95f3-de3910314390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:20.559111 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc41e3-d68a-43de-9c21-3a26699469f3 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:20.575578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:20.577188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813a031-414c-4441-841d-8be863c21b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:20.577947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813a031-414c-4441-841d-8be863c21b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:20.578244 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813a031-414c-4441-841d-8be863c21b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:20.578522 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813a031-414c-4441-841d-8be863c21b94 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:20.580069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813a031-414c-4441-841d-8be863c21b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:20.582618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813a031-414c-4441-841d-8be863c21b94 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:20.695400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1174/2321] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:31:20 2022] POST /identity/v3/users => generated 285 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:31:20.697706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769662fd-38c0-4e6e-9d99-f3253808c68e None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:20.698145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769662fd-38c0-4e6e-9d99-f3253808c68e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:20.698567 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769662fd-38c0-4e6e-9d99-f3253808c68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:20.704468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b98a-5f78-47e6-95f3-de3910314390 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:20.749924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-769662fd-38c0-4e6e-9d99-f3253808c68e None None] MFA Rules not processed for user `69b42355f861405898d6c4af8f24a75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:20.752676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-769662fd-38c0-4e6e-9d99-f3253808c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:20.811329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaadf6-1058-432b-9abd-cf5f16b84e0d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f9ba17c2634999b350b887a5229e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:20.815156 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaadf6-1058-432b-9abd-cf5f16b84e0d service glance] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:20.815156 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaadf6-1058-432b-9abd-cf5f16b84e0d service glance] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:20.815495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaadf6-1058-432b-9abd-cf5f16b84e0d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:20.951006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1175/2322] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:20.952403 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769662fd-38c0-4e6e-9d99-f3253808c68e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:20.962411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaadf6-1058-432b-9abd-cf5f16b84e0d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:20.964600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaadf6-1058-432b-9abd-cf5f16b84e0d service glance] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:20.971623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769662fd-38c0-4e6e-9d99-f3253808c68e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:20.977834 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876148c2-df70-492b-9899-0cd617866f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:20.978632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1148/2323] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:31:20.979368 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaadf6-1058-432b-9abd-cf5f16b84e0d service glance] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:20.980955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-88aaadf6-1058-432b-9abd-cf5f16b84e0d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:20.990115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876148c2-df70-492b-9899-0cd617866f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:20.990115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876148c2-df70-492b-9899-0cd617866f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:20.990115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876148c2-df70-492b-9899-0cd617866f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:20.990115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876148c2-df70-492b-9899-0cd617866f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:20.991407 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876148c2-df70-492b-9899-0cd617866f18 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:20.997674 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaadf6-1058-432b-9abd-cf5f16b84e0d service glance] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:21.006254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a71e4b-d7be-4f33-b849-8070fcc89e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:21.006441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1176/2324] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:21.007210 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71e4b-d7be-4f33-b849-8070fcc89e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:21.012330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71e4b-d7be-4f33-b849-8070fcc89e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:21.012330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71e4b-d7be-4f33-b849-8070fcc89e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:21.012330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a71e4b-d7be-4f33-b849-8070fcc89e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:21.012330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a71e4b-d7be-4f33-b849-8070fcc89e49 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:21.024882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876148c2-df70-492b-9899-0cd617866f18 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:21.037859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876148c2-df70-492b-9899-0cd617866f18 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:21.045284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:21.055112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2f360-42c3-4043-9c2a-e0b7c47735b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:21.055884 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f360-42c3-4043-9c2a-e0b7c47735b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:21.056077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f360-42c3-4043-9c2a-e0b7c47735b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:21.056367 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f360-42c3-4043-9c2a-e0b7c47735b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:21.057139 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2f360-42c3-4043-9c2a-e0b7c47735b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:21.066034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2f360-42c3-4043-9c2a-e0b7c47735b9 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:21.103315 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1177/2325] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:21.106436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2f360-42c3-4043-9c2a-e0b7c47735b9 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:21.121581 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1149/2326] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:31:20 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:31:21.122805 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a71e4b-d7be-4f33-b849-8070fcc89e49 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:21.136397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2f360-42c3-4043-9c2a-e0b7c47735b9 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:21.265080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a71e4b-d7be-4f33-b849-8070fcc89e49 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:21.278040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a230b-2e7d-49af-b955-75f44e18a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:21.278929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a230b-2e7d-49af-b955-75f44e18a8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:21.279220 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a230b-2e7d-49af-b955-75f44e18a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:21.279498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a230b-2e7d-49af-b955-75f44e18a8f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:21.280271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a230b-2e7d-49af-b955-75f44e18a8f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:21.285994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a230b-2e7d-49af-b955-75f44e18a8f9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:21.305304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981eb76a-db66-406f-8a5e-d74cd65e1f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:21.306514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eb76a-db66-406f-8a5e-d74cd65e1f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:21.306862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eb76a-db66-406f-8a5e-d74cd65e1f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:21.307227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eb76a-db66-406f-8a5e-d74cd65e1f56 admin admin] PATH_INFO: `/v3/projects/3d1595fc4614415cb0e7db361cd911e5/users/e512c98d6d12489aa73180c7a5cb7b66/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:21.338602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981eb76a-db66-406f-8a5e-d74cd65e1f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1595fc4614415cb0e7db361cd911e5, user_id=e512c98d6d12489aa73180c7a5cb7b66, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:21.339324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981eb76a-db66-406f-8a5e-d74cd65e1f56 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:21.413685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1150/2327] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:31:21 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:31:21.417236 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a230b-2e7d-49af-b955-75f44e18a8f9 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:21.435303 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a230b-2e7d-49af-b955-75f44e18a8f9 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:21.441646 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f59b2-8e95-457f-a4d8-ef88cc497b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:21.449487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f59b2-8e95-457f-a4d8-ef88cc497b49 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:21.449487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f59b2-8e95-457f-a4d8-ef88cc497b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:21.449487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f59b2-8e95-457f-a4d8-ef88cc497b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:21.449487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f59b2-8e95-457f-a4d8-ef88cc497b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:21.449835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1178/2328] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:31:21 2022] PUT /identity/v3/projects/3d1595fc4614415cb0e7db361cd911e5/users/e512c98d6d12489aa73180c7a5cb7b66/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:21.449921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f59b2-8e95-457f-a4d8-ef88cc497b49 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:21.461647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3579d0-21ab-4980-93c3-e251126d6509 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:21.462195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3579d0-21ab-4980-93c3-e251126d6509 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:21.462620 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3579d0-21ab-4980-93c3-e251126d6509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:21.472282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1151/2329] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:31:21.480976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f59b2-8e95-457f-a4d8-ef88cc497b49 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:21.516893 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f59b2-8e95-457f-a4d8-ef88cc497b49 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:21.535789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-7d3579d0-21ab-4980-93c3-e251126d6509 None None] MFA Rules not processed for user `e512c98d6d12489aa73180c7a5cb7b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:21.547690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-7d3579d0-21ab-4980-93c3-e251126d6509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:21.654685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74010a6a-34e4-49de-83b6-7b56be15a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:21.655727 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74010a6a-34e4-49de-83b6-7b56be15a1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:21.656011 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74010a6a-34e4-49de-83b6-7b56be15a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:21.656289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74010a6a-34e4-49de-83b6-7b56be15a1a9 admin admin] PATH_INFO: `/v3/projects/0a361dd523264c73bb2ebd41ab4599ff/users/c451fe6d0ce144bd9865f5a1b3b882b1/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:21.692292 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74010a6a-34e4-49de-83b6-7b56be15a1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a361dd523264c73bb2ebd41ab4599ff, user_id=c451fe6d0ce144bd9865f5a1b3b882b1, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:21.702478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74010a6a-34e4-49de-83b6-7b56be15a1a9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:21.729055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1179/2330] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:31:21.748658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3579d0-21ab-4980-93c3-e251126d6509 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:21.822625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1152/2331] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:31:21 2022] PUT /identity/v3/projects/0a361dd523264c73bb2ebd41ab4599ff/users/c451fe6d0ce144bd9865f5a1b3b882b1/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:21.826105 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74010a6a-34e4-49de-83b6-7b56be15a1a9 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:21.842436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3579d0-21ab-4980-93c3-e251126d6509 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:21.935535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67b02b-fa91-4bed-9410-f9bcb82853a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f9ba17c2634999b350b887a5229e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:21.936892 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67b02b-fa91-4bed-9410-f9bcb82853a9 service glance] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:21.936892 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67b02b-fa91-4bed-9410-f9bcb82853a9 service glance] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:21.937234 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67b02b-fa91-4bed-9410-f9bcb82853a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:21.940215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:21.980685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74010a6a-34e4-49de-83b6-7b56be15a1a9 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:21.990221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a292f55-d6da-4bd1-a135-46abcf8ce2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:21.991169 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a292f55-d6da-4bd1-a135-46abcf8ce2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:21.991601 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a292f55-d6da-4bd1-a135-46abcf8ce2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:21.992032 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a292f55-d6da-4bd1-a135-46abcf8ce2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:21.993396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a292f55-d6da-4bd1-a135-46abcf8ce2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:21.995522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a292f55-d6da-4bd1-a135-46abcf8ce2cd admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:22.040801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1153/2332] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:22.042054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a292f55-d6da-4bd1-a135-46abcf8ce2cd admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:22.058101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a292f55-d6da-4bd1-a135-46abcf8ce2cd admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:22.072993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f2aaa-619a-4ed2-ade1-974ab4ebd914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:22.074331 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f2aaa-619a-4ed2-ade1-974ab4ebd914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:22.077218 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f2aaa-619a-4ed2-ade1-974ab4ebd914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:22.078204 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f2aaa-619a-4ed2-ade1-974ab4ebd914 admin admin] PATH_INFO: `/v3/projects/0a361dd523264c73bb2ebd41ab4599ff/users/c451fe6d0ce144bd9865f5a1b3b882b1/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:22.084398 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f2aaa-619a-4ed2-ade1-974ab4ebd914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a361dd523264c73bb2ebd41ab4599ff, user_id=c451fe6d0ce144bd9865f5a1b3b882b1, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:22.093633 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f2aaa-619a-4ed2-ade1-974ab4ebd914 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:22.125545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1154/2333] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:31:22 2022] PUT /identity/v3/projects/0a361dd523264c73bb2ebd41ab4599ff/users/c451fe6d0ce144bd9865f5a1b3b882b1/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:22.136890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67b02b-fa91-4bed-9410-f9bcb82853a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:22.138480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67b02b-fa91-4bed-9410-f9bcb82853a9 service glance] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:22.160492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1180/2334] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:31:22.978382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02078495-c608-41cd-8550-0b6cc8b7f70e None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:22.978877 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02078495-c608-41cd-8550-0b6cc8b7f70e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:22.979144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02078495-c608-41cd-8550-0b6cc8b7f70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:23.009336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-02078495-c608-41cd-8550-0b6cc8b7f70e None None] MFA Rules not processed for user `071dc15e85a849afa9b9663f7e5f428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:23.010930 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-02078495-c608-41cd-8550-0b6cc8b7f70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:23.128485 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:23.167500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1155/2335] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:23.819099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:31.817260 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3009fed-2443-4dc3-9ee7-b892eaf1c6f7 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:31.817856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3009fed-2443-4dc3-9ee7-b892eaf1c6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:31.817856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3009fed-2443-4dc3-9ee7-b892eaf1c6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:31.851434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-d3009fed-2443-4dc3-9ee7-b892eaf1c6f7 None None] MFA Rules not processed for user `c451fe6d0ce144bd9865f5a1b3b882b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:31.852889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d3009fed-2443-4dc3-9ee7-b892eaf1c6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:31.877853 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:32.022469 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02078495-c608-41cd-8550-0b6cc8b7f70e None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:32.025044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-02078495-c608-41cd-8550-0b6cc8b7f70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:32.031393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1181/2336] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:32.162997 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02078495-c608-41cd-8550-0b6cc8b7f70e None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:32.170187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd599c56-5ff5-4ec4-b3e2-02a85cf8b68e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:32.170187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd599c56-5ff5-4ec4-b3e2-02a85cf8b68e service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:32.170523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd599c56-5ff5-4ec4-b3e2-02a85cf8b68e service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:32.170634 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd599c56-5ff5-4ec4-b3e2-02a85cf8b68e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:32.263697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:32.279810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd599c56-5ff5-4ec4-b3e2-02a85cf8b68e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:32.281512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd599c56-5ff5-4ec4-b3e2-02a85cf8b68e service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:32.303549 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1156/2337] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:31:33.670981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084b7c2-c854-495d-a996-5544fe2d0c71 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:33.676156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084b7c2-c854-495d-a996-5544fe2d0c71 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:33.676156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084b7c2-c854-495d-a996-5544fe2d0c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:33.702259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-0084b7c2-c854-495d-a996-5544fe2d0c71 None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:33.707290 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0084b7c2-c854-495d-a996-5544fe2d0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:33.809824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1182/2338] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:31:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:33.827566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd599c56-5ff5-4ec4-b3e2-02a85cf8b68e service nova] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:33.931061 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd599c56-5ff5-4ec4-b3e2-02a85cf8b68e service nova] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:33.942668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8dc74-f371-4416-969e-fec688a3eb04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:33.944172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8dc74-f371-4416-969e-fec688a3eb04 service swift] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:33.944498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8dc74-f371-4416-969e-fec688a3eb04 service swift] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:33.945020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8dc74-f371-4416-969e-fec688a3eb04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:33.959606 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8dc74-f371-4416-969e-fec688a3eb04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:33.961906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8dc74-f371-4416-969e-fec688a3eb04 service swift] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:33.983127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1157/2339] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:31:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 16:31:35.998372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcfcd7-0913-4793-ac9e-6ab97fbc1d45 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:35.999511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcfcd7-0913-4793-ac9e-6ab97fbc1d45 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:35.999950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcfcd7-0913-4793-ac9e-6ab97fbc1d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:36.027924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-11fcfcd7-0913-4793-ac9e-6ab97fbc1d45 None None] MFA Rules not processed for user `69b42355f861405898d6c4af8f24a75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:36.029483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-11fcfcd7-0913-4793-ac9e-6ab97fbc1d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:36.039628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1183/2340] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:37.231830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee60791-45be-4ab8-800b-901f1d0cd3de None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:37.232321 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee60791-45be-4ab8-800b-901f1d0cd3de None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:37.232415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee60791-45be-4ab8-800b-901f1d0cd3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:37.249781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-bee60791-45be-4ab8-800b-901f1d0cd3de None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:37.251524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-bee60791-45be-4ab8-800b-901f1d0cd3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:37.258788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1158/2341] 10.222.0.26 () {58 vars in 967 bytes} [Tue Jul 12 16:31:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:37.271521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcfcd7-0913-4793-ac9e-6ab97fbc1d45 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:37.283061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcfcd7-0913-4793-ac9e-6ab97fbc1d45 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:37.288131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18eabb6-3ca4-457e-a332-ed4b710aa196 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:37.288770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eabb6-3ca4-457e-a332-ed4b710aa196 service swift] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:37.289060 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eabb6-3ca4-457e-a332-ed4b710aa196 service swift] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:37.289373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eabb6-3ca4-457e-a332-ed4b710aa196 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:37.300901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18eabb6-3ca4-457e-a332-ed4b710aa196 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:37.300901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18eabb6-3ca4-457e-a332-ed4b710aa196 service swift] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:37.307692 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1184/2342] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:31:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:31:37.976427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ab426-8680-42e0-b25a-9d23afa951c1 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:37.976723 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ab426-8680-42e0-b25a-9d23afa951c1 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:37.977001 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ab426-8680-42e0-b25a-9d23afa951c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:37.997019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e07ab426-8680-42e0-b25a-9d23afa951c1 None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:37.998686 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e07ab426-8680-42e0-b25a-9d23afa951c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:38.008090 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1159/2343] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:31:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:31:38.024323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18eabb6-3ca4-457e-a332-ed4b710aa196 service swift] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:38.041393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18eabb6-3ca4-457e-a332-ed4b710aa196 service swift] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:38.050996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785510cf-106e-4ba0-ba8e-85eabda48ed6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:38.052018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785510cf-106e-4ba0-ba8e-85eabda48ed6 service swift] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:38.059881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785510cf-106e-4ba0-ba8e-85eabda48ed6 service swift] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:38.059881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785510cf-106e-4ba0-ba8e-85eabda48ed6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:38.062837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785510cf-106e-4ba0-ba8e-85eabda48ed6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:38.064333 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785510cf-106e-4ba0-ba8e-85eabda48ed6 service swift] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:38.082812 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1185/2344] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:31:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:31:43.494602 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd6f57-c70c-462c-8627-01876c4ca47a None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:43.495137 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd6f57-c70c-462c-8627-01876c4ca47a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:43.495235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd6f57-c70c-462c-8627-01876c4ca47a None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:43.496563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1160/2345] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:31:43.503309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99502ca-c876-48b0-beac-91a6bd205696 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:43.503775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99502ca-c876-48b0-beac-91a6bd205696 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:43.503875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99502ca-c876-48b0-beac-91a6bd205696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:43.528674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-c99502ca-c876-48b0-beac-91a6bd205696 None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:43.529952 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c99502ca-c876-48b0-beac-91a6bd205696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:43.540616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1186/2346] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:31:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:47.992997 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=43 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:52.080976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd6f57-c70c-462c-8627-01876c4ca47a None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:52.128173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99502ca-c876-48b0-beac-91a6bd205696 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:52.148762 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd6f57-c70c-462c-8627-01876c4ca47a None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:52.158051 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307d0e4-cbd4-480d-b483-29f47d51eb76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f9ba17c2634999b350b887a5229e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:52.158716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307d0e4-cbd4-480d-b483-29f47d51eb76 service glance] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:52.159005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307d0e4-cbd4-480d-b483-29f47d51eb76 service glance] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:52.159281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307d0e4-cbd4-480d-b483-29f47d51eb76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:52.171050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307d0e4-cbd4-480d-b483-29f47d51eb76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:52.172582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307d0e4-cbd4-480d-b483-29f47d51eb76 service glance] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:52.185721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1161/2347] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:31:52.224565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99502ca-c876-48b0-beac-91a6bd205696 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:52.229739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85c5b2-f798-409d-90a3-7cba18b69682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:52.230899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85c5b2-f798-409d-90a3-7cba18b69682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:52.231192 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85c5b2-f798-409d-90a3-7cba18b69682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:52.231472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85c5b2-f798-409d-90a3-7cba18b69682 admin admin] PATH_INFO: `/v3/users/9e0105083a8841e79dc1e71959c19c6d` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:52.233027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85c5b2-f798-409d-90a3-7cba18b69682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0105083a8841e79dc1e71959c19c6d)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:52.235141 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85c5b2-f798-409d-90a3-7cba18b69682 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:52.253023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:52.299460 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b85d0f-2934-4b40-a3a9-4520039d3bb6 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:52.299754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b85d0f-2934-4b40-a3a9-4520039d3bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:52.300034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b85d0f-2934-4b40-a3a9-4520039d3bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:52.321386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-61b85d0f-2934-4b40-a3a9-4520039d3bb6 None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:52.322660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-61b85d0f-2934-4b40-a3a9-4520039d3bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:52.330901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1162/2348] 10.222.0.26 () {58 vars in 967 bytes} [Tue Jul 12 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:31:52.354328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b85d0f-2934-4b40-a3a9-4520039d3bb6 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:52.368219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b85d0f-2934-4b40-a3a9-4520039d3bb6 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:52.374304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa56fd-6134-43b2-b5d9-8af051e784af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:52.374739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa56fd-6134-43b2-b5d9-8af051e784af service swift] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:52.374960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa56fd-6134-43b2-b5d9-8af051e784af service swift] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:52.375226 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa56fd-6134-43b2-b5d9-8af051e784af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:52.384816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa56fd-6134-43b2-b5d9-8af051e784af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:52.386440 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa56fd-6134-43b2-b5d9-8af051e784af service swift] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:52.399987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1163/2349] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:31:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:31:52.428658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-dc85c5b2-f798-409d-90a3-7cba18b69682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0105083a8841e79dc1e71959c19c6d'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:52.444912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c95fd-b8ae-40f5-b481-96b4c0ce6a9f None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:52.445258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c95fd-b8ae-40f5-b481-96b4c0ce6a9f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:52.445538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c95fd-b8ae-40f5-b481-96b4c0ce6a9f None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:52.446915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1164/2350] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 16:31:52.451888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439cbec-5379-4c42-b7a9-fe700c504706 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:52.452174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439cbec-5379-4c42-b7a9-fe700c504706 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:52.452448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439cbec-5379-4c42-b7a9-fe700c504706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:52.473796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a439cbec-5379-4c42-b7a9-fe700c504706 None None] MFA Rules not processed for user `f6a4da4c1dca40f5bb5d158a6f33d9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:52.474981 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a439cbec-5379-4c42-b7a9-fe700c504706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:52.519223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-dc85c5b2-f798-409d-90a3-7cba18b69682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0105083a8841e79dc1e71959c19c6d'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:52.519926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-dc85c5b2-f798-409d-90a3-7cba18b69682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0105083a8841e79dc1e71959c19c6d'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:52.528279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1165/2351] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:31:52.533527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-dc85c5b2-f798-409d-90a3-7cba18b69682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0105083a8841e79dc1e71959c19c6d'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:52.540367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439cbec-5379-4c42-b7a9-fe700c504706 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:52.547109 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-dc85c5b2-f798-409d-90a3-7cba18b69682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0105083a8841e79dc1e71959c19c6d'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:52.547266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a439cbec-5379-4c42-b7a9-fe700c504706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:52.548017 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1187/2352] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:31:52 2022] DELETE /identity/v3/users/9e0105083a8841e79dc1e71959c19c6d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:31:52.552958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ca7b6-1193-4bb8-830d-33600d54f3e7 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:52.553848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ca7b6-1193-4bb8-830d-33600d54f3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:52.554057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ca7b6-1193-4bb8-830d-33600d54f3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:52.556600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439cbec-5379-4c42-b7a9-fe700c504706 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:52.572382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-bc4ca7b6-1193-4bb8-830d-33600d54f3e7 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:52.573600 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bc4ca7b6-1193-4bb8-830d-33600d54f3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:52.612314 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed338d99-a7ec-40c8-8633-aedbf864fc11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:52.612971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338d99-a7ec-40c8-8633-aedbf864fc11 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:52.613370 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338d99-a7ec-40c8-8633-aedbf864fc11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:52.613655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338d99-a7ec-40c8-8633-aedbf864fc11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:52.621771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed338d99-a7ec-40c8-8633-aedbf864fc11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:52.623206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed338d99-a7ec-40c8-8633-aedbf864fc11 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:52.636108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1166/2353] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:31:52.640083 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1188/2354] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:31:52.648574 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed338d99-a7ec-40c8-8633-aedbf864fc11 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:52.650730 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-ed338d99-a7ec-40c8-8633-aedbf864fc11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:52.661751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed338d99-a7ec-40c8-8633-aedbf864fc11 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:52.665538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a57269-bfe4-4a90-8dce-2ee74c752d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:52.667631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57269-bfe4-4a90-8dce-2ee74c752d11 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:52.667631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57269-bfe4-4a90-8dce-2ee74c752d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:52.667631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57269-bfe4-4a90-8dce-2ee74c752d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:52.681428 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a57269-bfe4-4a90-8dce-2ee74c752d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:52.682842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a57269-bfe4-4a90-8dce-2ee74c752d11 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:52.693543 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1167/2355] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:31:52.727648 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248b07-26bc-477a-9fda-3f4eb1c77b5c None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:52.727945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248b07-26bc-477a-9fda-3f4eb1c77b5c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:52.728251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248b07-26bc-477a-9fda-3f4eb1c77b5c None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:52.729727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1189/2356] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:31:52.736723 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeca40e-199e-49f6-a300-71afd7f73183 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:52.737032 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeca40e-199e-49f6-a300-71afd7f73183 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:52.738344 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeca40e-199e-49f6-a300-71afd7f73183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:52.758544 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-9aeca40e-199e-49f6-a300-71afd7f73183 None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:52.760700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9aeca40e-199e-49f6-a300-71afd7f73183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:52.778865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:52.833306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1168/2357] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:52.844359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248b07-26bc-477a-9fda-3f4eb1c77b5c None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:52.863869 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248b07-26bc-477a-9fda-3f4eb1c77b5c None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:52.868004 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d927b-62aa-4ce2-9b46-60ac2aa10110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:52.868673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d927b-62aa-4ce2-9b46-60ac2aa10110 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:52.868956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d927b-62aa-4ce2-9b46-60ac2aa10110 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:52.869300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d927b-62aa-4ce2-9b46-60ac2aa10110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:52.884436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d927b-62aa-4ce2-9b46-60ac2aa10110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:52.886410 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d927b-62aa-4ce2-9b46-60ac2aa10110 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:52.903303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1190/2358] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:31:53.259537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeca40e-199e-49f6-a300-71afd7f73183 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:53.274003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9aeca40e-199e-49f6-a300-71afd7f73183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:53.313284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeca40e-199e-49f6-a300-71afd7f73183 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:53.326411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5919e-4e97-43da-a608-7b3091c2a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:53.331616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5919e-4e97-43da-a608-7b3091c2a1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:53.331616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5919e-4e97-43da-a608-7b3091c2a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:53.331616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5919e-4e97-43da-a608-7b3091c2a1f6 admin admin] PATH_INFO: `/v3/projects/4148a8d6705f418cb415af9d6643cf52` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:53.331616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5919e-4e97-43da-a608-7b3091c2a1f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4148a8d6705f418cb415af9d6643cf52)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:53.331910 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5919e-4e97-43da-a608-7b3091c2a1f6 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:53.504400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-33b5919e-4e97-43da-a608-7b3091c2a1f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4148a8d6705f418cb415af9d6643cf52', 'request_id': 'req-33b5919e-4e97-43da-a608-7b3091c2a1f6'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:53.604675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-33b5919e-4e97-43da-a608-7b3091c2a1f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4148a8d6705f418cb415af9d6643cf52', 'request_id': 'req-33b5919e-4e97-43da-a608-7b3091c2a1f6'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:53.611468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-33b5919e-4e97-43da-a608-7b3091c2a1f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4148a8d6705f418cb415af9d6643cf52', 'request_id': 'req-33b5919e-4e97-43da-a608-7b3091c2a1f6'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:53.622364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-33b5919e-4e97-43da-a608-7b3091c2a1f6 admin admin] The token cache is being invalidate because project 4148a8d6705f418cb415af9d6643cf52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:31:53.622656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-33b5919e-4e97-43da-a608-7b3091c2a1f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:53.623317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-33b5919e-4e97-43da-a608-7b3091c2a1f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:53.625090 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1169/2359] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:31:53 2022] DELETE /identity/v3/projects/4148a8d6705f418cb415af9d6643cf52 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:53.629958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517415b-5d75-4ec5-bddf-270f47d43d66 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:53.630453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517415b-5d75-4ec5-bddf-270f47d43d66 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:53.630553 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517415b-5d75-4ec5-bddf-270f47d43d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:53.648782 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-9517415b-5d75-4ec5-bddf-270f47d43d66 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:53.650021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9517415b-5d75-4ec5-bddf-270f47d43d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:53.713593 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1191/2360] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:53.721955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d4828-870d-47b4-8810-e372b73e7dff None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:53.722247 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d4828-870d-47b4-8810-e372b73e7dff None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:53.722531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d4828-870d-47b4-8810-e372b73e7dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:53.742114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-2d7d4828-870d-47b4-8810-e372b73e7dff None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:53.743310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2d7d4828-870d-47b4-8810-e372b73e7dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:53.752850 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1170/2361] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:53.756890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517415b-5d75-4ec5-bddf-270f47d43d66 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:53.769382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517415b-5d75-4ec5-bddf-270f47d43d66 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:53.774494 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea21b7-f105-40c3-a053-69f79b7deae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:53.777874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea21b7-f105-40c3-a053-69f79b7deae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:53.777874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea21b7-f105-40c3-a053-69f79b7deae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:53.777874 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea21b7-f105-40c3-a053-69f79b7deae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:53.778129 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea21b7-f105-40c3-a053-69f79b7deae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:31:53.778899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea21b7-f105-40c3-a053-69f79b7deae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:53.779914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea21b7-f105-40c3-a053-69f79b7deae4 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:53.793202 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1192/2362] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:31:53.797479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d4828-870d-47b4-8810-e372b73e7dff None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:53.808171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d4828-870d-47b4-8810-e372b73e7dff None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:53.814862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232d11b-ca39-4dca-8286-cef08c777b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:53.815458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232d11b-ca39-4dca-8286-cef08c777b49 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:53.815840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232d11b-ca39-4dca-8286-cef08c777b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:53.816118 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232d11b-ca39-4dca-8286-cef08c777b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:53.817074 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232d11b-ca39-4dca-8286-cef08c777b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:53.818788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232d11b-ca39-4dca-8286-cef08c777b49 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:53.942756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1171/2363] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:31:53 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:31:53.948055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea21b7-f105-40c3-a053-69f79b7deae4 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:53.957432 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:53.961732 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea21b7-f105-40c3-a053-69f79b7deae4 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:54.021974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560fa0-5571-4052-b7a7-e02c9c87f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:54.022969 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560fa0-5571-4052-b7a7-e02c9c87f340 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:54.023318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560fa0-5571-4052-b7a7-e02c9c87f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:54.023659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560fa0-5571-4052-b7a7-e02c9c87f340 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:54.024434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e560fa0-5571-4052-b7a7-e02c9c87f340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:54.026439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e560fa0-5571-4052-b7a7-e02c9c87f340 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:54.109285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1193/2364] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:31:53 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:31:54.114038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232d11b-ca39-4dca-8286-cef08c777b49 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:54.126868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232d11b-ca39-4dca-8286-cef08c777b49 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:54.131871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebedf0-b74a-43d6-bd4c-c629f2fed697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:54.132552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebedf0-b74a-43d6-bd4c-c629f2fed697 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:54.132845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebedf0-b74a-43d6-bd4c-c629f2fed697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:54.133144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebedf0-b74a-43d6-bd4c-c629f2fed697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:54.133914 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebedf0-b74a-43d6-bd4c-c629f2fed697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:54.135699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebedf0-b74a-43d6-bd4c-c629f2fed697 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:54.152855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1172/2365] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:54.154356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560fa0-5571-4052-b7a7-e02c9c87f340 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:54.169949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560fa0-5571-4052-b7a7-e02c9c87f340 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:54.173731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd873278-e32a-4fa9-8885-a53f05c3c22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:54.174484 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd873278-e32a-4fa9-8885-a53f05c3c22c admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:54.174906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd873278-e32a-4fa9-8885-a53f05c3c22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:54.175196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd873278-e32a-4fa9-8885-a53f05c3c22c admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:54.176081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd873278-e32a-4fa9-8885-a53f05c3c22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:54.177894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd873278-e32a-4fa9-8885-a53f05c3c22c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:54.194105 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1194/2366] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:31:54.198078 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebedf0-b74a-43d6-bd4c-c629f2fed697 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:54.209419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebedf0-b74a-43d6-bd4c-c629f2fed697 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:54.214298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646458e-e939-41af-b79e-383e5e9b48b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:54.224953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646458e-e939-41af-b79e-383e5e9b48b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:54.224953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646458e-e939-41af-b79e-383e5e9b48b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:54.224953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646458e-e939-41af-b79e-383e5e9b48b6 admin admin] PATH_INFO: `/v3/projects/e00bc61ceec0413295ef792436a2aab3/users/24fa9490f84c43eb83656a375d8638db/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:54.238707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646458e-e939-41af-b79e-383e5e9b48b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00bc61ceec0413295ef792436a2aab3, user_id=24fa9490f84c43eb83656a375d8638db, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:54.241444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646458e-e939-41af-b79e-383e5e9b48b6 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:54.319829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1173/2367] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:31:54 2022] PUT /identity/v3/projects/e00bc61ceec0413295ef792436a2aab3/users/24fa9490f84c43eb83656a375d8638db/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:54.331788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462678e2-81ad-4edc-be24-cc447ecddb4b None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:54.332085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462678e2-81ad-4edc-be24-cc447ecddb4b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:54.332372 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462678e2-81ad-4edc-be24-cc447ecddb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:54.360989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-462678e2-81ad-4edc-be24-cc447ecddb4b None None] MFA Rules not processed for user `24fa9490f84c43eb83656a375d8638db`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:54.362251 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-462678e2-81ad-4edc-be24-cc447ecddb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:54.430335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1195/2368] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:54.441588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646458e-e939-41af-b79e-383e5e9b48b6 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:54.443617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0646458e-e939-41af-b79e-383e5e9b48b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:54.494487 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:54.520592 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646458e-e939-41af-b79e-383e5e9b48b6 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:54.524694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d675956-4d70-4e2c-8ffc-3ba9239b49f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:54.525517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d675956-4d70-4e2c-8ffc-3ba9239b49f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:54.525917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d675956-4d70-4e2c-8ffc-3ba9239b49f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:54.526378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d675956-4d70-4e2c-8ffc-3ba9239b49f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:54.536916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d675956-4d70-4e2c-8ffc-3ba9239b49f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:54.538424 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d675956-4d70-4e2c-8ffc-3ba9239b49f8 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:54.548811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1174/2369] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:31:55.419948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462678e2-81ad-4edc-be24-cc447ecddb4b None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:55.421700 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-462678e2-81ad-4edc-be24-cc447ecddb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:55.633883 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462678e2-81ad-4edc-be24-cc447ecddb4b None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:55.642230 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:55.643371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:55.643659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:55.643935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] PATH_INFO: `/v3/users/21dae936bfcf462982bf8aa9275d56c5` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:55.645203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=21dae936bfcf462982bf8aa9275d56c5)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:55.648431 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:55.666488 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:55.877722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21dae936bfcf462982bf8aa9275d56c5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:55.993204 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21dae936bfcf462982bf8aa9275d56c5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:55.993848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21dae936bfcf462982bf8aa9275d56c5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:56.006579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21dae936bfcf462982bf8aa9275d56c5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:56.013203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21dae936bfcf462982bf8aa9275d56c5'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:56.019781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1196/2370] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:31:55 2022] DELETE /identity/v3/users/21dae936bfcf462982bf8aa9275d56c5 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:56.025283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce75996-d01a-41f6-b256-cb3b018f2fce None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:56.025283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce75996-d01a-41f6-b256-cb3b018f2fce None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:56.025283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce75996-d01a-41f6-b256-cb3b018f2fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:56.042503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-cce75996-d01a-41f6-b256-cb3b018f2fce None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:56.043705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-cce75996-d01a-41f6-b256-cb3b018f2fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:56.105597 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1175/2371] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:56.115600 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:56.117152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:56.172894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e3f24-a671-4475-9b46-b7cb37373c2d admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:56.176436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d63ae-3c35-441e-9d59-a485a2260a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:56.177081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d63ae-3c35-441e-9d59-a485a2260a32 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:56.177384 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d63ae-3c35-441e-9d59-a485a2260a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:56.177659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d63ae-3c35-441e-9d59-a485a2260a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:56.187373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d63ae-3c35-441e-9d59-a485a2260a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:56.188797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d63ae-3c35-441e-9d59-a485a2260a32 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:56.198841 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1197/2372] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:31:56.637558 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce75996-d01a-41f6-b256-cb3b018f2fce None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:56.639001 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-cce75996-d01a-41f6-b256-cb3b018f2fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:56.651720 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce75996-d01a-41f6-b256-cb3b018f2fce None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:56.656637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:56.657564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:56.657859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:56.658143 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] PATH_INFO: `/v3/projects/da925424882944f595b4a6b5af728629` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:56.660080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da925424882944f595b4a6b5af728629)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:56.662087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:56.798639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da925424882944f595b4a6b5af728629', 'request_id': 'req-de32d215-ae2b-4ccd-9805-68912140b8b2'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:56.871682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da925424882944f595b4a6b5af728629', 'request_id': 'req-de32d215-ae2b-4ccd-9805-68912140b8b2'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:56.880819 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da925424882944f595b4a6b5af728629', 'request_id': 'req-de32d215-ae2b-4ccd-9805-68912140b8b2'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:56.903414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] The token cache is being invalidate because project da925424882944f595b4a6b5af728629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:31:56.903708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:56.906517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:31:56.909881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1176/2373] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:31:56 2022] DELETE /identity/v3/projects/da925424882944f595b4a6b5af728629 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:31:57.310302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d252f7-875d-466e-b814-4b0f4ef56118 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:57.310789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d252f7-875d-466e-b814-4b0f4ef56118 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:57.310897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d252f7-875d-466e-b814-4b0f4ef56118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:57.328948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-74d252f7-875d-466e-b814-4b0f4ef56118 None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:31:57.330194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-74d252f7-875d-466e-b814-4b0f4ef56118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:57.388930 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1198/2374] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:31:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:31:57.401160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:31:57.402666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:31:57.471809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:31:57.477976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32d215-ae2b-4ccd-9805-68912140b8b2 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:31:57.483948 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1a149-c6c7-4c2d-b279-78bc44845c9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:31:57.485957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1a149-c6c7-4c2d-b279-78bc44845c9e service swift] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:31:57.485957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1a149-c6c7-4c2d-b279-78bc44845c9e service swift] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:31:57.485957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1a149-c6c7-4c2d-b279-78bc44845c9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:31:57.493642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1a149-c6c7-4c2d-b279-78bc44845c9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:31:57.495412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1a149-c6c7-4c2d-b279-78bc44845c9e service swift] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:31:57.504199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1177/2375] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:31:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:32:07.295447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d252f7-875d-466e-b814-4b0f4ef56118 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:07.296898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-74d252f7-875d-466e-b814-4b0f4ef56118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:07.340181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:07.362948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d252f7-875d-466e-b814-4b0f4ef56118 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:07.367500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:07.368367 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:07.368647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:07.368918 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] PATH_INFO: `/v3/users/24fa9490f84c43eb83656a375d8638db` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:07.370969 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24fa9490f84c43eb83656a375d8638db)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:07.372956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:07.595343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24fa9490f84c43eb83656a375d8638db'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:07.673102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:07.690718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24fa9490f84c43eb83656a375d8638db'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:07.691333 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24fa9490f84c43eb83656a375d8638db'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:07.703775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24fa9490f84c43eb83656a375d8638db'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:07.710706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24fa9490f84c43eb83656a375d8638db'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:07.716730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1199/2376] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:32:07 2022] DELETE /identity/v3/users/24fa9490f84c43eb83656a375d8638db => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:32:07.721189 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cda5c-e51f-40e5-bc7e-ac6a78f9a8ae None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:07.721488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cda5c-e51f-40e5-bc7e-ac6a78f9a8ae None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:07.721800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cda5c-e51f-40e5-bc7e-ac6a78f9a8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:07.739786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-806cda5c-e51f-40e5-bc7e-ac6a78f9a8ae None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:32:07.740982 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-806cda5c-e51f-40e5-bc7e-ac6a78f9a8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:07.798233 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1178/2377] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:32:07.808506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:07.809928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:07.868813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b7819-d3e0-4b97-8a2f-ae87a06acdf3 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:07.872400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfb643-cbdb-4aac-b3a2-4b68712cc2fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:07.873048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfb643-cbdb-4aac-b3a2-4b68712cc2fd service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:07.873377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfb643-cbdb-4aac-b3a2-4b68712cc2fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:07.873654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfb643-cbdb-4aac-b3a2-4b68712cc2fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:07.883100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfb643-cbdb-4aac-b3a2-4b68712cc2fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:07.884548 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfb643-cbdb-4aac-b3a2-4b68712cc2fd service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:07.894079 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1200/2378] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:32:08.183187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cda5c-e51f-40e5-bc7e-ac6a78f9a8ae None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:08.184775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-806cda5c-e51f-40e5-bc7e-ac6a78f9a8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:08.200941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cda5c-e51f-40e5-bc7e-ac6a78f9a8ae None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:08.207234 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe2bbc-95f8-4735-a5ef-07286a2edda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:08.208389 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe2bbc-95f8-4735-a5ef-07286a2edda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:08.209146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe2bbc-95f8-4735-a5ef-07286a2edda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:08.209661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe2bbc-95f8-4735-a5ef-07286a2edda6 admin admin] PATH_INFO: `/v3/users/e512c98d6d12489aa73180c7a5cb7b66` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:08.211133 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe2bbc-95f8-4735-a5ef-07286a2edda6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e512c98d6d12489aa73180c7a5cb7b66)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:08.213396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe2bbc-95f8-4735-a5ef-07286a2edda6 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:08.417081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfb643-cbdb-4aac-b3a2-4b68712cc2fd service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:08.419169 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8bbfb643-cbdb-4aac-b3a2-4b68712cc2fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:08.440439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b7fe2bbc-95f8-4735-a5ef-07286a2edda6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e512c98d6d12489aa73180c7a5cb7b66'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:08.462581 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfb643-cbdb-4aac-b3a2-4b68712cc2fd service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:08.468352 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740778a2-e043-468b-840e-1898f210123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:08.469270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740778a2-e043-468b-840e-1898f210123b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:08.469563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740778a2-e043-468b-840e-1898f210123b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:08.469841 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740778a2-e043-468b-840e-1898f210123b admin admin] PATH_INFO: `/v3/projects/e00bc61ceec0413295ef792436a2aab3` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:08.471577 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740778a2-e043-468b-840e-1898f210123b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00bc61ceec0413295ef792436a2aab3)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:08.473559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740778a2-e043-468b-840e-1898f210123b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:08.530162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b7fe2bbc-95f8-4735-a5ef-07286a2edda6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e512c98d6d12489aa73180c7a5cb7b66'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:08.551358 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b7fe2bbc-95f8-4735-a5ef-07286a2edda6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e512c98d6d12489aa73180c7a5cb7b66'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:08.552367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b7fe2bbc-95f8-4735-a5ef-07286a2edda6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e512c98d6d12489aa73180c7a5cb7b66'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:08.559807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b7fe2bbc-95f8-4735-a5ef-07286a2edda6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e512c98d6d12489aa73180c7a5cb7b66'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:08.566702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1179/2379] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:32:08 2022] DELETE /identity/v3/users/e512c98d6d12489aa73180c7a5cb7b66 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:32:08.570718 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bd241-3488-4673-9b6d-a71207a1b104 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:08.571019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bd241-3488-4673-9b6d-a71207a1b104 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:08.571306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bd241-3488-4673-9b6d-a71207a1b104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:08.589953 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-2b7bd241-3488-4673-9b6d-a71207a1b104 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:32:08.591170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2b7bd241-3488-4673-9b6d-a71207a1b104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:08.659813 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1180/2380] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:32:08.670800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bd241-3488-4673-9b6d-a71207a1b104 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:08.672378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-2b7bd241-3488-4673-9b6d-a71207a1b104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:08.683183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-740778a2-e043-468b-840e-1898f210123b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00bc61ceec0413295ef792436a2aab3', 'request_id': 'req-740778a2-e043-468b-840e-1898f210123b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:08.685848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:08.729190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bd241-3488-4673-9b6d-a71207a1b104 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:08.776888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422a3a2-5076-492e-82be-782affcf4b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:08.777574 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422a3a2-5076-492e-82be-782affcf4b0b service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:08.777878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422a3a2-5076-492e-82be-782affcf4b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:08.778131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422a3a2-5076-492e-82be-782affcf4b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:08.781266 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-740778a2-e043-468b-840e-1898f210123b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00bc61ceec0413295ef792436a2aab3', 'request_id': 'req-740778a2-e043-468b-840e-1898f210123b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:08.783085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:08.788976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-740778a2-e043-468b-840e-1898f210123b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00bc61ceec0413295ef792436a2aab3', 'request_id': 'req-740778a2-e043-468b-840e-1898f210123b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:08.803719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-740778a2-e043-468b-840e-1898f210123b admin admin] The token cache is being invalidate because project e00bc61ceec0413295ef792436a2aab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:32:08.804231 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-740778a2-e043-468b-840e-1898f210123b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:08.805255 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-740778a2-e043-468b-840e-1898f210123b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:08.809246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1201/2381] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:32:08 2022] DELETE /identity/v3/projects/e00bc61ceec0413295ef792436a2aab3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:32:08.814911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740778a2-e043-468b-840e-1898f210123b admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:08.817159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-740778a2-e043-468b-840e-1898f210123b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:08.848624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422a3a2-5076-492e-82be-782affcf4b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:08.850540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422a3a2-5076-492e-82be-782affcf4b0b service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:08.861813 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1181/2382] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:32:08.863229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c38461-7938-4623-82d6-b6cb79c3ee14 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:08.863627 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c38461-7938-4623-82d6-b6cb79c3ee14 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:08.863966 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c38461-7938-4623-82d6-b6cb79c3ee14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:08.893659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e3c38461-7938-4623-82d6-b6cb79c3ee14 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:32:08.895901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e3c38461-7938-4623-82d6-b6cb79c3ee14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:08.905192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1182/2383] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:32:08.914657 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a467ba-4aef-44e6-bd75-72eb289076e6 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:08.914657 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a467ba-4aef-44e6-bd75-72eb289076e6 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:08.914657 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a467ba-4aef-44e6-bd75-72eb289076e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:08.922439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740778a2-e043-468b-840e-1898f210123b admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:08.928459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f15281-6f25-4772-bd4d-2637b9d8e6da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b62795a6111a4c05a24e69efc7a0faba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:08.929152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f15281-6f25-4772-bd4d-2637b9d8e6da service placement] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:08.929475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f15281-6f25-4772-bd4d-2637b9d8e6da service placement] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:08.929812 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f15281-6f25-4772-bd4d-2637b9d8e6da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:08.931670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-37f15281-6f25-4772-bd4d-2637b9d8e6da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:08.944779 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-29a467ba-4aef-44e6-bd75-72eb289076e6 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:32:08.945308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f15281-6f25-4772-bd4d-2637b9d8e6da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:08.946265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-29a467ba-4aef-44e6-bd75-72eb289076e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:08.946926 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f15281-6f25-4772-bd4d-2637b9d8e6da service placement] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:08.957832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1183/2384] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:32:08.963098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1202/2385] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:32:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:32:08.968193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a467ba-4aef-44e6-bd75-72eb289076e6 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:08.979328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a467ba-4aef-44e6-bd75-72eb289076e6 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:08.985363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84866abd-eb8e-4da4-aa3b-b50cff149884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:08.986579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84866abd-eb8e-4da4-aa3b-b50cff149884 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:08.987375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84866abd-eb8e-4da4-aa3b-b50cff149884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:08.987847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84866abd-eb8e-4da4-aa3b-b50cff149884 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:08.988892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84866abd-eb8e-4da4-aa3b-b50cff149884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:32:08.989238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84866abd-eb8e-4da4-aa3b-b50cff149884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:08.991715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84866abd-eb8e-4da4-aa3b-b50cff149884 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:09.007630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1184/2386] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:32:09.011829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f15281-6f25-4772-bd4d-2637b9d8e6da service placement] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:09.022596 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f15281-6f25-4772-bd4d-2637b9d8e6da service placement] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:09.027358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6d843-84cd-4aec-8d29-40f3217504f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:09.027996 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6d843-84cd-4aec-8d29-40f3217504f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:09.028298 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6d843-84cd-4aec-8d29-40f3217504f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:09.028610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6d843-84cd-4aec-8d29-40f3217504f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:09.029356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6d843-84cd-4aec-8d29-40f3217504f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:09.031288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6d843-84cd-4aec-8d29-40f3217504f5 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:09.156357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1203/2387] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:32:09 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:32:09.161207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84866abd-eb8e-4da4-aa3b-b50cff149884 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:09.178152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84866abd-eb8e-4da4-aa3b-b50cff149884 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:09.260607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:09.276545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a0ff5-180b-44ca-9c52-77e59ff6bd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:09.277333 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a0ff5-180b-44ca-9c52-77e59ff6bd8a admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:09.277626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a0ff5-180b-44ca-9c52-77e59ff6bd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:09.277910 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a0ff5-180b-44ca-9c52-77e59ff6bd8a admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:09.278652 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a0ff5-180b-44ca-9c52-77e59ff6bd8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:09.281164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a0ff5-180b-44ca-9c52-77e59ff6bd8a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:09.333099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6d843-84cd-4aec-8d29-40f3217504f5 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:09.335161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-26e6d843-84cd-4aec-8d29-40f3217504f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:09.348613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6d843-84cd-4aec-8d29-40f3217504f5 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:09.354298 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a5604-919b-4b12-b852-14e269c0c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:09.355306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a5604-919b-4b12-b852-14e269c0c956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:09.355944 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a5604-919b-4b12-b852-14e269c0c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:09.356286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a5604-919b-4b12-b852-14e269c0c956 admin admin] PATH_INFO: `/v3/projects/3d1595fc4614415cb0e7db361cd911e5` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:09.357543 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a5604-919b-4b12-b852-14e269c0c956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1595fc4614415cb0e7db361cd911e5)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:09.359642 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a5604-919b-4b12-b852-14e269c0c956 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:09.412658 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1185/2388] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:32:09 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:32:09.417095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a0ff5-180b-44ca-9c52-77e59ff6bd8a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:09.428801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a0ff5-180b-44ca-9c52-77e59ff6bd8a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:09.436234 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417ce3a-d83e-4881-8866-987d1ebf3157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:09.436234 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417ce3a-d83e-4881-8866-987d1ebf3157 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:09.436234 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417ce3a-d83e-4881-8866-987d1ebf3157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:09.436485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417ce3a-d83e-4881-8866-987d1ebf3157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:09.437170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417ce3a-d83e-4881-8866-987d1ebf3157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:09.438825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417ce3a-d83e-4881-8866-987d1ebf3157 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:09.451537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1186/2389] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:32:09.459717 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417ce3a-d83e-4881-8866-987d1ebf3157 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:09.471355 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417ce3a-d83e-4881-8866-987d1ebf3157 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:09.478424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-9d6a5604-919b-4b12-b852-14e269c0c956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1595fc4614415cb0e7db361cd911e5', 'request_id': 'req-9d6a5604-919b-4b12-b852-14e269c0c956'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:09.532905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77f7f9-13be-4bc1-81f9-cf62e1e2e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:09.533587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77f7f9-13be-4bc1-81f9-cf62e1e2e23d admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:09.533881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77f7f9-13be-4bc1-81f9-cf62e1e2e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:09.539233 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77f7f9-13be-4bc1-81f9-cf62e1e2e23d admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:09.539233 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77f7f9-13be-4bc1-81f9-cf62e1e2e23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:09.539461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-9d6a5604-919b-4b12-b852-14e269c0c956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1595fc4614415cb0e7db361cd911e5', 'request_id': 'req-9d6a5604-919b-4b12-b852-14e269c0c956'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:09.539566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77f7f9-13be-4bc1-81f9-cf62e1e2e23d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:09.550171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1187/2390] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:32:09.551189 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77f7f9-13be-4bc1-81f9-cf62e1e2e23d admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:09.553931 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-9d6a5604-919b-4b12-b852-14e269c0c956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1595fc4614415cb0e7db361cd911e5', 'request_id': 'req-9d6a5604-919b-4b12-b852-14e269c0c956'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:09.562307 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77f7f9-13be-4bc1-81f9-cf62e1e2e23d admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:09.567997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-9d6a5604-919b-4b12-b852-14e269c0c956 admin admin] The token cache is being invalidate because project 3d1595fc4614415cb0e7db361cd911e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:32:09.567997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-9d6a5604-919b-4b12-b852-14e269c0c956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:09.568538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb971c-2922-4ad4-9a89-d895f5a814ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:09.568909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-9d6a5604-919b-4b12-b852-14e269c0c956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:32:09.569463 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb971c-2922-4ad4-9a89-d895f5a814ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:09.569746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb971c-2922-4ad4-9a89-d895f5a814ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:09.570021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb971c-2922-4ad4-9a89-d895f5a814ff admin admin] PATH_INFO: `/v3/projects/10ef0ee206d24b5aa3388600a27eb0c4/users/afdfb530e9d34805b568b2333a1d1c10/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:09.571097 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1204/2391] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:32:09 2022] DELETE /identity/v3/projects/3d1595fc4614415cb0e7db361cd911e5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:32:09.591966 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb971c-2922-4ad4-9a89-d895f5a814ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ef0ee206d24b5aa3388600a27eb0c4, user_id=afdfb530e9d34805b568b2333a1d1c10, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:09.595282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb971c-2922-4ad4-9a89-d895f5a814ff admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:09.710916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1188/2392] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:32:09 2022] PUT /identity/v3/projects/10ef0ee206d24b5aa3388600a27eb0c4/users/afdfb530e9d34805b568b2333a1d1c10/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:32:09.718903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36270b-8a45-47a2-9ac4-aca4fcf36ea7 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:09.725217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36270b-8a45-47a2-9ac4-aca4fcf36ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:09.725217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36270b-8a45-47a2-9ac4-aca4fcf36ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:09.762065 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ae36270b-8a45-47a2-9ac4-aca4fcf36ea7 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:32:09.763592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ae36270b-8a45-47a2-9ac4-aca4fcf36ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:09.802613 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:09.840098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1205/2393] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:32:09.848769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb971c-2922-4ad4-9a89-d895f5a814ff admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:09.851593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e3fb971c-2922-4ad4-9a89-d895f5a814ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:09.921030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb971c-2922-4ad4-9a89-d895f5a814ff admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:09.925529 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d129e72-b077-475d-82a4-fa7b1bad974e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:09.926201 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d129e72-b077-475d-82a4-fa7b1bad974e service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:09.926492 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d129e72-b077-475d-82a4-fa7b1bad974e service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:09.926771 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d129e72-b077-475d-82a4-fa7b1bad974e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:09.954552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d129e72-b077-475d-82a4-fa7b1bad974e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:09.956110 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d129e72-b077-475d-82a4-fa7b1bad974e service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:09.967863 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1189/2394] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:32:14.941628 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc36ee-6d75-4fbe-a35c-daf5d393593a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:14.942174 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc36ee-6d75-4fbe-a35c-daf5d393593a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:14.942503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc36ee-6d75-4fbe-a35c-daf5d393593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:14.992067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-39cc36ee-6d75-4fbe-a35c-daf5d393593a None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:32:14.994506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-39cc36ee-6d75-4fbe-a35c-daf5d393593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:15.101242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1206/2395] 10.222.0.26 () {58 vars in 967 bytes} [Tue Jul 12 16:32:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:32:15.125564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d129e72-b077-475d-82a4-fa7b1bad974e service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:15.127086 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3d129e72-b077-475d-82a4-fa7b1bad974e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:15.256652 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:15.309289 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d129e72-b077-475d-82a4-fa7b1bad974e service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:15.325998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d16ab8-b540-49b2-827c-62d927cbfb71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:15.327228 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d16ab8-b540-49b2-827c-62d927cbfb71 service swift] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:15.327870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d16ab8-b540-49b2-827c-62d927cbfb71 service swift] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:15.329324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d16ab8-b540-49b2-827c-62d927cbfb71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:15.351563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d16ab8-b540-49b2-827c-62d927cbfb71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:15.354248 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d16ab8-b540-49b2-827c-62d927cbfb71 service swift] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:15.373327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1190/2396] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:32:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:32:17.404191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6899a91-c0f5-4c71-b7b0-752ff5a821e7 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:17.405343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6899a91-c0f5-4c71-b7b0-752ff5a821e7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:17.405801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6899a91-c0f5-4c71-b7b0-752ff5a821e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:17.442578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-d6899a91-c0f5-4c71-b7b0-752ff5a821e7 None None] MFA Rules not processed for user `afdfb530e9d34805b568b2333a1d1c10`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:32:17.443739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d6899a91-c0f5-4c71-b7b0-752ff5a821e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:17.515210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1207/2397] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:32:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:32:17.520277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d16ab8-b540-49b2-827c-62d927cbfb71 service swift] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:17.521804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e9d16ab8-b540-49b2-827c-62d927cbfb71 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:17.536628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d16ab8-b540-49b2-827c-62d927cbfb71 service swift] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:17.542295 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df67d78-e9e0-41f7-ad98-cbe82b82b54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:17.542958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df67d78-e9e0-41f7-ad98-cbe82b82b54c admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:17.543244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df67d78-e9e0-41f7-ad98-cbe82b82b54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:17.543522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df67d78-e9e0-41f7-ad98-cbe82b82b54c admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:17.544219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df67d78-e9e0-41f7-ad98-cbe82b82b54c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:17.546177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df67d78-e9e0-41f7-ad98-cbe82b82b54c admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:17.654323 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1191/2398] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:32:17 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:32:17.654480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6899a91-c0f5-4c71-b7b0-752ff5a821e7 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:17.666205 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6899a91-c0f5-4c71-b7b0-752ff5a821e7 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:17.739392 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6d91f-9ee8-4794-8a86-fc010f2ab3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:17.740287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6d91f-9ee8-4794-8a86-fc010f2ab3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:17.740643 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6d91f-9ee8-4794-8a86-fc010f2ab3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:17.740925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6d91f-9ee8-4794-8a86-fc010f2ab3f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:17.741780 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6d91f-9ee8-4794-8a86-fc010f2ab3f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:17.743706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6d91f-9ee8-4794-8a86-fc010f2ab3f6 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:17.840088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:17.846335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1208/2399] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:32:17 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:32:17.849979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df67d78-e9e0-41f7-ad98-cbe82b82b54c admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:17.863403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df67d78-e9e0-41f7-ad98-cbe82b82b54c admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:17.868208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32053ba8-2294-41cf-b4dc-1a1454f8e3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:17.871416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32053ba8-2294-41cf-b4dc-1a1454f8e3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:17.871416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32053ba8-2294-41cf-b4dc-1a1454f8e3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:17.871416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32053ba8-2294-41cf-b4dc-1a1454f8e3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:17.871416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32053ba8-2294-41cf-b4dc-1a1454f8e3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:17.871993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32053ba8-2294-41cf-b4dc-1a1454f8e3d3 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:17.883047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1192/2400] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:32:17.887091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6d91f-9ee8-4794-8a86-fc010f2ab3f6 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:17.897434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6d91f-9ee8-4794-8a86-fc010f2ab3f6 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:17.902285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e7cc-e77a-491a-b87a-fa0f7e9721da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:17.903210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e7cc-e77a-491a-b87a-fa0f7e9721da admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:17.903497 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e7cc-e77a-491a-b87a-fa0f7e9721da admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:17.903776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e7cc-e77a-491a-b87a-fa0f7e9721da admin admin] PATH_INFO: `/v3/projects/9428b9bdfb5847bead41fca6d9d20e1d/users/c14593be390e48c8b270090284bffc9c/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:17.920813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374e7cc-e77a-491a-b87a-fa0f7e9721da admin admin] RBAC: Authorizing `identity:create_grant(project_id=9428b9bdfb5847bead41fca6d9d20e1d, user_id=c14593be390e48c8b270090284bffc9c, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:17.924122 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374e7cc-e77a-491a-b87a-fa0f7e9721da admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:18.003133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1209/2401] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:32:17 2022] PUT /identity/v3/projects/9428b9bdfb5847bead41fca6d9d20e1d/users/c14593be390e48c8b270090284bffc9c/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:32:18.007037 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32053ba8-2294-41cf-b4dc-1a1454f8e3d3 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:18.017402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32053ba8-2294-41cf-b4dc-1a1454f8e3d3 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:18.080219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183b6c0-c22c-44af-a289-614af71629f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:18.080890 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b6c0-c22c-44af-a289-614af71629f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:18.081209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b6c0-c22c-44af-a289-614af71629f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:18.081494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b6c0-c22c-44af-a289-614af71629f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:18.082224 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183b6c0-c22c-44af-a289-614af71629f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:18.083826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183b6c0-c22c-44af-a289-614af71629f9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:18.093923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1193/2402] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:32:18.098866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e7cc-e77a-491a-b87a-fa0f7e9721da admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:18.114851 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e7cc-e77a-491a-b87a-fa0f7e9721da admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:18.119718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dc474-5d35-448d-9f95-3c6441559af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:18.120730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc474-5d35-448d-9f95-3c6441559af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:18.121166 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc474-5d35-448d-9f95-3c6441559af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:18.121528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc474-5d35-448d-9f95-3c6441559af3 admin admin] PATH_INFO: `/v3/projects/9428b9bdfb5847bead41fca6d9d20e1d/users/c14593be390e48c8b270090284bffc9c/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:18.123758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dc474-5d35-448d-9f95-3c6441559af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9428b9bdfb5847bead41fca6d9d20e1d, user_id=c14593be390e48c8b270090284bffc9c, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:18.126582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dc474-5d35-448d-9f95-3c6441559af3 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:18.138840 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1210/2403] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:32:18 2022] PUT /identity/v3/projects/9428b9bdfb5847bead41fca6d9d20e1d/users/c14593be390e48c8b270090284bffc9c/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:32:24.337094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3ff9-dbe3-4be9-819a-0ff583612789 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:24.337642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3ff9-dbe3-4be9-819a-0ff583612789 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:24.337642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3ff9-dbe3-4be9-819a-0ff583612789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:24.373789 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-27fd3ff9-dbe3-4be9-819a-0ff583612789 None None] MFA Rules not processed for user `c14593be390e48c8b270090284bffc9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:32:24.375015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-27fd3ff9-dbe3-4be9-819a-0ff583612789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:24.452957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1194/2404] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:32:24.464393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dc474-5d35-448d-9f95-3c6441559af3 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:24.466270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3d1dc474-5d35-448d-9f95-3c6441559af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:24.532536 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dc474-5d35-448d-9f95-3c6441559af3 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:24.536354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1b03e-da2c-4011-b3a6-ea1ff0466f41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f9ba17c2634999b350b887a5229e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:24.537018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1b03e-da2c-4011-b3a6-ea1ff0466f41 service glance] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:24.537343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1b03e-da2c-4011-b3a6-ea1ff0466f41 service glance] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:24.537622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1b03e-da2c-4011-b3a6-ea1ff0466f41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:24.598264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1b03e-da2c-4011-b3a6-ea1ff0466f41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:24.599754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1b03e-da2c-4011-b3a6-ea1ff0466f41 service glance] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:24.609492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1211/2405] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:32:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:32:24.894511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ef187-7352-4d17-8a31-6f85f97e2dd3 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:24.894859 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ef187-7352-4d17-8a31-6f85f97e2dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:24.895149 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ef187-7352-4d17-8a31-6f85f97e2dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:24.916117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-328ef187-7352-4d17-8a31-6f85f97e2dd3 None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:32:24.924603 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-328ef187-7352-4d17-8a31-6f85f97e2dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:24.951281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:24.995848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1195/2406] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:32:25.012157 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1b03e-da2c-4011-b3a6-ea1ff0466f41 service glance] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:25.106104 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1b03e-da2c-4011-b3a6-ea1ff0466f41 service glance] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:25.109338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258710d4-4da7-4fba-8c16-45af6726571f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:25.110396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258710d4-4da7-4fba-8c16-45af6726571f service swift] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:25.110836 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258710d4-4da7-4fba-8c16-45af6726571f service swift] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:25.111264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258710d4-4da7-4fba-8c16-45af6726571f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:25.122270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258710d4-4da7-4fba-8c16-45af6726571f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:25.124209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258710d4-4da7-4fba-8c16-45af6726571f service swift] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:25.135572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1212/2407] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:32:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:32:26.698902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ef187-7352-4d17-8a31-6f85f97e2dd3 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:26.762123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ef187-7352-4d17-8a31-6f85f97e2dd3 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:26.765873 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b484862-56b1-458e-be36-1a30eaa99adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:26.766655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b484862-56b1-458e-be36-1a30eaa99adc service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:26.766970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b484862-56b1-458e-be36-1a30eaa99adc service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:26.767267 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b484862-56b1-458e-be36-1a30eaa99adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:26.769040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7b484862-56b1-458e-be36-1a30eaa99adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:26.848860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b484862-56b1-458e-be36-1a30eaa99adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:26.850862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b484862-56b1-458e-be36-1a30eaa99adc service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:26.862952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1196/2408] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:32:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:32:35.131032 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:36.348143 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c08a7-9a4e-4cdf-983a-a4d4aa4dab94 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:36.348734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c08a7-9a4e-4cdf-983a-a4d4aa4dab94 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:36.348734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c08a7-9a4e-4cdf-983a-a4d4aa4dab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:36.366167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-279c08a7-9a4e-4cdf-983a-a4d4aa4dab94 None None] MFA Rules not processed for user `afdfb530e9d34805b568b2333a1d1c10`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:32:36.367349 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-279c08a7-9a4e-4cdf-983a-a4d4aa4dab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:36.374149 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1213/2409] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:32:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:32:36.857507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=64 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:39.960733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687f787-2a2b-4cae-a3d9-02f988ac2fea None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:39.961345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687f787-2a2b-4cae-a3d9-02f988ac2fea None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:39.961345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687f787-2a2b-4cae-a3d9-02f988ac2fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:39.978410 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-d687f787-2a2b-4cae-a3d9-02f988ac2fea None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:32:39.979556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d687f787-2a2b-4cae-a3d9-02f988ac2fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:32:39.987343 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1197/2410] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:32:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:32:39.999089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c08a7-9a4e-4cdf-983a-a4d4aa4dab94 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:32:40.011449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c08a7-9a4e-4cdf-983a-a4d4aa4dab94 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:32:40.016480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfd232-665d-42bd-9c00-a715484a560b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:32:40.017210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfd232-665d-42bd-9c00-a715484a560b service swift] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:32:40.017493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfd232-665d-42bd-9c00-a715484a560b service swift] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:32:40.017769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfd232-665d-42bd-9c00-a715484a560b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:32:40.025798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfd232-665d-42bd-9c00-a715484a560b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:32:40.027363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfd232-665d-42bd-9c00-a715484a560b service swift] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:32:40.035220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1214/2411] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:32:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:32:49.973369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:32:50.032095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=9 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:33:06.250319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687f787-2a2b-4cae-a3d9-02f988ac2fea None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:33:06.252399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d687f787-2a2b-4cae-a3d9-02f988ac2fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:33:06.263830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687f787-2a2b-4cae-a3d9-02f988ac2fea None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:33:06.267595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed05af-ddd3-4b78-8c65-4f544c0e791a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:33:06.268239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed05af-ddd3-4b78-8c65-4f544c0e791a service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:33:06.268524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed05af-ddd3-4b78-8c65-4f544c0e791a service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:33:06.268806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed05af-ddd3-4b78-8c65-4f544c0e791a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:33:06.278001 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed05af-ddd3-4b78-8c65-4f544c0e791a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:33:06.279479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed05af-ddd3-4b78-8c65-4f544c0e791a service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:33:06.289219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1198/2412] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:33:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:33:09.155406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f76cd-ac7b-4e7b-9637-86358c0a726f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:33:09.155930 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f76cd-ac7b-4e7b-9637-86358c0a726f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:33:09.156044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f76cd-ac7b-4e7b-9637-86358c0a726f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:33:09.175180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-cb5f76cd-ac7b-4e7b-9637-86358c0a726f None None] MFA Rules not processed for user `8a248a93038e426da3ed5ab25a65eb81`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:33:09.176456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-cb5f76cd-ac7b-4e7b-9637-86358c0a726f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:33:09.259681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1215/2413] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:33:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:33:16.284860 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=6 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:33:19.251915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=25 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:33:25.989134 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd67d4-6212-4a11-8c2b-27257d7556bf None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:33:25.989650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd67d4-6212-4a11-8c2b-27257d7556bf None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:33:25.989753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd67d4-6212-4a11-8c2b-27257d7556bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:33:26.007716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-47cd67d4-6212-4a11-8c2b-27257d7556bf None None] MFA Rules not processed for user `071dc15e85a849afa9b9663f7e5f428e`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:33:26.008908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-47cd67d4-6212-4a11-8c2b-27257d7556bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:33:26.063107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1199/2414] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:33:36.056625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=25 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:33:37.776531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011739f-f00a-49fa-9745-f44fbd5f38b7 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:33:37.777071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011739f-f00a-49fa-9745-f44fbd5f38b7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:33:37.777071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011739f-f00a-49fa-9745-f44fbd5f38b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:33:37.795305 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-1011739f-f00a-49fa-9745-f44fbd5f38b7 None None] MFA Rules not processed for user `ddfe9bf33946474f8ea4019d2c9e86e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:33:37.796497 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1011739f-f00a-49fa-9745-f44fbd5f38b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:33:37.857108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1216/2415] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:33:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:33:47.850250 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=25 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:34:09.530319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd67d4-6212-4a11-8c2b-27257d7556bf None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:09.531740 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-47cd67d4-6212-4a11-8c2b-27257d7556bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:09.587433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd67d4-6212-4a11-8c2b-27257d7556bf None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:09.591001 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ae7e5-a160-46d0-affe-1fba5fe979a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:09.591641 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ae7e5-a160-46d0-affe-1fba5fe979a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:09.591927 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ae7e5-a160-46d0-affe-1fba5fe979a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:09.592204 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ae7e5-a160-46d0-affe-1fba5fe979a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:09.593973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8d0ae7e5-a160-46d0-affe-1fba5fe979a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:09.661976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ae7e5-a160-46d0-affe-1fba5fe979a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:09.663413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ae7e5-a160-46d0-affe-1fba5fe979a4 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:09.675336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1200/2416] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:10.158801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011739f-f00a-49fa-9745-f44fbd5f38b7 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:10.169827 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011739f-f00a-49fa-9745-f44fbd5f38b7 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:10.173400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f0ea8-f5f9-4b24-aa95-1ed064679cb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f9ba17c2634999b350b887a5229e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:10.174044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f0ea8-f5f9-4b24-aa95-1ed064679cb8 service glance] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:10.174347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f0ea8-f5f9-4b24-aa95-1ed064679cb8 service glance] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:10.174634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f0ea8-f5f9-4b24-aa95-1ed064679cb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:10.176980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4b0f0ea8-f5f9-4b24-aa95-1ed064679cb8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:10.191697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f0ea8-f5f9-4b24-aa95-1ed064679cb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:10.193178 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f0ea8-f5f9-4b24-aa95-1ed064679cb8 service glance] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:10.203990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1217/2417] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:13.993708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ae7e5-a160-46d0-affe-1fba5fe979a4 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:13.995164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8d0ae7e5-a160-46d0-affe-1fba5fe979a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:14.008700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ae7e5-a160-46d0-affe-1fba5fe979a4 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:14.019843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfa3c4-1131-47b3-8f20-6cf5ba6de10d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:14.020493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfa3c4-1131-47b3-8f20-6cf5ba6de10d service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:14.020775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfa3c4-1131-47b3-8f20-6cf5ba6de10d service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:14.021049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfa3c4-1131-47b3-8f20-6cf5ba6de10d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:14.022862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d3cfa3c4-1131-47b3-8f20-6cf5ba6de10d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:14.033473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfa3c4-1131-47b3-8f20-6cf5ba6de10d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:14.035650 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfa3c4-1131-47b3-8f20-6cf5ba6de10d service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:14.044849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1201/2418] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:17.337469 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f0ea8-f5f9-4b24-aa95-1ed064679cb8 service glance] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:17.346725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f0ea8-f5f9-4b24-aa95-1ed064679cb8 service glance] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:17.350419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5a9b3-05e2-4d94-81bb-5ea8f25a1fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:17.351066 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5a9b3-05e2-4d94-81bb-5ea8f25a1fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:17.351337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5a9b3-05e2-4d94-81bb-5ea8f25a1fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:17.351614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5a9b3-05e2-4d94-81bb-5ea8f25a1fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:17.353677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4fd5a9b3-05e2-4d94-81bb-5ea8f25a1fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:17.364425 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5a9b3-05e2-4d94-81bb-5ea8f25a1fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:17.370331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5a9b3-05e2-4d94-81bb-5ea8f25a1fb8 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:17.374838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1218/2419] 10.222.0.26 () {60 vars in 1396 bytes} [Tue Jul 12 16:34:17 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:24.040505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=60 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:34:27.370972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=12 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:34:31.861892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dc388-5306-4236-9c32-749c83fe4d06 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:31.862380 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dc388-5306-4236-9c32-749c83fe4d06 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:31.862498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dc388-5306-4236-9c32-749c83fe4d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:31.882054 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e54dc388-5306-4236-9c32-749c83fe4d06 None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:34:31.883296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e54dc388-5306-4236-9c32-749c83fe4d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:31.891043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1202/2420] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:34:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:34:31.935835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5a9b3-05e2-4d94-81bb-5ea8f25a1fb8 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:31.947285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5a9b3-05e2-4d94-81bb-5ea8f25a1fb8 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:31.955358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fac4e3-8c16-47d5-9896-7f4227e6678c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:31.956259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fac4e3-8c16-47d5-9896-7f4227e6678c service swift] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:31.956545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fac4e3-8c16-47d5-9896-7f4227e6678c service swift] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:31.956822 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fac4e3-8c16-47d5-9896-7f4227e6678c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:31.966759 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fac4e3-8c16-47d5-9896-7f4227e6678c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:31.970607 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fac4e3-8c16-47d5-9896-7f4227e6678c service swift] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:31.980357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1219/2421] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:34:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 16:34:33.405266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54dc388-5306-4236-9c32-749c83fe4d06 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:33.417911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54dc388-5306-4236-9c32-749c83fe4d06 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:33.421810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069b44e-4ffc-4003-9bf2-685e2ab1bf26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:33.422468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069b44e-4ffc-4003-9bf2-685e2ab1bf26 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:33.422754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069b44e-4ffc-4003-9bf2-685e2ab1bf26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:33.423032 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069b44e-4ffc-4003-9bf2-685e2ab1bf26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:33.424823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e069b44e-4ffc-4003-9bf2-685e2ab1bf26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:33.528466 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069b44e-4ffc-4003-9bf2-685e2ab1bf26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:33.532920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069b44e-4ffc-4003-9bf2-685e2ab1bf26 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:33.560434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1203/2422] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:34:33.719164 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fac4e3-8c16-47d5-9896-7f4227e6678c service swift] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:33.733077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fac4e3-8c16-47d5-9896-7f4227e6678c service swift] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:33.742340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88f11d-1b20-43b9-b09d-ce86c952dd96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:33.743337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88f11d-1b20-43b9-b09d-ce86c952dd96 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:33.743783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88f11d-1b20-43b9-b09d-ce86c952dd96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:33.744226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88f11d-1b20-43b9-b09d-ce86c952dd96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:33.751589 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0d88f11d-1b20-43b9-b09d-ce86c952dd96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:33.780048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88f11d-1b20-43b9-b09d-ce86c952dd96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:33.781808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88f11d-1b20-43b9-b09d-ce86c952dd96 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:33.802340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1220/2423] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:35.927507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069b44e-4ffc-4003-9bf2-685e2ab1bf26 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:35.929033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e069b44e-4ffc-4003-9bf2-685e2ab1bf26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:35.953461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069b44e-4ffc-4003-9bf2-685e2ab1bf26 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:35.961572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c63d3-bdff-4209-9d53-3c4e83991a7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:35.963286 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c63d3-bdff-4209-9d53-3c4e83991a7c service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:35.963780 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c63d3-bdff-4209-9d53-3c4e83991a7c service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:35.964255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c63d3-bdff-4209-9d53-3c4e83991a7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:35.969538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-997c63d3-bdff-4209-9d53-3c4e83991a7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:35.986660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c63d3-bdff-4209-9d53-3c4e83991a7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:35.990479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c63d3-bdff-4209-9d53-3c4e83991a7c service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:36.016570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1204/2424] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:36.192091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88f11d-1b20-43b9-b09d-ce86c952dd96 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:36.217545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88f11d-1b20-43b9-b09d-ce86c952dd96 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:36.227678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fa0bd-cc65-4b75-b5af-025d21c24bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:36.228473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fa0bd-cc65-4b75-b5af-025d21c24bf5 service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:36.228762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fa0bd-cc65-4b75-b5af-025d21c24bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:36.229072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fa0bd-cc65-4b75-b5af-025d21c24bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:36.234901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c28fa0bd-cc65-4b75-b5af-025d21c24bf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:36.261619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fa0bd-cc65-4b75-b5af-025d21c24bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:36.263284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fa0bd-cc65-4b75-b5af-025d21c24bf5 service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:36.284772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1221/2425] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:39.397738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c63d3-bdff-4209-9d53-3c4e83991a7c service nova] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:39.399820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-997c63d3-bdff-4209-9d53-3c4e83991a7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:39.525235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c63d3-bdff-4209-9d53-3c4e83991a7c service nova] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:39.533396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84474ca-72cd-4df4-8b48-761fd973ab21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b62795a6111a4c05a24e69efc7a0faba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:39.534122 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84474ca-72cd-4df4-8b48-761fd973ab21 service placement] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:39.537342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84474ca-72cd-4df4-8b48-761fd973ab21 service placement] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:39.537342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84474ca-72cd-4df4-8b48-761fd973ab21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:39.537342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e84474ca-72cd-4df4-8b48-761fd973ab21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:39.551857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84474ca-72cd-4df4-8b48-761fd973ab21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:39.553664 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84474ca-72cd-4df4-8b48-761fd973ab21 service placement] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:39.566942 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1205/2426] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:39.633513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fa0bd-cc65-4b75-b5af-025d21c24bf5 service nova] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:39.635815 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c28fa0bd-cc65-4b75-b5af-025d21c24bf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:39.662843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fa0bd-cc65-4b75-b5af-025d21c24bf5 service nova] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:39.671724 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c674c8-ee63-4174-ae75-443fea519836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:39.672608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c674c8-ee63-4174-ae75-443fea519836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:39.672892 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c674c8-ee63-4174-ae75-443fea519836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:39.673237 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c674c8-ee63-4174-ae75-443fea519836 admin admin] PATH_INFO: `/v3/users/071dc15e85a849afa9b9663f7e5f428e` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:39.674439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c674c8-ee63-4174-ae75-443fea519836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071dc15e85a849afa9b9663f7e5f428e)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:39.676709 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c674c8-ee63-4174-ae75-443fea519836 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:39.896563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-32c674c8-ee63-4174-ae75-443fea519836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071dc15e85a849afa9b9663f7e5f428e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:39.985087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-32c674c8-ee63-4174-ae75-443fea519836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071dc15e85a849afa9b9663f7e5f428e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:39.985877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-32c674c8-ee63-4174-ae75-443fea519836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071dc15e85a849afa9b9663f7e5f428e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:39.999650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-32c674c8-ee63-4174-ae75-443fea519836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071dc15e85a849afa9b9663f7e5f428e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:40.007358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-32c674c8-ee63-4174-ae75-443fea519836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071dc15e85a849afa9b9663f7e5f428e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:40.014688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1222/2427] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:34:39 2022] DELETE /identity/v3/users/071dc15e85a849afa9b9663f7e5f428e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:34:40.565736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84474ca-72cd-4df4-8b48-761fd973ab21 service placement] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:40.576854 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84474ca-72cd-4df4-8b48-761fd973ab21 service placement] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:40.634914 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e54a65-3ae4-4be7-ab91-324cffc5cc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:40.635690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e54a65-3ae4-4be7-ab91-324cffc5cc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:40.635978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e54a65-3ae4-4be7-ab91-324cffc5cc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:40.636257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e54a65-3ae4-4be7-ab91-324cffc5cc53 admin admin] PATH_INFO: `/v3/projects/ef496aec46c24f51800a6ade4be97fc3` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:40.637465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e54a65-3ae4-4be7-ab91-324cffc5cc53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef496aec46c24f51800a6ade4be97fc3)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:40.639371 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e54a65-3ae4-4be7-ab91-324cffc5cc53 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:40.646323 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:34:40.770109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-98e54a65-3ae4-4be7-ab91-324cffc5cc53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef496aec46c24f51800a6ade4be97fc3', 'request_id': 'req-98e54a65-3ae4-4be7-ab91-324cffc5cc53'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:40.848520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-98e54a65-3ae4-4be7-ab91-324cffc5cc53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef496aec46c24f51800a6ade4be97fc3', 'request_id': 'req-98e54a65-3ae4-4be7-ab91-324cffc5cc53'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:40.857073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-98e54a65-3ae4-4be7-ab91-324cffc5cc53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef496aec46c24f51800a6ade4be97fc3', 'request_id': 'req-98e54a65-3ae4-4be7-ab91-324cffc5cc53'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:40.876391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-98e54a65-3ae4-4be7-ab91-324cffc5cc53 admin admin] The token cache is being invalidate because project ef496aec46c24f51800a6ade4be97fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:34:40.876836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-98e54a65-3ae4-4be7-ab91-324cffc5cc53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:40.877529 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-98e54a65-3ae4-4be7-ab91-324cffc5cc53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:40.886024 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1206/2428] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:34:40 2022] DELETE /identity/v3/projects/ef496aec46c24f51800a6ade4be97fc3 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:34:40.887492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952885f2-0957-45a4-b1a7-fd59360feb08 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:40.888022 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952885f2-0957-45a4-b1a7-fd59360feb08 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:40.888108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952885f2-0957-45a4-b1a7-fd59360feb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:40.915026 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-952885f2-0957-45a4-b1a7-fd59360feb08 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:34:40.917021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-952885f2-0957-45a4-b1a7-fd59360feb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:41.015456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1223/2429] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:34:41.022928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d232-34e2-4a9e-a234-196597660144 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:41.023252 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d232-34e2-4a9e-a234-196597660144 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:41.023584 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d232-34e2-4a9e-a234-196597660144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:41.058222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-5088d232-34e2-4a9e-a234-196597660144 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:34:41.060092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5088d232-34e2-4a9e-a234-196597660144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:41.073423 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1207/2430] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:34:41.074293 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952885f2-0957-45a4-b1a7-fd59360feb08 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:41.093706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952885f2-0957-45a4-b1a7-fd59360feb08 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:41.100194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aee25-cec7-48f4-8ad4-66eaf418dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:41.100918 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aee25-cec7-48f4-8ad4-66eaf418dc4c admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:41.101243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aee25-cec7-48f4-8ad4-66eaf418dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:41.101529 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aee25-cec7-48f4-8ad4-66eaf418dc4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:41.102262 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422aee25-cec7-48f4-8ad4-66eaf418dc4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:34:41.102573 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422aee25-cec7-48f4-8ad4-66eaf418dc4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:41.104662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422aee25-cec7-48f4-8ad4-66eaf418dc4c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:41.121538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1224/2431] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:34:41.125917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088d232-34e2-4a9e-a234-196597660144 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:41.137764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088d232-34e2-4a9e-a234-196597660144 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:41.142857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e290c8-f97d-488f-9e2d-8adc7e5d71aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:41.143514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e290c8-f97d-488f-9e2d-8adc7e5d71aa admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:41.143803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e290c8-f97d-488f-9e2d-8adc7e5d71aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:41.144249 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e290c8-f97d-488f-9e2d-8adc7e5d71aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:41.144817 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e290c8-f97d-488f-9e2d-8adc7e5d71aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:41.146892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e290c8-f97d-488f-9e2d-8adc7e5d71aa admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:41.258293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1208/2432] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:34:41 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:34:41.265415 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aee25-cec7-48f4-8ad4-66eaf418dc4c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:41.278010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aee25-cec7-48f4-8ad4-66eaf418dc4c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:41.328465 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:34:41.404003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e62d0-9727-401a-b992-423a187a7082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:41.404948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e62d0-9727-401a-b992-423a187a7082 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:41.405271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e62d0-9727-401a-b992-423a187a7082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:41.405551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e62d0-9727-401a-b992-423a187a7082 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:41.406249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e62d0-9727-401a-b992-423a187a7082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:41.408463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e62d0-9727-401a-b992-423a187a7082 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:41.544031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1225/2433] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:34:41 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:34:41.545265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e290c8-f97d-488f-9e2d-8adc7e5d71aa admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:41.557579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e290c8-f97d-488f-9e2d-8adc7e5d71aa admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:41.566576 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a77298-7622-46de-b4c3-ccaafacb5d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:41.567348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a77298-7622-46de-b4c3-ccaafacb5d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:41.570979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a77298-7622-46de-b4c3-ccaafacb5d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:41.570979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a77298-7622-46de-b4c3-ccaafacb5d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:41.570979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a77298-7622-46de-b4c3-ccaafacb5d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:41.570979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a77298-7622-46de-b4c3-ccaafacb5d85 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:41.583340 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1209/2434] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:34:41.587086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e62d0-9727-401a-b992-423a187a7082 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:41.599850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e62d0-9727-401a-b992-423a187a7082 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:41.604846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ad203-3f87-4043-a41b-afd80c825cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:41.605562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ad203-3f87-4043-a41b-afd80c825cdc admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:41.605898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ad203-3f87-4043-a41b-afd80c825cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:41.606176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ad203-3f87-4043-a41b-afd80c825cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:41.606979 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ad203-3f87-4043-a41b-afd80c825cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:41.608622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ad203-3f87-4043-a41b-afd80c825cdc admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:41.627320 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a77298-7622-46de-b4c3-ccaafacb5d85 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:41.632959 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1226/2435] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:34:41.638782 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a77298-7622-46de-b4c3-ccaafacb5d85 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:41.645045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffe767-4104-42df-b691-ed61792f105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:41.646532 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffe767-4104-42df-b691-ed61792f105d admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:41.647003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffe767-4104-42df-b691-ed61792f105d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:41.648179 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffe767-4104-42df-b691-ed61792f105d admin admin] PATH_INFO: `/v3/projects/a25dceaf62a349efbe2d66be7be91fd4/users/a727df3cf06746b8929de45d8ab5493c/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:41.672244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffe767-4104-42df-b691-ed61792f105d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25dceaf62a349efbe2d66be7be91fd4, user_id=a727df3cf06746b8929de45d8ab5493c, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:41.675659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffe767-4104-42df-b691-ed61792f105d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:41.779301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1210/2436] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:34:41 2022] PUT /identity/v3/projects/a25dceaf62a349efbe2d66be7be91fd4/users/a727df3cf06746b8929de45d8ab5493c/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:34:41.784465 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2674e3-82f1-47ba-ad64-27c57beeb744 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:41.784783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2674e3-82f1-47ba-ad64-27c57beeb744 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:41.785135 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2674e3-82f1-47ba-ad64-27c57beeb744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:41.810925 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ce2674e3-82f1-47ba-ad64-27c57beeb744 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:34:41.812399 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ce2674e3-82f1-47ba-ad64-27c57beeb744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:41.885213 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1227/2437] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:34:41.900690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffe767-4104-42df-b691-ed61792f105d admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:41.903453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-4cffe767-4104-42df-b691-ed61792f105d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:42.017512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffe767-4104-42df-b691-ed61792f105d admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:42.022477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0d77f-2414-4294-841f-d9ece43a95f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:42.023230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0d77f-2414-4294-841f-d9ece43a95f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:42.023738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0d77f-2414-4294-841f-d9ece43a95f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:42.024086 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0d77f-2414-4294-841f-d9ece43a95f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:42.044883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0d77f-2414-4294-841f-d9ece43a95f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:42.046726 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0d77f-2414-4294-841f-d9ece43a95f0 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:42.064878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1211/2438] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:44.597837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65458c73-e952-449d-bafb-ec58f7e417ba None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:44.601795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65458c73-e952-449d-bafb-ec58f7e417ba None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:44.602965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65458c73-e952-449d-bafb-ec58f7e417ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:44.633051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-65458c73-e952-449d-bafb-ec58f7e417ba None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:34:44.634472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-65458c73-e952-449d-bafb-ec58f7e417ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:44.712527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1228/2439] 10.222.0.26 () {58 vars in 967 bytes} [Tue Jul 12 16:34:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:34:44.729156 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0d77f-2414-4294-841f-d9ece43a95f0 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:44.730706 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-73f0d77f-2414-4294-841f-d9ece43a95f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:44.796014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:34:44.880553 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0d77f-2414-4294-841f-d9ece43a95f0 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:44.889908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6ff11-278f-40ea-a0e9-bcda92af9f28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:44.891785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6ff11-278f-40ea-a0e9-bcda92af9f28 service swift] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:44.892190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6ff11-278f-40ea-a0e9-bcda92af9f28 service swift] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:44.892595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6ff11-278f-40ea-a0e9-bcda92af9f28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:44.944954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6ff11-278f-40ea-a0e9-bcda92af9f28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:44.949047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6ff11-278f-40ea-a0e9-bcda92af9f28 service swift] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:44.969449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1212/2440] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:34:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:34:50.756717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65458c73-e952-449d-bafb-ec58f7e417ba None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:50.757802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-65458c73-e952-449d-bafb-ec58f7e417ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:50.840061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:34:50.885261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65458c73-e952-449d-bafb-ec58f7e417ba None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:50.896401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4178ef-5832-45a4-946c-25fd5eb57b7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:50.903788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4178ef-5832-45a4-946c-25fd5eb57b7f service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:50.904093 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4178ef-5832-45a4-946c-25fd5eb57b7f service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:50.904376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4178ef-5832-45a4-946c-25fd5eb57b7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:50.909511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1c4178ef-5832-45a4-946c-25fd5eb57b7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:50.939805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4178ef-5832-45a4-946c-25fd5eb57b7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:50.942303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4178ef-5832-45a4-946c-25fd5eb57b7f service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:50.957451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1229/2441] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:50.996383 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb458e-d336-4f7a-bf22-b547fefb679b None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:50.997387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb458e-d336-4f7a-bf22-b547fefb679b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:50.997830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb458e-d336-4f7a-bf22-b547fefb679b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:51.043913 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-82eb458e-d336-4f7a-bf22-b547fefb679b None None] MFA Rules not processed for user `a727df3cf06746b8929de45d8ab5493c`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:34:51.045172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-82eb458e-d336-4f7a-bf22-b547fefb679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:51.133421 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1213/2442] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:34:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:34:51.147143 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4178ef-5832-45a4-946c-25fd5eb57b7f service nova] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:51.158511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4178ef-5832-45a4-946c-25fd5eb57b7f service nova] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:51.164845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95834106-43ab-4e81-ac4b-3777e8e2db97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:51.165761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95834106-43ab-4e81-ac4b-3777e8e2db97 service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:51.166052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95834106-43ab-4e81-ac4b-3777e8e2db97 service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:51.166326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95834106-43ab-4e81-ac4b-3777e8e2db97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:51.176808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95834106-43ab-4e81-ac4b-3777e8e2db97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:51.178067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95834106-43ab-4e81-ac4b-3777e8e2db97 service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:51.188876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1230/2443] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:52.855705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb458e-d336-4f7a-bf22-b547fefb679b None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:52.857600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-82eb458e-d336-4f7a-bf22-b547fefb679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:52.873842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb458e-d336-4f7a-bf22-b547fefb679b None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:52.878570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d44e02-86a6-442b-9783-a76d0bc0504f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:52.882483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d44e02-86a6-442b-9783-a76d0bc0504f service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:52.882483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d44e02-86a6-442b-9783-a76d0bc0504f service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:52.882483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d44e02-86a6-442b-9783-a76d0bc0504f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:52.882483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-64d44e02-86a6-442b-9783-a76d0bc0504f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:52.892748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d44e02-86a6-442b-9783-a76d0bc0504f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:52.894556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d44e02-86a6-442b-9783-a76d0bc0504f service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:52.908776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1214/2444] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:53.333141 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0b54c-92b2-450d-88a5-859ce5d7f767 None None] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:53.333662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0b54c-92b2-450d-88a5-859ce5d7f767 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:53.334374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0b54c-92b2-450d-88a5-859ce5d7f767 None None] PATH_INFO: `/` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:53.335908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1231/2445] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:34:53.343029 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7ed9f-e173-4b3f-b432-7095cf29522d None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:53.343537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7ed9f-e173-4b3f-b432-7095cf29522d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:53.343972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7ed9f-e173-4b3f-b432-7095cf29522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:53.383781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-86e7ed9f-e173-4b3f-b432-7095cf29522d None None] MFA Rules not processed for user `f6a4da4c1dca40f5bb5d158a6f33d9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:34:53.385413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-86e7ed9f-e173-4b3f-b432-7095cf29522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:53.403082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1215/2446] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:34:53.483999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0b54c-92b2-450d-88a5-859ce5d7f767 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:53.506730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0b54c-92b2-450d-88a5-859ce5d7f767 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:53.547564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6ae93-9c97-4311-aa97-7099acc54714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:53.548237 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6ae93-9c97-4311-aa97-7099acc54714 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:53.550641 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6ae93-9c97-4311-aa97-7099acc54714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:53.551498 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6ae93-9c97-4311-aa97-7099acc54714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:53.574049 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6ae93-9c97-4311-aa97-7099acc54714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:53.576620 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6ae93-9c97-4311-aa97-7099acc54714 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:53.608001 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1232/2447] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:53.851748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062012b-8da4-4d20-976b-309373a41b13 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:53.852255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062012b-8da4-4d20-976b-309373a41b13 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:53.852370 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062012b-8da4-4d20-976b-309373a41b13 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:53.853912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1216/2448] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:34:53.861245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da859a-f8ba-49ab-acfb-d603ff7093b4 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:53.861903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da859a-f8ba-49ab-acfb-d603ff7093b4 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:53.862603 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da859a-f8ba-49ab-acfb-d603ff7093b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:53.886449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-98da859a-f8ba-49ab-acfb-d603ff7093b4 None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:34:53.889611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-98da859a-f8ba-49ab-acfb-d603ff7093b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:53.905196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1233/2449] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:34:53.921790 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062012b-8da4-4d20-976b-309373a41b13 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:53.945764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062012b-8da4-4d20-976b-309373a41b13 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:53.962475 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e523ab-035d-4f1d-b0ff-33ba8a50eff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:53.963385 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e523ab-035d-4f1d-b0ff-33ba8a50eff7 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:53.963582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e523ab-035d-4f1d-b0ff-33ba8a50eff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:53.964075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e523ab-035d-4f1d-b0ff-33ba8a50eff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:53.981306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e523ab-035d-4f1d-b0ff-33ba8a50eff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:53.983274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e523ab-035d-4f1d-b0ff-33ba8a50eff7 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:54.005342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1217/2450] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:54.175089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da859a-f8ba-49ab-acfb-d603ff7093b4 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:54.177304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-98da859a-f8ba-49ab-acfb-d603ff7093b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:54.366390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da859a-f8ba-49ab-acfb-d603ff7093b4 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:54.378429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a91cb-5130-4f4e-8862-91d92abcbd4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b62795a6111a4c05a24e69efc7a0faba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:54.380995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a91cb-5130-4f4e-8862-91d92abcbd4b service placement] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:54.380995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a91cb-5130-4f4e-8862-91d92abcbd4b service placement] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:54.380995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a91cb-5130-4f4e-8862-91d92abcbd4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:54.383296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a74a91cb-5130-4f4e-8862-91d92abcbd4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:54.398829 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a91cb-5130-4f4e-8862-91d92abcbd4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:54.400680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a91cb-5130-4f4e-8862-91d92abcbd4b service placement] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:54.414144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1234/2451] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:55.295460 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c68e45-1560-4244-997b-69553eabb8d3 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:55.296306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c68e45-1560-4244-997b-69553eabb8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:55.296742 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c68e45-1560-4244-997b-69553eabb8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:55.326643 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-d5c68e45-1560-4244-997b-69553eabb8d3 None None] MFA Rules not processed for user `a727df3cf06746b8929de45d8ab5493c`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:34:55.328732 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d5c68e45-1560-4244-997b-69553eabb8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:55.353468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1218/2452] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:34:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:34:56.118286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a91cb-5130-4f4e-8862-91d92abcbd4b service placement] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:56.135045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a91cb-5130-4f4e-8862-91d92abcbd4b service placement] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:56.141629 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ae380-629a-4554-8e2b-25be29304b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:56.143305 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae380-629a-4554-8e2b-25be29304b29 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:56.143767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae380-629a-4554-8e2b-25be29304b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:56.144041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae380-629a-4554-8e2b-25be29304b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:56.146430 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-658ae380-629a-4554-8e2b-25be29304b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:56.157379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ae380-629a-4554-8e2b-25be29304b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:56.158915 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ae380-629a-4554-8e2b-25be29304b29 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:56.171334 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1235/2453] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:57.121386 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d5c92-5da9-4696-8982-86d42e146936 None None] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:57.121841 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d5c92-5da9-4696-8982-86d42e146936 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:57.121979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d5c92-5da9-4696-8982-86d42e146936 None None] PATH_INFO: `/` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:57.128120 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1219/2454] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 16:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 16:34:57.131490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124f7f-5322-4d72-a5f7-dd7ae81b621b None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:57.132015 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124f7f-5322-4d72-a5f7-dd7ae81b621b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:57.132101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124f7f-5322-4d72-a5f7-dd7ae81b621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:57.174855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-93124f7f-5322-4d72-a5f7-dd7ae81b621b None None] MFA Rules not processed for user `f36355ce7ff841f3bd9e228fbad64a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:34:57.176115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-93124f7f-5322-4d72-a5f7-dd7ae81b621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:57.185671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1236/2455] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:34:57.201968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d5c92-5da9-4696-8982-86d42e146936 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:57.204033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-4e6d5c92-5da9-4696-8982-86d42e146936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:57.278898 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d5c92-5da9-4696-8982-86d42e146936 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:57.286986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4725a-5f8a-4866-a353-8b5d0053af8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9f9ba17c2634999b350b887a5229e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:57.287881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4725a-5f8a-4866-a353-8b5d0053af8a service glance] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:57.288846 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4725a-5f8a-4866-a353-8b5d0053af8a service glance] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:57.288846 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4725a-5f8a-4866-a353-8b5d0053af8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:57.302895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4725a-5f8a-4866-a353-8b5d0053af8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:57.304625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4725a-5f8a-4866-a353-8b5d0053af8a service glance] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:57.322084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1220/2456] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:34:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:34:58.808823 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93124f7f-5322-4d72-a5f7-dd7ae81b621b None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:58.810302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-93124f7f-5322-4d72-a5f7-dd7ae81b621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:58.823406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93124f7f-5322-4d72-a5f7-dd7ae81b621b None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:58.827976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:58.828845 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:58.829279 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:58.829559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] PATH_INFO: `/v3/users/afdfb530e9d34805b568b2333a1d1c10` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:58.830753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=afdfb530e9d34805b568b2333a1d1c10)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:58.833282 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:58.958394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afdfb530e9d34805b568b2333a1d1c10'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.017276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afdfb530e9d34805b568b2333a1d1c10'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.017981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afdfb530e9d34805b568b2333a1d1c10'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.025733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:34:59.033122 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afdfb530e9d34805b568b2333a1d1c10'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.040125 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afdfb530e9d34805b568b2333a1d1c10'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.046906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1237/2457] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:34:58 2022] DELETE /identity/v3/users/afdfb530e9d34805b568b2333a1d1c10 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:34:59.278783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4725a-5f8a-4866-a353-8b5d0053af8a service glance] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:59.293657 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4725a-5f8a-4866-a353-8b5d0053af8a service glance] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:59.319861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:34:59.364247 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:59.365105 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:59.365434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:59.365759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] PATH_INFO: `/v3/projects/10ef0ee206d24b5aa3388600a27eb0c4` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:59.367042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ef0ee206d24b5aa3388600a27eb0c4)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:59.368940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:59.487530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ef0ee206d24b5aa3388600a27eb0c4', 'request_id': 'req-9181d445-1443-4e41-995a-469af2dfe455'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.561675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ef0ee206d24b5aa3388600a27eb0c4', 'request_id': 'req-9181d445-1443-4e41-995a-469af2dfe455'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.568708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ef0ee206d24b5aa3388600a27eb0c4', 'request_id': 'req-9181d445-1443-4e41-995a-469af2dfe455'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.579377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] The token cache is being invalidate because project 10ef0ee206d24b5aa3388600a27eb0c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:34:59.579668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.580328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.582123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1221/2458] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:34:59 2022] DELETE /identity/v3/projects/10ef0ee206d24b5aa3388600a27eb0c4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:34:59.586193 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:34:59.587584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:34:59.604412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98bedd-7e34-4362-a32f-cb95addb4d8d admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:34:59.662088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff322564-2083-48f4-be85-91b8c68928be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:34:59.663054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322564-2083-48f4-be85-91b8c68928be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:34:59.663406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322564-2083-48f4-be85-91b8c68928be admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:34:59.663747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322564-2083-48f4-be85-91b8c68928be admin admin] PATH_INFO: `/v3/users/c14593be390e48c8b270090284bffc9c` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:34:59.665047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff322564-2083-48f4-be85-91b8c68928be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14593be390e48c8b270090284bffc9c)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:34:59.667314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff322564-2083-48f4-be85-91b8c68928be admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:34:59.883325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ff322564-2083-48f4-be85-91b8c68928be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14593be390e48c8b270090284bffc9c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.942462 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ff322564-2083-48f4-be85-91b8c68928be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14593be390e48c8b270090284bffc9c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.943070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ff322564-2083-48f4-be85-91b8c68928be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14593be390e48c8b270090284bffc9c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.959167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ff322564-2083-48f4-be85-91b8c68928be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14593be390e48c8b270090284bffc9c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.976675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-ff322564-2083-48f4-be85-91b8c68928be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14593be390e48c8b270090284bffc9c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:34:59.984390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1238/2459] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:34:59 2022] DELETE /identity/v3/users/c14593be390e48c8b270090284bffc9c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:00.406857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:00.408579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:00.456061 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181d445-1443-4e41-995a-469af2dfe455 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:00.537599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:00.538991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:00.539493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:00.539828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] PATH_INFO: `/v3/projects/9428b9bdfb5847bead41fca6d9d20e1d` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:00.541931 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9428b9bdfb5847bead41fca6d9d20e1d)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:00.548793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:00.663617 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:00.664839 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9428b9bdfb5847bead41fca6d9d20e1d', 'request_id': 'req-97432f60-cd52-4ed2-992d-6cb4ac527e28'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:00.762333 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9428b9bdfb5847bead41fca6d9d20e1d', 'request_id': 'req-97432f60-cd52-4ed2-992d-6cb4ac527e28'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:00.769231 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9428b9bdfb5847bead41fca6d9d20e1d', 'request_id': 'req-97432f60-cd52-4ed2-992d-6cb4ac527e28'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:00.780425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] The token cache is being invalidate because project 9428b9bdfb5847bead41fca6d9d20e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:35:00.780714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:00.781391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:00.783305 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1222/2460] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:35:00 2022] DELETE /identity/v3/projects/9428b9bdfb5847bead41fca6d9d20e1d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:03.729708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe4ef2-ff22-4485-9e01-6e17986b34af None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:03.730345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe4ef2-ff22-4485-9e01-6e17986b34af None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:03.730345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe4ef2-ff22-4485-9e01-6e17986b34af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:03.751518 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-bbfe4ef2-ff22-4485-9e01-6e17986b34af None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:03.752943 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bbfe4ef2-ff22-4485-9e01-6e17986b34af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:03.829415 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1239/2461] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 16:35:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:35:03.844359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:03.850068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:03.935681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97432f60-cd52-4ed2-992d-6cb4ac527e28 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:03.940869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c043f2-c76d-47cc-b3e2-1298d250f17a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:03.941615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c043f2-c76d-47cc-b3e2-1298d250f17a service swift] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:03.941902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c043f2-c76d-47cc-b3e2-1298d250f17a service swift] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:03.942182 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c043f2-c76d-47cc-b3e2-1298d250f17a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:03.950788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c043f2-c76d-47cc-b3e2-1298d250f17a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:03.952495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c043f2-c76d-47cc-b3e2-1298d250f17a service swift] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:03.963055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1223/2462] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:35:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 16:35:08.019057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe4ef2-ff22-4485-9e01-6e17986b34af None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:08.021451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bbfe4ef2-ff22-4485-9e01-6e17986b34af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:08.027208 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:08.089473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe4ef2-ff22-4485-9e01-6e17986b34af None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:08.094398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe267e6-8b5a-4793-a822-cb9b15917ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:08.095064 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe267e6-8b5a-4793-a822-cb9b15917ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:08.097301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe267e6-8b5a-4793-a822-cb9b15917ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:08.097301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe267e6-8b5a-4793-a822-cb9b15917ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:08.097619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bbe267e6-8b5a-4793-a822-cb9b15917ab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:08.170826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe267e6-8b5a-4793-a822-cb9b15917ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:08.172440 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe267e6-8b5a-4793-a822-cb9b15917ab0 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:08.187391 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1240/2463] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:35:13.157500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c043f2-c76d-47cc-b3e2-1298d250f17a service swift] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:13.177970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-33c043f2-c76d-47cc-b3e2-1298d250f17a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:13.177970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c043f2-c76d-47cc-b3e2-1298d250f17a service swift] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:13.179716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f627372-a691-42b8-a066-3c42e23e361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:13.180592 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f627372-a691-42b8-a066-3c42e23e361d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:13.180885 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f627372-a691-42b8-a066-3c42e23e361d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:13.181193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f627372-a691-42b8-a066-3c42e23e361d admin admin] PATH_INFO: `/v3/users/ddfe9bf33946474f8ea4019d2c9e86e0` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:13.182388 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f627372-a691-42b8-a066-3c42e23e361d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddfe9bf33946474f8ea4019d2c9e86e0)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:13.184337 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f627372-a691-42b8-a066-3c42e23e361d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:13.341083 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-4f627372-a691-42b8-a066-3c42e23e361d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddfe9bf33946474f8ea4019d2c9e86e0'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:13.399123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-4f627372-a691-42b8-a066-3c42e23e361d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddfe9bf33946474f8ea4019d2c9e86e0'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:13.411867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-4f627372-a691-42b8-a066-3c42e23e361d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddfe9bf33946474f8ea4019d2c9e86e0'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:13.412512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-4f627372-a691-42b8-a066-3c42e23e361d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddfe9bf33946474f8ea4019d2c9e86e0'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:13.420825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-4f627372-a691-42b8-a066-3c42e23e361d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddfe9bf33946474f8ea4019d2c9e86e0'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:13.426758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1224/2464] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:35:13 2022] DELETE /identity/v3/users/ddfe9bf33946474f8ea4019d2c9e86e0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:13.664284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe267e6-8b5a-4793-a822-cb9b15917ab0 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:13.674899 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe267e6-8b5a-4793-a822-cb9b15917ab0 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:13.743353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344407bf-d441-42b3-936c-aaf4da4bc4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:13.743353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344407bf-d441-42b3-936c-aaf4da4bc4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:13.743353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344407bf-d441-42b3-936c-aaf4da4bc4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:13.743353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344407bf-d441-42b3-936c-aaf4da4bc4fd admin admin] PATH_INFO: `/v3/projects/fbe5725453a9468eb6f934078b01a862` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:13.743877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344407bf-d441-42b3-936c-aaf4da4bc4fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe5725453a9468eb6f934078b01a862)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:13.744484 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344407bf-d441-42b3-936c-aaf4da4bc4fd admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:13.882804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-344407bf-d441-42b3-936c-aaf4da4bc4fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe5725453a9468eb6f934078b01a862', 'request_id': 'req-344407bf-d441-42b3-936c-aaf4da4bc4fd'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:13.888750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:13.974059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-344407bf-d441-42b3-936c-aaf4da4bc4fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe5725453a9468eb6f934078b01a862', 'request_id': 'req-344407bf-d441-42b3-936c-aaf4da4bc4fd'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:13.980172 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-344407bf-d441-42b3-936c-aaf4da4bc4fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe5725453a9468eb6f934078b01a862', 'request_id': 'req-344407bf-d441-42b3-936c-aaf4da4bc4fd'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:13.991950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-344407bf-d441-42b3-936c-aaf4da4bc4fd admin admin] The token cache is being invalidate because project fbe5725453a9468eb6f934078b01a862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:35:13.992239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-344407bf-d441-42b3-936c-aaf4da4bc4fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:13.992905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-344407bf-d441-42b3-936c-aaf4da4bc4fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:13.994717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1241/2465] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:35:13 2022] DELETE /identity/v3/projects/fbe5725453a9468eb6f934078b01a862 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:13.999635 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4eb2d-5c05-4eaa-9e29-bc07bf0fb081 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:14.000005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4eb2d-5c05-4eaa-9e29-bc07bf0fb081 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:14.000348 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4eb2d-5c05-4eaa-9e29-bc07bf0fb081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:14.018676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-59b4eb2d-5c05-4eaa-9e29-bc07bf0fb081 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:14.019907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-59b4eb2d-5c05-4eaa-9e29-bc07bf0fb081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:14.054912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:14.085172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1225/2466] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:35:14.093095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b032d-d785-4e48-abc0-2accdadaa22d None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:14.097980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b032d-d785-4e48-abc0-2accdadaa22d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:14.097980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b032d-d785-4e48-abc0-2accdadaa22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:14.112407 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-729b032d-d785-4e48-abc0-2accdadaa22d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:14.114452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-729b032d-d785-4e48-abc0-2accdadaa22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:14.122453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1242/2467] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:35:14.126684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4eb2d-5c05-4eaa-9e29-bc07bf0fb081 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:14.136273 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4eb2d-5c05-4eaa-9e29-bc07bf0fb081 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:14.140867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5511b4-47d6-41d9-a825-d1aab2eaeb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:14.141558 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5511b4-47d6-41d9-a825-d1aab2eaeb5e admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:14.141847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5511b4-47d6-41d9-a825-d1aab2eaeb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:14.142123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5511b4-47d6-41d9-a825-d1aab2eaeb5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:14.143208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5511b4-47d6-41d9-a825-d1aab2eaeb5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:35:14.143208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5511b4-47d6-41d9-a825-d1aab2eaeb5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:14.144812 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5511b4-47d6-41d9-a825-d1aab2eaeb5e admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:14.156514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1226/2468] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:35:14.161444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b032d-d785-4e48-abc0-2accdadaa22d None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:14.171094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b032d-d785-4e48-abc0-2accdadaa22d None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:14.176422 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24c3a6-8ab9-42ea-8987-a41cc2939c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:14.177195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24c3a6-8ab9-42ea-8987-a41cc2939c99 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:14.177489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24c3a6-8ab9-42ea-8987-a41cc2939c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:14.177767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24c3a6-8ab9-42ea-8987-a41cc2939c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:14.178757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24c3a6-8ab9-42ea-8987-a41cc2939c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:14.180395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24c3a6-8ab9-42ea-8987-a41cc2939c99 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:14.266835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1243/2469] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:35:14 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:35:14.268511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5511b4-47d6-41d9-a825-d1aab2eaeb5e admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:14.278980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5511b4-47d6-41d9-a825-d1aab2eaeb5e admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:14.337296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c710a-6fa4-4686-9cd1-ac7ccc8a0711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:14.340970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c710a-6fa4-4686-9cd1-ac7ccc8a0711 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:14.340970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c710a-6fa4-4686-9cd1-ac7ccc8a0711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:14.340970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c710a-6fa4-4686-9cd1-ac7ccc8a0711 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:14.340970 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c710a-6fa4-4686-9cd1-ac7ccc8a0711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:14.341430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c710a-6fa4-4686-9cd1-ac7ccc8a0711 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:14.417962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1227/2470] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:35:14 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:35:14.422194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24c3a6-8ab9-42ea-8987-a41cc2939c99 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:14.432985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24c3a6-8ab9-42ea-8987-a41cc2939c99 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:14.437771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8fea-545f-4a88-99e2-93a56529a201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:14.438444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8fea-545f-4a88-99e2-93a56529a201 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:14.438731 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8fea-545f-4a88-99e2-93a56529a201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:14.439013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8fea-545f-4a88-99e2-93a56529a201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:14.439743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef8fea-545f-4a88-99e2-93a56529a201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:14.441882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef8fea-545f-4a88-99e2-93a56529a201 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:14.453018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1244/2471] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:35:14.460329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c710a-6fa4-4686-9cd1-ac7ccc8a0711 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:14.470768 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c710a-6fa4-4686-9cd1-ac7ccc8a0711 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:14.476345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea868f7-0ad0-4087-87a3-9518400498b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:14.477012 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea868f7-0ad0-4087-87a3-9518400498b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:14.477446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea868f7-0ad0-4087-87a3-9518400498b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:14.477832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea868f7-0ad0-4087-87a3-9518400498b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:14.478572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea868f7-0ad0-4087-87a3-9518400498b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:14.480182 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea868f7-0ad0-4087-87a3-9518400498b7 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:14.491353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1228/2472] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:35:14.495535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8fea-545f-4a88-99e2-93a56529a201 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:14.505357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8fea-545f-4a88-99e2-93a56529a201 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:14.510336 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438be60-4970-492f-ae28-1cfeaf3577b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:14.515203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438be60-4970-492f-ae28-1cfeaf3577b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:14.515203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438be60-4970-492f-ae28-1cfeaf3577b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:14.515203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438be60-4970-492f-ae28-1cfeaf3577b0 admin admin] PATH_INFO: `/v3/projects/da4d42bff1c241e98b9fbddbd700998d/users/9af134ca441a4666b50219e8b73f460f/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:14.527537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438be60-4970-492f-ae28-1cfeaf3577b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4d42bff1c241e98b9fbddbd700998d, user_id=9af134ca441a4666b50219e8b73f460f, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:14.530224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438be60-4970-492f-ae28-1cfeaf3577b0 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:14.645325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1245/2473] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:35:14 2022] PUT /identity/v3/projects/da4d42bff1c241e98b9fbddbd700998d/users/9af134ca441a4666b50219e8b73f460f/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:14.655470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198146fa-f43b-4d70-af77-381419ee6888 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:14.655781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198146fa-f43b-4d70-af77-381419ee6888 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:14.660848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198146fa-f43b-4d70-af77-381419ee6888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:14.682621 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-198146fa-f43b-4d70-af77-381419ee6888 None None] MFA Rules not processed for user `9af134ca441a4666b50219e8b73f460f`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:14.683846 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-198146fa-f43b-4d70-af77-381419ee6888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:14.763461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1229/2474] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:35:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:35:14.775700 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438be60-4970-492f-ae28-1cfeaf3577b0 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:14.777580 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-6438be60-4970-492f-ae28-1cfeaf3577b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:14.868846 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438be60-4970-492f-ae28-1cfeaf3577b0 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:14.875612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefaeeb-8e35-4d65-906a-4632ea96dc2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:14.876407 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefaeeb-8e35-4d65-906a-4632ea96dc2c service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:14.876692 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefaeeb-8e35-4d65-906a-4632ea96dc2c service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:14.876967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefaeeb-8e35-4d65-906a-4632ea96dc2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:14.893683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefaeeb-8e35-4d65-906a-4632ea96dc2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:14.896608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefaeeb-8e35-4d65-906a-4632ea96dc2c service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:14.905685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1246/2475] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:35:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:35:15.128626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198146fa-f43b-4d70-af77-381419ee6888 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:15.162056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:15.189702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198146fa-f43b-4d70-af77-381419ee6888 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:15.194977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:15.196045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:15.196526 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:15.196820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] PATH_INFO: `/v3/users/9af134ca441a4666b50219e8b73f460f` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:15.198390 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af134ca441a4666b50219e8b73f460f)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:15.200632 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:15.398980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af134ca441a4666b50219e8b73f460f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:15.447528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af134ca441a4666b50219e8b73f460f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:15.460863 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af134ca441a4666b50219e8b73f460f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:15.461586 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af134ca441a4666b50219e8b73f460f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:15.468546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af134ca441a4666b50219e8b73f460f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:15.475023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1230/2476] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:35:15 2022] DELETE /identity/v3/users/9af134ca441a4666b50219e8b73f460f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:15.479674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06c40e-9208-4af2-a199-74815349b448 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:15.479988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06c40e-9208-4af2-a199-74815349b448 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:15.480292 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06c40e-9208-4af2-a199-74815349b448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:15.498263 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-1c06c40e-9208-4af2-a199-74815349b448 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:15.499469 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1c06c40e-9208-4af2-a199-74815349b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:15.556337 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1247/2477] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:35:15.565928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:15.570518 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:15.624328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42f84d-febf-4969-9df3-08d27cf202b9 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:15.627933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86ffaf-6cd7-4bd1-8ffb-0cd759f15707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:15.628580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86ffaf-6cd7-4bd1-8ffb-0cd759f15707 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:15.629547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86ffaf-6cd7-4bd1-8ffb-0cd759f15707 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:15.629832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86ffaf-6cd7-4bd1-8ffb-0cd759f15707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:15.638822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86ffaf-6cd7-4bd1-8ffb-0cd759f15707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:15.640238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86ffaf-6cd7-4bd1-8ffb-0cd759f15707 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:15.650404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1231/2478] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:35:16.058842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06c40e-9208-4af2-a199-74815349b448 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:16.068746 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1c06c40e-9208-4af2-a199-74815349b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:16.069396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:16.073233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06c40e-9208-4af2-a199-74815349b448 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:16.078783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4166214-ad6b-4e74-abe5-a5ef27be1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:16.079660 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166214-ad6b-4e74-abe5-a5ef27be1bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:16.080016 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166214-ad6b-4e74-abe5-a5ef27be1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:16.080376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166214-ad6b-4e74-abe5-a5ef27be1bab admin admin] PATH_INFO: `/v3/projects/da4d42bff1c241e98b9fbddbd700998d` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:16.081678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4166214-ad6b-4e74-abe5-a5ef27be1bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4d42bff1c241e98b9fbddbd700998d)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:16.083673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4166214-ad6b-4e74-abe5-a5ef27be1bab admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:16.200358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d4166214-ad6b-4e74-abe5-a5ef27be1bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4d42bff1c241e98b9fbddbd700998d', 'request_id': 'req-d4166214-ad6b-4e74-abe5-a5ef27be1bab'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:16.310589 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d4166214-ad6b-4e74-abe5-a5ef27be1bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4d42bff1c241e98b9fbddbd700998d', 'request_id': 'req-d4166214-ad6b-4e74-abe5-a5ef27be1bab'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:16.316625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d4166214-ad6b-4e74-abe5-a5ef27be1bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4d42bff1c241e98b9fbddbd700998d', 'request_id': 'req-d4166214-ad6b-4e74-abe5-a5ef27be1bab'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:16.327960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d4166214-ad6b-4e74-abe5-a5ef27be1bab admin admin] The token cache is being invalidate because project da4d42bff1c241e98b9fbddbd700998d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:35:16.328245 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d4166214-ad6b-4e74-abe5-a5ef27be1bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:16.328866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d4166214-ad6b-4e74-abe5-a5ef27be1bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:16.330416 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1248/2479] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:35:16 2022] DELETE /identity/v3/projects/da4d42bff1c241e98b9fbddbd700998d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:16.340288 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a4f60-8b59-4d7d-917f-e63fdb92f6f1 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:16.340611 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a4f60-8b59-4d7d-917f-e63fdb92f6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:16.340889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a4f60-8b59-4d7d-917f-e63fdb92f6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:16.358672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-670a4f60-8b59-4d7d-917f-e63fdb92f6f1 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:16.359876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-670a4f60-8b59-4d7d-917f-e63fdb92f6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:16.407984 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:16.420475 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1232/2480] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:35:16.428706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb08fc-bcc4-420d-af32-48122a2c611e None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:16.428990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb08fc-bcc4-420d-af32-48122a2c611e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:16.429325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb08fc-bcc4-420d-af32-48122a2c611e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:16.449151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-7cdb08fc-bcc4-420d-af32-48122a2c611e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:16.452283 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-7cdb08fc-bcc4-420d-af32-48122a2c611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:16.459335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1249/2481] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:35:16.463357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a4f60-8b59-4d7d-917f-e63fdb92f6f1 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:16.474089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a4f60-8b59-4d7d-917f-e63fdb92f6f1 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:16.478777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265af6bc-809b-4e45-95be-f67d0983563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:16.480608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265af6bc-809b-4e45-95be-f67d0983563e admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:16.480608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265af6bc-809b-4e45-95be-f67d0983563e admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:16.480608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265af6bc-809b-4e45-95be-f67d0983563e admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:16.480883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265af6bc-809b-4e45-95be-f67d0983563e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:35:16.480982 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265af6bc-809b-4e45-95be-f67d0983563e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:16.482607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265af6bc-809b-4e45-95be-f67d0983563e admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:16.496084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1233/2482] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:35:16.500450 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb08fc-bcc4-420d-af32-48122a2c611e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:16.509827 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb08fc-bcc4-420d-af32-48122a2c611e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:16.514787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de10c5-23a7-40f6-9f51-81a28b7c21d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:16.515563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de10c5-23a7-40f6-9f51-81a28b7c21d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:16.515849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de10c5-23a7-40f6-9f51-81a28b7c21d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:16.516130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de10c5-23a7-40f6-9f51-81a28b7c21d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:16.516824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de10c5-23a7-40f6-9f51-81a28b7c21d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:16.518760 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de10c5-23a7-40f6-9f51-81a28b7c21d5 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:16.632067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1250/2483] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:35:16 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:35:16.636193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265af6bc-809b-4e45-95be-f67d0983563e admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:16.646979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265af6bc-809b-4e45-95be-f67d0983563e admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:16.701875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b776f78-1928-4d07-b2d9-cbbd416a4bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:16.702462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b776f78-1928-4d07-b2d9-cbbd416a4bbf admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:16.702743 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b776f78-1928-4d07-b2d9-cbbd416a4bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:16.703018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b776f78-1928-4d07-b2d9-cbbd416a4bbf admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:16.703702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b776f78-1928-4d07-b2d9-cbbd416a4bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:16.705626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b776f78-1928-4d07-b2d9-cbbd416a4bbf admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:16.788884 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1234/2484] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:35:16 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:35:16.790843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de10c5-23a7-40f6-9f51-81a28b7c21d5 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:16.801384 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de10c5-23a7-40f6-9f51-81a28b7c21d5 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:16.805967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0984f-5c87-4f3a-b9bc-15cb1737383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:16.811588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0984f-5c87-4f3a-b9bc-15cb1737383a admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:16.811588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0984f-5c87-4f3a-b9bc-15cb1737383a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:16.811588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0984f-5c87-4f3a-b9bc-15cb1737383a admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:16.811588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0984f-5c87-4f3a-b9bc-15cb1737383a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:16.811588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0984f-5c87-4f3a-b9bc-15cb1737383a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:16.820812 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1251/2485] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:35:16.825056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b776f78-1928-4d07-b2d9-cbbd416a4bbf admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:16.836751 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b776f78-1928-4d07-b2d9-cbbd416a4bbf admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:16.842454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661358f5-55be-4c3c-96f5-4826d858d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:16.843118 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661358f5-55be-4c3c-96f5-4826d858d936 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:16.843431 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661358f5-55be-4c3c-96f5-4826d858d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:16.843708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661358f5-55be-4c3c-96f5-4826d858d936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:16.844434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661358f5-55be-4c3c-96f5-4826d858d936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:16.846082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661358f5-55be-4c3c-96f5-4826d858d936 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:16.856936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1235/2486] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:35:16.861297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0984f-5c87-4f3a-b9bc-15cb1737383a admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:16.871424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0984f-5c87-4f3a-b9bc-15cb1737383a admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:16.876271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111c474-9ee4-4e5d-bdbe-dfb0a643a46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:16.877311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111c474-9ee4-4e5d-bdbe-dfb0a643a46c admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:16.877665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111c474-9ee4-4e5d-bdbe-dfb0a643a46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:16.878015 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111c474-9ee4-4e5d-bdbe-dfb0a643a46c admin admin] PATH_INFO: `/v3/projects/5e83f2956b264996bd59ddb24bb99372/users/2b0add131b6a4d57ab9cbe96d90e86dc/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:16.892808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111c474-9ee4-4e5d-bdbe-dfb0a643a46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e83f2956b264996bd59ddb24bb99372, user_id=2b0add131b6a4d57ab9cbe96d90e86dc, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:16.896206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111c474-9ee4-4e5d-bdbe-dfb0a643a46c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:16.971782 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1252/2487] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:35:16 2022] PUT /identity/v3/projects/5e83f2956b264996bd59ddb24bb99372/users/2b0add131b6a4d57ab9cbe96d90e86dc/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:16.983332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fb03a-c9c4-4aad-888d-32f2223e7db8 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:16.983624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fb03a-c9c4-4aad-888d-32f2223e7db8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:16.983901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fb03a-c9c4-4aad-888d-32f2223e7db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:17.012138 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-558fb03a-c9c4-4aad-888d-32f2223e7db8 None None] MFA Rules not processed for user `2b0add131b6a4d57ab9cbe96d90e86dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:17.013389 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-558fb03a-c9c4-4aad-888d-32f2223e7db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:17.090462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1236/2488] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:35:17.095594 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111c474-9ee4-4e5d-bdbe-dfb0a643a46c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:17.176941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111c474-9ee4-4e5d-bdbe-dfb0a643a46c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:17.182081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4d3eb-c608-4b65-94c9-49ed28b1699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:17.182443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4d3eb-c608-4b65-94c9-49ed28b1699d admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:17.182799 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4d3eb-c608-4b65-94c9-49ed28b1699d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:17.183149 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4d3eb-c608-4b65-94c9-49ed28b1699d admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:17.184094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4d3eb-c608-4b65-94c9-49ed28b1699d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:17.186224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4d3eb-c608-4b65-94c9-49ed28b1699d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:17.940599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1253/2489] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:35:17 2022] POST /identity/v3/projects => generated 371 bytes in 846 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:35:17.944834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fb03a-c9c4-4aad-888d-32f2223e7db8 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:17.955575 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fb03a-c9c4-4aad-888d-32f2223e7db8 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:18.005232 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:18.014712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37202f-a618-413b-97bd-ef956febcdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:18.015392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37202f-a618-413b-97bd-ef956febcdbc admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:18.015685 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37202f-a618-413b-97bd-ef956febcdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:18.015973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37202f-a618-413b-97bd-ef956febcdbc admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:18.016679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37202f-a618-413b-97bd-ef956febcdbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:18.018652 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37202f-a618-413b-97bd-ef956febcdbc admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:18.089053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1237/2490] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:35:17 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:35:18.092329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4d3eb-c608-4b65-94c9-49ed28b1699d admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:18.102558 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4d3eb-c608-4b65-94c9-49ed28b1699d admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:18.107010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41961e-8993-4e1d-ae73-f819845c2a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:18.107669 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41961e-8993-4e1d-ae73-f819845c2a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:18.107954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41961e-8993-4e1d-ae73-f819845c2a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:18.108250 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41961e-8993-4e1d-ae73-f819845c2a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:18.108956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41961e-8993-4e1d-ae73-f819845c2a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:18.110578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41961e-8993-4e1d-ae73-f819845c2a19 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:18.112620 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:18.122492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1254/2491] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:35:18.126662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37202f-a618-413b-97bd-ef956febcdbc admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:18.137753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37202f-a618-413b-97bd-ef956febcdbc admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:18.142333 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466cf5b-e074-4f30-bfb1-3937bc67717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:18.143222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466cf5b-e074-4f30-bfb1-3937bc67717c admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:18.143501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466cf5b-e074-4f30-bfb1-3937bc67717c admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:18.143774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466cf5b-e074-4f30-bfb1-3937bc67717c admin admin] PATH_INFO: `/v3/projects/1f31411827614ed1a9a5fb47a2682b6b/users/20ba8fc660504f86a745f1457378ca95/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:18.158364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466cf5b-e074-4f30-bfb1-3937bc67717c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f31411827614ed1a9a5fb47a2682b6b, user_id=20ba8fc660504f86a745f1457378ca95, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:18.160992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466cf5b-e074-4f30-bfb1-3937bc67717c admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:18.219056 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1238/2492] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:35:18 2022] PUT /identity/v3/projects/1f31411827614ed1a9a5fb47a2682b6b/users/20ba8fc660504f86a745f1457378ca95/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:18.222919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41961e-8993-4e1d-ae73-f819845c2a19 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:18.232772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41961e-8993-4e1d-ae73-f819845c2a19 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:18.288726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f0a10-c356-4863-9b7f-46d3ad328daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:18.289431 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f0a10-c356-4863-9b7f-46d3ad328daf admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:18.289717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f0a10-c356-4863-9b7f-46d3ad328daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:18.289994 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f0a10-c356-4863-9b7f-46d3ad328daf admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:18.290992 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f0a10-c356-4863-9b7f-46d3ad328daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:18.292652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f0a10-c356-4863-9b7f-46d3ad328daf admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:18.303447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1255/2493] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:35:18.307594 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466cf5b-e074-4f30-bfb1-3937bc67717c admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:18.318420 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466cf5b-e074-4f30-bfb1-3937bc67717c admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:18.323214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772a49-7bea-41b8-8c1b-b4c54e9d3b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:18.326188 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772a49-7bea-41b8-8c1b-b4c54e9d3b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:18.326188 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772a49-7bea-41b8-8c1b-b4c54e9d3b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:18.326188 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772a49-7bea-41b8-8c1b-b4c54e9d3b73 admin admin] PATH_INFO: `/v3/projects/1f31411827614ed1a9a5fb47a2682b6b/users/20ba8fc660504f86a745f1457378ca95/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:18.326875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23772a49-7bea-41b8-8c1b-b4c54e9d3b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f31411827614ed1a9a5fb47a2682b6b, user_id=20ba8fc660504f86a745f1457378ca95, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:18.329655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23772a49-7bea-41b8-8c1b-b4c54e9d3b73 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:18.340267 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1239/2494] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:35:18 2022] PUT /identity/v3/projects/1f31411827614ed1a9a5fb47a2682b6b/users/20ba8fc660504f86a745f1457378ca95/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:18.350486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337fe32-b3dc-4300-88cf-ba154d10fc0f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:18.350781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337fe32-b3dc-4300-88cf-ba154d10fc0f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:18.351062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337fe32-b3dc-4300-88cf-ba154d10fc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:18.379279 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a337fe32-b3dc-4300-88cf-ba154d10fc0f None None] MFA Rules not processed for user `20ba8fc660504f86a745f1457378ca95`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:18.381087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a337fe32-b3dc-4300-88cf-ba154d10fc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:18.451406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1256/2495] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:35:18.463285 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772a49-7bea-41b8-8c1b-b4c54e9d3b73 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:18.464987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-23772a49-7bea-41b8-8c1b-b4c54e9d3b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:18.522473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772a49-7bea-41b8-8c1b-b4c54e9d3b73 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:18.526267 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba685090-9c9b-49b9-b47a-a1570b99dee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:18.526991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba685090-9c9b-49b9-b47a-a1570b99dee7 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:18.527282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba685090-9c9b-49b9-b47a-a1570b99dee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:18.527560 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba685090-9c9b-49b9-b47a-a1570b99dee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:18.536879 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba685090-9c9b-49b9-b47a-a1570b99dee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:18.538375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba685090-9c9b-49b9-b47a-a1570b99dee7 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:18.548300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1240/2496] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:35:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:35:18.749140 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337fe32-b3dc-4300-88cf-ba154d10fc0f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:18.759384 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337fe32-b3dc-4300-88cf-ba154d10fc0f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:18.762978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56545578-f9f2-4c7e-a2db-35be8d52c483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:18.763624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56545578-f9f2-4c7e-a2db-35be8d52c483 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:18.763909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56545578-f9f2-4c7e-a2db-35be8d52c483 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:18.764186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56545578-f9f2-4c7e-a2db-35be8d52c483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:18.822243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56545578-f9f2-4c7e-a2db-35be8d52c483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:18.823691 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56545578-f9f2-4c7e-a2db-35be8d52c483 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:18.832716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1257/2497] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:35:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:35:19.608656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acff89-68ed-41ac-a285-df65b01cb790 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:19.609154 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acff89-68ed-41ac-a285-df65b01cb790 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:19.609265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acff89-68ed-41ac-a285-df65b01cb790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:19.627193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-22acff89-68ed-41ac-a285-df65b01cb790 None None] MFA Rules not processed for user `cdf13cc74cf94d9a87613fe1e102ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:19.628368 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-22acff89-68ed-41ac-a285-df65b01cb790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:19.684200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1241/2498] 10.222.0.26 () {58 vars in 967 bytes} [Tue Jul 12 16:35:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:35:19.697360 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56545578-f9f2-4c7e-a2db-35be8d52c483 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:19.699510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-56545578-f9f2-4c7e-a2db-35be8d52c483 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:19.724703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:19.776951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56545578-f9f2-4c7e-a2db-35be8d52c483 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:19.782789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdab09-1750-4274-ab5f-cfe6af95e0fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '143798e5887b49338f0000de5b55be68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:19.783450 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdab09-1750-4274-ab5f-cfe6af95e0fe service swift] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:19.783741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdab09-1750-4274-ab5f-cfe6af95e0fe service swift] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:19.784020 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdab09-1750-4274-ab5f-cfe6af95e0fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:19.804327 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdab09-1750-4274-ab5f-cfe6af95e0fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:19.804327 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdab09-1750-4274-ab5f-cfe6af95e0fe service swift] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:19.812089 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1258/2499] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 16:35:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 16:35:23.494472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acff89-68ed-41ac-a285-df65b01cb790 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:23.496195 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-22acff89-68ed-41ac-a285-df65b01cb790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:23.549263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:23.571932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acff89-68ed-41ac-a285-df65b01cb790 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:23.577502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b14991-c528-4a5c-9aa8-985cfdf60bc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:23.578383 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14991-c528-4a5c-9aa8-985cfdf60bc8 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:23.578840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14991-c528-4a5c-9aa8-985cfdf60bc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:23.579537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14991-c528-4a5c-9aa8-985cfdf60bc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:23.581459 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f5b14991-c528-4a5c-9aa8-985cfdf60bc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:23.593889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b14991-c528-4a5c-9aa8-985cfdf60bc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:23.595495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b14991-c528-4a5c-9aa8-985cfdf60bc8 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:23.606320 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1242/2500] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:35:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:35:29.808278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=24 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:33.629957 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=11 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:54.850398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdab09-1750-4274-ab5f-cfe6af95e0fe service swift] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:54.918288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdab09-1750-4274-ab5f-cfe6af95e0fe service swift] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:54.922786 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:54.923648 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:54.923931 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:54.924208 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] PATH_INFO: `/v3/users/2b0add131b6a4d57ab9cbe96d90e86dc` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:54.925430 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0add131b6a4d57ab9cbe96d90e86dc)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:54.927343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:55.123277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0add131b6a4d57ab9cbe96d90e86dc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:55.195017 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0add131b6a4d57ab9cbe96d90e86dc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:55.195637 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0add131b6a4d57ab9cbe96d90e86dc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:55.208328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0add131b6a4d57ab9cbe96d90e86dc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:55.215227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0add131b6a4d57ab9cbe96d90e86dc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:55.221427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1259/2501] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:35:54 2022] DELETE /identity/v3/users/2b0add131b6a4d57ab9cbe96d90e86dc => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:55.226119 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cb73a-55cd-44c5-971b-5bd006d37a05 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:55.228264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cb73a-55cd-44c5-971b-5bd006d37a05 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:55.228264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cb73a-55cd-44c5-971b-5bd006d37a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:55.246016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-405cb73a-55cd-44c5-971b-5bd006d37a05 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:55.247296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-405cb73a-55cd-44c5-971b-5bd006d37a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:55.306510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1243/2502] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:35:55.316689 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:55.318321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:55.381168 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc2d6f-cd56-4543-b341-c2f0b07cc737 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:55.384767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb561c06-372b-4390-bd9c-51a800c3ea06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:55.385461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561c06-372b-4390-bd9c-51a800c3ea06 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:55.385747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561c06-372b-4390-bd9c-51a800c3ea06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:55.386026 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561c06-372b-4390-bd9c-51a800c3ea06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:55.395278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb561c06-372b-4390-bd9c-51a800c3ea06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:55.396766 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb561c06-372b-4390-bd9c-51a800c3ea06 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:55.406878 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1260/2503] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:35:55.813864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cb73a-55cd-44c5-971b-5bd006d37a05 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:55.815459 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-405cb73a-55cd-44c5-971b-5bd006d37a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:55.827645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cb73a-55cd-44c5-971b-5bd006d37a05 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:55.832492 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:55.833403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:55.833694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:55.833975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] PATH_INFO: `/v3/projects/5e83f2956b264996bd59ddb24bb99372` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:55.835208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e83f2956b264996bd59ddb24bb99372)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:55.837783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:55.936230 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e83f2956b264996bd59ddb24bb99372', 'request_id': 'req-a30dccd1-4440-4fb7-b896-09d50f983641'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:56.004372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e83f2956b264996bd59ddb24bb99372', 'request_id': 'req-a30dccd1-4440-4fb7-b896-09d50f983641'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:56.011313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e83f2956b264996bd59ddb24bb99372', 'request_id': 'req-a30dccd1-4440-4fb7-b896-09d50f983641'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:56.021582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] The token cache is being invalidate because project 5e83f2956b264996bd59ddb24bb99372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:35:56.021933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:56.022557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:56.024725 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1244/2504] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:35:55 2022] DELETE /identity/v3/projects/5e83f2956b264996bd59ddb24bb99372 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:56.028921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb561c06-372b-4390-bd9c-51a800c3ea06 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:56.038942 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb561c06-372b-4390-bd9c-51a800c3ea06 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:56.057681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:56.096338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530f804-1a4a-4478-be6c-a0a2e95cec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:56.097238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530f804-1a4a-4478-be6c-a0a2e95cec33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:56.097526 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530f804-1a4a-4478-be6c-a0a2e95cec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:56.097802 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530f804-1a4a-4478-be6c-a0a2e95cec33 admin admin] PATH_INFO: `/v3/users/20ba8fc660504f86a745f1457378ca95` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:56.098977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530f804-1a4a-4478-be6c-a0a2e95cec33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ba8fc660504f86a745f1457378ca95)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:56.101023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530f804-1a4a-4478-be6c-a0a2e95cec33 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:56.265462 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e530f804-1a4a-4478-be6c-a0a2e95cec33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ba8fc660504f86a745f1457378ca95'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:56.326550 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e530f804-1a4a-4478-be6c-a0a2e95cec33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ba8fc660504f86a745f1457378ca95'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:56.327342 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e530f804-1a4a-4478-be6c-a0a2e95cec33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ba8fc660504f86a745f1457378ca95'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:56.340357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e530f804-1a4a-4478-be6c-a0a2e95cec33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ba8fc660504f86a745f1457378ca95'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:56.347310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-e530f804-1a4a-4478-be6c-a0a2e95cec33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ba8fc660504f86a745f1457378ca95'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:56.353947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1261/2505] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:35:56 2022] DELETE /identity/v3/users/20ba8fc660504f86a745f1457378ca95 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:56.836638 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:56.838746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:56.853398 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dccd1-4440-4fb7-b896-09d50f983641 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:56.912353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ab2de-4a5f-4679-a2b9-811a8030992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:56.913257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ab2de-4a5f-4679-a2b9-811a8030992b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:56.913546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ab2de-4a5f-4679-a2b9-811a8030992b admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:56.913827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ab2de-4a5f-4679-a2b9-811a8030992b admin admin] PATH_INFO: `/v3/projects/1f31411827614ed1a9a5fb47a2682b6b` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:56.915335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ab2de-4a5f-4679-a2b9-811a8030992b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f31411827614ed1a9a5fb47a2682b6b)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:56.917285 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ab2de-4a5f-4679-a2b9-811a8030992b admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:57.005982 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:57.022350 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f37ab2de-4a5f-4679-a2b9-811a8030992b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f31411827614ed1a9a5fb47a2682b6b', 'request_id': 'req-f37ab2de-4a5f-4679-a2b9-811a8030992b'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:57.141845 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f37ab2de-4a5f-4679-a2b9-811a8030992b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f31411827614ed1a9a5fb47a2682b6b', 'request_id': 'req-f37ab2de-4a5f-4679-a2b9-811a8030992b'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:57.148603 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f37ab2de-4a5f-4679-a2b9-811a8030992b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f31411827614ed1a9a5fb47a2682b6b', 'request_id': 'req-f37ab2de-4a5f-4679-a2b9-811a8030992b'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:57.160435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f37ab2de-4a5f-4679-a2b9-811a8030992b admin admin] The token cache is being invalidate because project 1f31411827614ed1a9a5fb47a2682b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:35:57.160722 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f37ab2de-4a5f-4679-a2b9-811a8030992b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:57.161404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f37ab2de-4a5f-4679-a2b9-811a8030992b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:35:57.163013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1245/2506] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:35:56 2022] DELETE /identity/v3/projects/1f31411827614ed1a9a5fb47a2682b6b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:57.168688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f38a2-c5c6-4d3a-96bb-bd0a15a5d8cf None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:57.180386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f38a2-c5c6-4d3a-96bb-bd0a15a5d8cf None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:57.180386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f38a2-c5c6-4d3a-96bb-bd0a15a5d8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:57.187677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ce7f38a2-c5c6-4d3a-96bb-bd0a15a5d8cf None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:57.188664 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ce7f38a2-c5c6-4d3a-96bb-bd0a15a5d8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:57.251760 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1262/2507] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:35:57.260735 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c1e4-7e8d-41b4-a11a-b2e627e4237d None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:57.261028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c1e4-7e8d-41b4-a11a-b2e627e4237d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:57.261359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c1e4-7e8d-41b4-a11a-b2e627e4237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:57.280441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-4201c1e4-7e8d-41b4-a11a-b2e627e4237d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:57.281677 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-4201c1e4-7e8d-41b4-a11a-b2e627e4237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:57.290834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1246/2508] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:35:57.294938 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f38a2-c5c6-4d3a-96bb-bd0a15a5d8cf None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:57.304398 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f38a2-c5c6-4d3a-96bb-bd0a15a5d8cf None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:57.309567 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a1fb0-108d-4d57-8ccd-75eb1d12d830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:57.310223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a1fb0-108d-4d57-8ccd-75eb1d12d830 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:57.310503 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a1fb0-108d-4d57-8ccd-75eb1d12d830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:57.310777 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a1fb0-108d-4d57-8ccd-75eb1d12d830 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:57.311499 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a1fb0-108d-4d57-8ccd-75eb1d12d830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:35:57.311807 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a1fb0-108d-4d57-8ccd-75eb1d12d830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:57.313444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a1fb0-108d-4d57-8ccd-75eb1d12d830 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:57.325917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1263/2509] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:35:57.330351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201c1e4-7e8d-41b4-a11a-b2e627e4237d None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:57.339948 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201c1e4-7e8d-41b4-a11a-b2e627e4237d None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:57.344725 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30519d-ac73-4c65-9596-b24339da9d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:57.345501 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30519d-ac73-4c65-9596-b24339da9d85 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:57.352050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30519d-ac73-4c65-9596-b24339da9d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:57.352050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30519d-ac73-4c65-9596-b24339da9d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:57.352050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30519d-ac73-4c65-9596-b24339da9d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:57.352050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30519d-ac73-4c65-9596-b24339da9d85 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:57.456247 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1247/2510] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:35:57 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:35:57.461954 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a1fb0-108d-4d57-8ccd-75eb1d12d830 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:57.469304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a1fb0-108d-4d57-8ccd-75eb1d12d830 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:57.497278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:57.528612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64be6ef-f8cf-45de-9949-bb5f80ed2588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:57.529321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be6ef-f8cf-45de-9949-bb5f80ed2588 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:57.529612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be6ef-f8cf-45de-9949-bb5f80ed2588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:57.529894 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be6ef-f8cf-45de-9949-bb5f80ed2588 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:57.530757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64be6ef-f8cf-45de-9949-bb5f80ed2588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:57.532690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64be6ef-f8cf-45de-9949-bb5f80ed2588 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:57.615465 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1264/2511] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:35:57 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:35:57.616689 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30519d-ac73-4c65-9596-b24339da9d85 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:57.627803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30519d-ac73-4c65-9596-b24339da9d85 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:57.632664 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951f767-e1c6-4327-a09b-15dd9b4c17ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:57.633367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951f767-e1c6-4327-a09b-15dd9b4c17ca admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:57.634306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951f767-e1c6-4327-a09b-15dd9b4c17ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:57.634591 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951f767-e1c6-4327-a09b-15dd9b4c17ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:57.635413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951f767-e1c6-4327-a09b-15dd9b4c17ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:57.637016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951f767-e1c6-4327-a09b-15dd9b4c17ca admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:57.657391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1248/2512] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:35:57.658087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64be6ef-f8cf-45de-9949-bb5f80ed2588 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:57.668662 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64be6ef-f8cf-45de-9949-bb5f80ed2588 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:57.673542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c303a2-4815-4a81-a709-bab1cd9eee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:57.675397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c303a2-4815-4a81-a709-bab1cd9eee8f admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:57.675397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c303a2-4815-4a81-a709-bab1cd9eee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:57.675397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c303a2-4815-4a81-a709-bab1cd9eee8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:57.676008 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c303a2-4815-4a81-a709-bab1cd9eee8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:57.677867 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c303a2-4815-4a81-a709-bab1cd9eee8f admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:57.689895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1265/2513] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:35:57.693635 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951f767-e1c6-4327-a09b-15dd9b4c17ca admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:57.707764 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951f767-e1c6-4327-a09b-15dd9b4c17ca admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:57.713495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145c22b-9906-441b-a07e-4991c6e4e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:57.717171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145c22b-9906-441b-a07e-4991c6e4e036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:57.717171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145c22b-9906-441b-a07e-4991c6e4e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:57.717171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145c22b-9906-441b-a07e-4991c6e4e036 admin admin] PATH_INFO: `/v3/projects/2ef3e69d8cf54c76933e8fdaa8cb843a/users/b7fb2831eb3d4f9cb2df24514b6aa757/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:57.734826 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145c22b-9906-441b-a07e-4991c6e4e036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef3e69d8cf54c76933e8fdaa8cb843a, user_id=b7fb2831eb3d4f9cb2df24514b6aa757, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:57.737747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145c22b-9906-441b-a07e-4991c6e4e036 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:57.842793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1249/2514] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:35:57 2022] PUT /identity/v3/projects/2ef3e69d8cf54c76933e8fdaa8cb843a/users/b7fb2831eb3d4f9cb2df24514b6aa757/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:57.853978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e6862-d325-4742-b5df-112024991af7 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:57.854267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e6862-d325-4742-b5df-112024991af7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:57.854542 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e6862-d325-4742-b5df-112024991af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:57.886490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-815e6862-d325-4742-b5df-112024991af7 None None] MFA Rules not processed for user `b7fb2831eb3d4f9cb2df24514b6aa757`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:57.887740 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-815e6862-d325-4742-b5df-112024991af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:57.971967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1266/2515] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:35:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:35:57.976809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145c22b-9906-441b-a07e-4991c6e4e036 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:58.044462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145c22b-9906-441b-a07e-4991c6e4e036 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:58.049524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28c127-3f63-4ff0-a98b-4046eccc433b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:58.050184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28c127-3f63-4ff0-a98b-4046eccc433b admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:58.050472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28c127-3f63-4ff0-a98b-4046eccc433b admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:58.050757 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28c127-3f63-4ff0-a98b-4046eccc433b admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:58.051484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28c127-3f63-4ff0-a98b-4046eccc433b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:58.053485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28c127-3f63-4ff0-a98b-4046eccc433b admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:58.120624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1250/2516] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:35:57 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:35:58.124743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e6862-d325-4742-b5df-112024991af7 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:58.138014 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e6862-d325-4742-b5df-112024991af7 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:58.197371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9b441-ee1e-4161-872f-224985fc7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:58.198068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9b441-ee1e-4161-872f-224985fc7802 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:58.198380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9b441-ee1e-4161-872f-224985fc7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:58.198665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9b441-ee1e-4161-872f-224985fc7802 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:58.199399 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9b441-ee1e-4161-872f-224985fc7802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:58.201456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9b441-ee1e-4161-872f-224985fc7802 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:58.285432 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1267/2517] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:35:58 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:35:58.289637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28c127-3f63-4ff0-a98b-4046eccc433b admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:58.300316 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28c127-3f63-4ff0-a98b-4046eccc433b admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:58.304910 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56ad6e-f12e-413f-805c-1fcd83b58b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:58.305772 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56ad6e-f12e-413f-805c-1fcd83b58b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:58.305972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56ad6e-f12e-413f-805c-1fcd83b58b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:58.306253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56ad6e-f12e-413f-805c-1fcd83b58b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:58.306982 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56ad6e-f12e-413f-805c-1fcd83b58b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:58.308642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56ad6e-f12e-413f-805c-1fcd83b58b6b admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:58.319473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1251/2518] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:35:58.324489 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9b441-ee1e-4161-872f-224985fc7802 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:58.334919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9b441-ee1e-4161-872f-224985fc7802 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:58.341649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edfb70-9a1c-4062-b778-480c068d1dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:58.343242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edfb70-9a1c-4062-b778-480c068d1dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:58.343752 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edfb70-9a1c-4062-b778-480c068d1dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:58.344096 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edfb70-9a1c-4062-b778-480c068d1dd6 admin admin] PATH_INFO: `/v3/projects/7fd8dfaefd4a451ca2820d353546975c/users/5de060333eca43408267d090563acc70/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:58.363557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edfb70-9a1c-4062-b778-480c068d1dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd8dfaefd4a451ca2820d353546975c, user_id=5de060333eca43408267d090563acc70, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:58.366353 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edfb70-9a1c-4062-b778-480c068d1dd6 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:58.452365 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1268/2519] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:35:58 2022] PUT /identity/v3/projects/7fd8dfaefd4a451ca2820d353546975c/users/5de060333eca43408267d090563acc70/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:35:58.456288 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56ad6e-f12e-413f-805c-1fcd83b58b6b admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:58.469476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56ad6e-f12e-413f-805c-1fcd83b58b6b admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:58.490248 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:58.530704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b835b88-56b1-4063-ad88-0910887de227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:58.531505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b835b88-56b1-4063-ad88-0910887de227 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:58.531798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b835b88-56b1-4063-ad88-0910887de227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:58.532081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b835b88-56b1-4063-ad88-0910887de227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:58.532811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b835b88-56b1-4063-ad88-0910887de227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:58.534484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b835b88-56b1-4063-ad88-0910887de227 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:58.545502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1252/2520] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:35:58.549758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edfb70-9a1c-4062-b778-480c068d1dd6 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:58.555796 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:35:58.567061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edfb70-9a1c-4062-b778-480c068d1dd6 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:58.567061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ed31c-2a18-4848-bc66-a71897b7bb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:58.567273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ed31c-2a18-4848-bc66-a71897b7bb76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:58.567549 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ed31c-2a18-4848-bc66-a71897b7bb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:58.567822 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ed31c-2a18-4848-bc66-a71897b7bb76 admin admin] PATH_INFO: `/v3/projects/7fd8dfaefd4a451ca2820d353546975c/users/5de060333eca43408267d090563acc70/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:58.569844 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ed31c-2a18-4848-bc66-a71897b7bb76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd8dfaefd4a451ca2820d353546975c, user_id=5de060333eca43408267d090563acc70, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:58.573174 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ed31c-2a18-4848-bc66-a71897b7bb76 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:58.583856 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1269/2521] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:35:58 2022] PUT /identity/v3/projects/7fd8dfaefd4a451ca2820d353546975c/users/5de060333eca43408267d090563acc70/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:35:58.594714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d763dfb-4c8b-49a1-9c74-42ff9e3b8f7b None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:58.595009 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d763dfb-4c8b-49a1-9c74-42ff9e3b8f7b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:58.595294 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d763dfb-4c8b-49a1-9c74-42ff9e3b8f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:58.622214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-5d763dfb-4c8b-49a1-9c74-42ff9e3b8f7b None None] MFA Rules not processed for user `5de060333eca43408267d090563acc70`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:35:58.623434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5d763dfb-4c8b-49a1-9c74-42ff9e3b8f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:58.692360 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1253/2522] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:35:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:35:58.704012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ed31c-2a18-4848-bc66-a71897b7bb76 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:58.705711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-916ed31c-2a18-4848-bc66-a71897b7bb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:35:58.767665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ed31c-2a18-4848-bc66-a71897b7bb76 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:58.767967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18152bf-9d57-49a3-8019-f5ef0a9013e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:58.768616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18152bf-9d57-49a3-8019-f5ef0a9013e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:58.768896 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18152bf-9d57-49a3-8019-f5ef0a9013e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:58.769197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18152bf-9d57-49a3-8019-f5ef0a9013e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:58.778441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18152bf-9d57-49a3-8019-f5ef0a9013e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:58.779911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18152bf-9d57-49a3-8019-f5ef0a9013e2 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:58.789380 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1270/2523] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:35:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:35:58.946196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d763dfb-4c8b-49a1-9c74-42ff9e3b8f7b None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:35:58.957257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d763dfb-4c8b-49a1-9c74-42ff9e3b8f7b None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:35:58.961084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd04c9-cac8-4878-8b40-c28645335b0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:35:58.961802 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd04c9-cac8-4878-8b40-c28645335b0a service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:35:58.962085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd04c9-cac8-4878-8b40-c28645335b0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:35:58.962363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd04c9-cac8-4878-8b40-c28645335b0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:35:59.021427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd04c9-cac8-4878-8b40-c28645335b0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:35:59.021921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd04c9-cac8-4878-8b40-c28645335b0a service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:35:59.031538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1254/2524] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:35:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:36:02.840544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18152bf-9d57-49a3-8019-f5ef0a9013e2 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:02.847051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e18152bf-9d57-49a3-8019-f5ef0a9013e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:02.897736 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18152bf-9d57-49a3-8019-f5ef0a9013e2 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:02.901916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924bfd2-217d-411a-8c97-e7476d95bddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:02.902564 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924bfd2-217d-411a-8c97-e7476d95bddc service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:02.902849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924bfd2-217d-411a-8c97-e7476d95bddc service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:02.903128 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924bfd2-217d-411a-8c97-e7476d95bddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:02.904913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f924bfd2-217d-411a-8c97-e7476d95bddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:02.968102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924bfd2-217d-411a-8c97-e7476d95bddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:02.969554 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924bfd2-217d-411a-8c97-e7476d95bddc service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:02.978985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1271/2525] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:06.691952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd04c9-cac8-4878-8b40-c28645335b0a service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:06.694065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-48cd04c9-cac8-4878-8b40-c28645335b0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:06.711427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd04c9-cac8-4878-8b40-c28645335b0a service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:06.716838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:06.717875 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:06.718249 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:06.718528 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] PATH_INFO: `/v3/users/8a248a93038e426da3ed5ab25a65eb81` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:06.719739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a248a93038e426da3ed5ab25a65eb81)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:06.721690 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:06.965532 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:06.971761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a248a93038e426da3ed5ab25a65eb81'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:07.051057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a248a93038e426da3ed5ab25a65eb81'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:07.066938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a248a93038e426da3ed5ab25a65eb81'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:07.067958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a248a93038e426da3ed5ab25a65eb81'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:07.081795 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a248a93038e426da3ed5ab25a65eb81'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:07.089444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1255/2526] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:06 2022] DELETE /identity/v3/users/8a248a93038e426da3ed5ab25a65eb81 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:07.197839 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eebfd-984d-4010-a8db-e2c350b056b5 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:07.198382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eebfd-984d-4010-a8db-e2c350b056b5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:07.198511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eebfd-984d-4010-a8db-e2c350b056b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:07.217105 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-df3eebfd-984d-4010-a8db-e2c350b056b5 None None] MFA Rules not processed for user `a727df3cf06746b8929de45d8ab5493c`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:07.218354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-df3eebfd-984d-4010-a8db-e2c350b056b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:07.264716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:07.283606 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1272/2527] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:07.422276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:07.423796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:07.496792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258e246-1a75-4c6e-88a3-c0235d849f61 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:07.501643 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3061203-9b02-453c-bc29-a724b21713c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:07.502523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3061203-9b02-453c-bc29-a724b21713c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:07.502810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3061203-9b02-453c-bc29-a724b21713c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:07.503095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3061203-9b02-453c-bc29-a724b21713c0 admin admin] PATH_INFO: `/v3/projects/0e863c4004e64e788cd32ff5cc836482` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:07.504281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3061203-9b02-453c-bc29-a724b21713c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e863c4004e64e788cd32ff5cc836482)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:07.506239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3061203-9b02-453c-bc29-a724b21713c0 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:07.618418 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a3061203-9b02-453c-bc29-a724b21713c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e863c4004e64e788cd32ff5cc836482', 'request_id': 'req-a3061203-9b02-453c-bc29-a724b21713c0'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:07.715176 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a3061203-9b02-453c-bc29-a724b21713c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e863c4004e64e788cd32ff5cc836482', 'request_id': 'req-a3061203-9b02-453c-bc29-a724b21713c0'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:07.722298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a3061203-9b02-453c-bc29-a724b21713c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e863c4004e64e788cd32ff5cc836482', 'request_id': 'req-a3061203-9b02-453c-bc29-a724b21713c0'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:07.733055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a3061203-9b02-453c-bc29-a724b21713c0 admin admin] The token cache is being invalidate because project 0e863c4004e64e788cd32ff5cc836482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:07.733368 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a3061203-9b02-453c-bc29-a724b21713c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:07.734012 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-a3061203-9b02-453c-bc29-a724b21713c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:07.735565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1256/2528] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:07 2022] DELETE /identity/v3/projects/0e863c4004e64e788cd32ff5cc836482 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:07.740939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a4e66-8ffc-4943-a404-2fd8cc3c8ee8 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:07.740939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a4e66-8ffc-4943-a404-2fd8cc3c8ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:07.741165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a4e66-8ffc-4943-a404-2fd8cc3c8ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:07.767431 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-9f5a4e66-8ffc-4943-a404-2fd8cc3c8ee8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:07.768749 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9f5a4e66-8ffc-4943-a404-2fd8cc3c8ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:07.838175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1273/2529] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:07.845929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cca67-b5f9-4228-a23d-b92bfa1386b1 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:07.847049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cca67-b5f9-4228-a23d-b92bfa1386b1 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:07.847049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cca67-b5f9-4228-a23d-b92bfa1386b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:07.865609 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-fe6cca67-b5f9-4228-a23d-b92bfa1386b1 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:07.866840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-fe6cca67-b5f9-4228-a23d-b92bfa1386b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:07.875387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1257/2530] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:07.879625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a4e66-8ffc-4943-a404-2fd8cc3c8ee8 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:07.889182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a4e66-8ffc-4943-a404-2fd8cc3c8ee8 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:07.893697 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57af8b-af1d-4139-b672-7a6ebb17be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:07.894352 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57af8b-af1d-4139-b672-7a6ebb17be95 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:07.894630 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57af8b-af1d-4139-b672-7a6ebb17be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:07.894906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57af8b-af1d-4139-b672-7a6ebb17be95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:07.895629 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57af8b-af1d-4139-b672-7a6ebb17be95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:36:07.895936 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57af8b-af1d-4139-b672-7a6ebb17be95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:07.897558 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57af8b-af1d-4139-b672-7a6ebb17be95 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:07.911253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1274/2531] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:36:07.916126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cca67-b5f9-4228-a23d-b92bfa1386b1 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:07.926455 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cca67-b5f9-4228-a23d-b92bfa1386b1 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:07.931880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfefcb-9a51-4594-84a0-9927551317de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:07.932531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfefcb-9a51-4594-84a0-9927551317de admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:07.935087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfefcb-9a51-4594-84a0-9927551317de admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:07.935087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfefcb-9a51-4594-84a0-9927551317de admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:07.935087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfefcb-9a51-4594-84a0-9927551317de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:07.936013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfefcb-9a51-4594-84a0-9927551317de admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:08.052139 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1258/2532] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:07 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:08.057615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57af8b-af1d-4139-b672-7a6ebb17be95 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:08.069805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57af8b-af1d-4139-b672-7a6ebb17be95 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:08.099261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfefcb-9a51-4594-84a0-9927551317de admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:08.101094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1bdfefcb-9a51-4594-84a0-9927551317de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:08.128927 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:08.145703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27e503-92c2-4e43-9221-847bd71831cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:08.147369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27e503-92c2-4e43-9221-847bd71831cf admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:08.147658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27e503-92c2-4e43-9221-847bd71831cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:08.147946 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27e503-92c2-4e43-9221-847bd71831cf admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:08.148652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27e503-92c2-4e43-9221-847bd71831cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:08.151026 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27e503-92c2-4e43-9221-847bd71831cf admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:08.177610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfefcb-9a51-4594-84a0-9927551317de admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:08.183278 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716256-01cf-4dd9-89a7-52d4a909fa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:08.184191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716256-01cf-4dd9-89a7-52d4a909fa2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:08.184473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716256-01cf-4dd9-89a7-52d4a909fa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:08.184744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716256-01cf-4dd9-89a7-52d4a909fa2c admin admin] PATH_INFO: `/v3/users/b7fb2831eb3d4f9cb2df24514b6aa757` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:08.186944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7716256-01cf-4dd9-89a7-52d4a909fa2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7fb2831eb3d4f9cb2df24514b6aa757)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:08.191440 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7716256-01cf-4dd9-89a7-52d4a909fa2c admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:08.342406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1275/2533] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:08 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:08.346404 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27e503-92c2-4e43-9221-847bd71831cf admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:08.363467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27e503-92c2-4e43-9221-847bd71831cf admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:08.363467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474fd2c-34b6-498c-9035-b6fa720d9562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:08.363467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474fd2c-34b6-498c-9035-b6fa720d9562 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:08.363467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474fd2c-34b6-498c-9035-b6fa720d9562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:08.364005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474fd2c-34b6-498c-9035-b6fa720d9562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:08.364005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474fd2c-34b6-498c-9035-b6fa720d9562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:08.365342 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474fd2c-34b6-498c-9035-b6fa720d9562 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:08.375933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1276/2534] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:36:08.379679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474fd2c-34b6-498c-9035-b6fa720d9562 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:08.389730 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474fd2c-34b6-498c-9035-b6fa720d9562 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:08.394259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641375ae-da84-4cc8-8f85-1add494ea33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:08.394901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641375ae-da84-4cc8-8f85-1add494ea33c admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:08.395186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641375ae-da84-4cc8-8f85-1add494ea33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:08.395461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641375ae-da84-4cc8-8f85-1add494ea33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:08.396171 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641375ae-da84-4cc8-8f85-1add494ea33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:08.397849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641375ae-da84-4cc8-8f85-1add494ea33c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:08.408831 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1277/2535] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:36:08.413143 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641375ae-da84-4cc8-8f85-1add494ea33c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:08.422986 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641375ae-da84-4cc8-8f85-1add494ea33c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:08.427579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab26d18-e563-4505-bb1f-7bb9096b65de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:08.428501 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab26d18-e563-4505-bb1f-7bb9096b65de admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:08.428783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab26d18-e563-4505-bb1f-7bb9096b65de admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:08.429059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab26d18-e563-4505-bb1f-7bb9096b65de admin admin] PATH_INFO: `/v3/projects/bfccc9b52cb24cd3972a92c143a4baeb/users/09b67ac7b8d04e298b503f68e2e02a2c/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:08.443651 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab26d18-e563-4505-bb1f-7bb9096b65de admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfccc9b52cb24cd3972a92c143a4baeb, user_id=09b67ac7b8d04e298b503f68e2e02a2c, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:08.446420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab26d18-e563-4505-bb1f-7bb9096b65de admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:08.483756 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b7716256-01cf-4dd9-89a7-52d4a909fa2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7fb2831eb3d4f9cb2df24514b6aa757'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:08.556345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1278/2536] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:08 2022] PUT /identity/v3/projects/bfccc9b52cb24cd3972a92c143a4baeb/users/09b67ac7b8d04e298b503f68e2e02a2c/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:08.564128 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b7716256-01cf-4dd9-89a7-52d4a909fa2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7fb2831eb3d4f9cb2df24514b6aa757'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:08.566378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee11c-088e-40ef-a992-be6322c5bd02 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:08.566673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee11c-088e-40ef-a992-be6322c5bd02 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:08.566958 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee11c-088e-40ef-a992-be6322c5bd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:08.578291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b7716256-01cf-4dd9-89a7-52d4a909fa2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7fb2831eb3d4f9cb2df24514b6aa757'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:08.578972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b7716256-01cf-4dd9-89a7-52d4a909fa2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7fb2831eb3d4f9cb2df24514b6aa757'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:08.586697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b7716256-01cf-4dd9-89a7-52d4a909fa2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7fb2831eb3d4f9cb2df24514b6aa757'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:08.592880 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1259/2537] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:08 2022] DELETE /identity/v3/users/b7fb2831eb3d4f9cb2df24514b6aa757 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:08.593653 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-40fee11c-088e-40ef-a992-be6322c5bd02 None None] MFA Rules not processed for user `09b67ac7b8d04e298b503f68e2e02a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:08.594860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-40fee11c-088e-40ef-a992-be6322c5bd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:08.597090 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b09c4-db1d-44cb-a26c-0204b25f1454 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:08.597437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b09c4-db1d-44cb-a26c-0204b25f1454 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:08.597878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b09c4-db1d-44cb-a26c-0204b25f1454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:08.600011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:08.619767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-1f0b09c4-db1d-44cb-a26c-0204b25f1454 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:08.619767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1f0b09c4-db1d-44cb-a26c-0204b25f1454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:08.670205 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1279/2538] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:36:08.682008 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee11c-088e-40ef-a992-be6322c5bd02 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:08.683400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-40fee11c-088e-40ef-a992-be6322c5bd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:08.688342 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1260/2539] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:36:08.697748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b09c4-db1d-44cb-a26c-0204b25f1454 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:08.699065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1f0b09c4-db1d-44cb-a26c-0204b25f1454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:08.741915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:08.758436 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b09c4-db1d-44cb-a26c-0204b25f1454 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:08.762175 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6caf79-2bbe-4014-ad1a-b7a8c1538fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:08.762913 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6caf79-2bbe-4014-ad1a-b7a8c1538fea service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:08.763276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6caf79-2bbe-4014-ad1a-b7a8c1538fea service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:08.763506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee11c-088e-40ef-a992-be6322c5bd02 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:08.763694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6caf79-2bbe-4014-ad1a-b7a8c1538fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:08.769370 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c77bf-9dca-4248-aa9b-c7bc5be239eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:08.770024 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c77bf-9dca-4248-aa9b-c7bc5be239eb service nova] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:08.770311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c77bf-9dca-4248-aa9b-c7bc5be239eb service nova] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:08.770588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c77bf-9dca-4248-aa9b-c7bc5be239eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:08.772878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6caf79-2bbe-4014-ad1a-b7a8c1538fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:08.774480 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6caf79-2bbe-4014-ad1a-b7a8c1538fea service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:08.778572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c77bf-9dca-4248-aa9b-c7bc5be239eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:08.780204 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c77bf-9dca-4248-aa9b-c7bc5be239eb service nova] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:08.783908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1261/2540] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:36:08.790351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1280/2541] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:36:09.288314 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6caf79-2bbe-4014-ad1a-b7a8c1538fea service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:09.291197 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8f6caf79-2bbe-4014-ad1a-b7a8c1538fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:09.316543 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6caf79-2bbe-4014-ad1a-b7a8c1538fea service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:09.321615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:09.322498 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:09.322762 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:09.323036 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] PATH_INFO: `/v3/projects/2ef3e69d8cf54c76933e8fdaa8cb843a` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:09.324232 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef3e69d8cf54c76933e8fdaa8cb843a)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:09.326161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:09.553684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef3e69d8cf54c76933e8fdaa8cb843a', 'request_id': 'req-e332d136-d2b8-4ff1-91a8-b00258b2c891'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:09.669724 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef3e69d8cf54c76933e8fdaa8cb843a', 'request_id': 'req-e332d136-d2b8-4ff1-91a8-b00258b2c891'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:09.676992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef3e69d8cf54c76933e8fdaa8cb843a', 'request_id': 'req-e332d136-d2b8-4ff1-91a8-b00258b2c891'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:09.694300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] The token cache is being invalidate because project 2ef3e69d8cf54c76933e8fdaa8cb843a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:09.694696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:09.695462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:09.698092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1262/2542] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:09 2022] DELETE /identity/v3/projects/2ef3e69d8cf54c76933e8fdaa8cb843a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:09.701849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c77bf-9dca-4248-aa9b-c7bc5be239eb service nova] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:09.713426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c77bf-9dca-4248-aa9b-c7bc5be239eb service nova] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:09.800607 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d14c7e-356d-4ce6-b44a-219c38e169fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:09.801504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d14c7e-356d-4ce6-b44a-219c38e169fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:09.801787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d14c7e-356d-4ce6-b44a-219c38e169fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:09.802059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d14c7e-356d-4ce6-b44a-219c38e169fe admin admin] PATH_INFO: `/v3/users/5de060333eca43408267d090563acc70` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:09.803340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d14c7e-356d-4ce6-b44a-219c38e169fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de060333eca43408267d090563acc70)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:09.805876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d14c7e-356d-4ce6-b44a-219c38e169fe admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:10.021063 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:10.029600 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c7d14c7e-356d-4ce6-b44a-219c38e169fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de060333eca43408267d090563acc70'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:10.143741 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c7d14c7e-356d-4ce6-b44a-219c38e169fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de060333eca43408267d090563acc70'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:10.144369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c7d14c7e-356d-4ce6-b44a-219c38e169fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de060333eca43408267d090563acc70'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:10.157632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c7d14c7e-356d-4ce6-b44a-219c38e169fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de060333eca43408267d090563acc70'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:10.165221 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c7d14c7e-356d-4ce6-b44a-219c38e169fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de060333eca43408267d090563acc70'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:10.171055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1281/2543] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:09 2022] DELETE /identity/v3/users/5de060333eca43408267d090563acc70 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:10.673949 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:10.675868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:10.700892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d136-d2b8-4ff1-91a8-b00258b2c891 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:10.759524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe704f-1df3-4a2e-a55e-4d520f383462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:10.760393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe704f-1df3-4a2e-a55e-4d520f383462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:10.760672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe704f-1df3-4a2e-a55e-4d520f383462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:10.760944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe704f-1df3-4a2e-a55e-4d520f383462 admin admin] PATH_INFO: `/v3/projects/7fd8dfaefd4a451ca2820d353546975c` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:10.762174 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe704f-1df3-4a2e-a55e-4d520f383462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd8dfaefd4a451ca2820d353546975c)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:10.764062 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe704f-1df3-4a2e-a55e-4d520f383462 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:10.930867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e7fe704f-1df3-4a2e-a55e-4d520f383462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd8dfaefd4a451ca2820d353546975c', 'request_id': 'req-e7fe704f-1df3-4a2e-a55e-4d520f383462'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:11.044325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e7fe704f-1df3-4a2e-a55e-4d520f383462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd8dfaefd4a451ca2820d353546975c', 'request_id': 'req-e7fe704f-1df3-4a2e-a55e-4d520f383462'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:11.051216 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e7fe704f-1df3-4a2e-a55e-4d520f383462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd8dfaefd4a451ca2820d353546975c', 'request_id': 'req-e7fe704f-1df3-4a2e-a55e-4d520f383462'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:11.055925 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:11.063165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e7fe704f-1df3-4a2e-a55e-4d520f383462 admin admin] The token cache is being invalidate because project 7fd8dfaefd4a451ca2820d353546975c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:11.063456 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e7fe704f-1df3-4a2e-a55e-4d520f383462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:11.064108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e7fe704f-1df3-4a2e-a55e-4d520f383462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:11.065762 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1263/2544] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:10 2022] DELETE /identity/v3/projects/7fd8dfaefd4a451ca2820d353546975c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:11.070619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c309ed-33e7-4e4c-9c36-ddb5d14a2c55 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:11.075220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c309ed-33e7-4e4c-9c36-ddb5d14a2c55 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:11.075220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c309ed-33e7-4e4c-9c36-ddb5d14a2c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:11.090988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-28c309ed-33e7-4e4c-9c36-ddb5d14a2c55 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:11.092208 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-28c309ed-33e7-4e4c-9c36-ddb5d14a2c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:11.157924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1282/2545] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:11.166263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3176ba-8d8f-4b4d-ba8d-1add979c7752 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:11.166557 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3176ba-8d8f-4b4d-ba8d-1add979c7752 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:11.166835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3176ba-8d8f-4b4d-ba8d-1add979c7752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:11.185367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-bc3176ba-8d8f-4b4d-ba8d-1add979c7752 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:11.186565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-bc3176ba-8d8f-4b4d-ba8d-1add979c7752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:11.198941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1264/2546] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:11.200369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c309ed-33e7-4e4c-9c36-ddb5d14a2c55 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:11.211155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c309ed-33e7-4e4c-9c36-ddb5d14a2c55 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:11.217798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41e306-c912-4eb1-ac79-096b03eb2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:11.218760 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41e306-c912-4eb1-ac79-096b03eb2724 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:11.219011 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41e306-c912-4eb1-ac79-096b03eb2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:11.224615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41e306-c912-4eb1-ac79-096b03eb2724 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:11.224615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41e306-c912-4eb1-ac79-096b03eb2724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:36:11.224615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41e306-c912-4eb1-ac79-096b03eb2724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:11.224615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41e306-c912-4eb1-ac79-096b03eb2724 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:11.235803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1283/2547] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:36:11.240322 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3176ba-8d8f-4b4d-ba8d-1add979c7752 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:11.249691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3176ba-8d8f-4b4d-ba8d-1add979c7752 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:11.254344 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cd1ca-efd6-4938-b42e-12ae7c5e417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:11.254987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd1ca-efd6-4938-b42e-12ae7c5e417f admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:11.255271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd1ca-efd6-4938-b42e-12ae7c5e417f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:11.255545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd1ca-efd6-4938-b42e-12ae7c5e417f admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:11.256325 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cd1ca-efd6-4938-b42e-12ae7c5e417f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:11.258265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cd1ca-efd6-4938-b42e-12ae7c5e417f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:11.378283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1265/2548] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:11 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:11.382813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41e306-c912-4eb1-ac79-096b03eb2724 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:11.395358 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41e306-c912-4eb1-ac79-096b03eb2724 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:11.501546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9db55f-ad45-4c0a-a739-65304717b46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:11.502257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9db55f-ad45-4c0a-a739-65304717b46c admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:11.502545 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9db55f-ad45-4c0a-a739-65304717b46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:11.502821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9db55f-ad45-4c0a-a739-65304717b46c admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:11.503537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9db55f-ad45-4c0a-a739-65304717b46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:11.505861 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9db55f-ad45-4c0a-a739-65304717b46c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:11.600581 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1284/2549] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:11 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:11.605341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cd1ca-efd6-4938-b42e-12ae7c5e417f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:11.616887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cd1ca-efd6-4938-b42e-12ae7c5e417f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:11.623195 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed456f82-e56b-4937-b3ce-2091c11c693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:11.623979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed456f82-e56b-4937-b3ce-2091c11c693d admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:11.624346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed456f82-e56b-4937-b3ce-2091c11c693d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:11.624683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed456f82-e56b-4937-b3ce-2091c11c693d admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:11.627338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed456f82-e56b-4937-b3ce-2091c11c693d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:11.627338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed456f82-e56b-4937-b3ce-2091c11c693d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:11.643136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1266/2550] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:11.647721 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9db55f-ad45-4c0a-a739-65304717b46c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:11.660098 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9db55f-ad45-4c0a-a739-65304717b46c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:11.665556 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f1f6-789e-4c89-a0e8-b99255040f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:11.666325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f1f6-789e-4c89-a0e8-b99255040f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:11.666528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f1f6-789e-4c89-a0e8-b99255040f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:11.666820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f1f6-789e-4c89-a0e8-b99255040f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:11.667563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2f1f6-789e-4c89-a0e8-b99255040f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:11.672838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2f1f6-789e-4c89-a0e8-b99255040f73 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:11.684423 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1285/2551] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:36:11.685579 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed456f82-e56b-4937-b3ce-2091c11c693d admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:11.701055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed456f82-e56b-4937-b3ce-2091c11c693d admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:11.706616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c500e5-0ef7-422c-a807-ed2304638ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:11.707667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c500e5-0ef7-422c-a807-ed2304638ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:11.708051 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c500e5-0ef7-422c-a807-ed2304638ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:11.708367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c500e5-0ef7-422c-a807-ed2304638ac1 admin admin] PATH_INFO: `/v3/projects/17f782ceacea42c9a5ee8865395188c5/users/e31b1fd79c7141c1afdfcbabfffeb04e/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:11.724300 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c500e5-0ef7-422c-a807-ed2304638ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f782ceacea42c9a5ee8865395188c5, user_id=e31b1fd79c7141c1afdfcbabfffeb04e, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:11.728090 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c500e5-0ef7-422c-a807-ed2304638ac1 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:11.804506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1267/2552] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:11 2022] PUT /identity/v3/projects/17f782ceacea42c9a5ee8865395188c5/users/e31b1fd79c7141c1afdfcbabfffeb04e/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:11.816379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1255305-b9c9-46a5-9aa5-b987b5a50b11 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:11.816679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1255305-b9c9-46a5-9aa5-b987b5a50b11 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:11.816977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1255305-b9c9-46a5-9aa5-b987b5a50b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:11.844163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-f1255305-b9c9-46a5-9aa5-b987b5a50b11 None None] MFA Rules not processed for user `e31b1fd79c7141c1afdfcbabfffeb04e`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:11.845438 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f1255305-b9c9-46a5-9aa5-b987b5a50b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:11.850657 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:11.912126 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1286/2553] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:36:11.917512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c500e5-0ef7-422c-a807-ed2304638ac1 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:11.979854 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c500e5-0ef7-422c-a807-ed2304638ac1 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:11.984546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52082254-776c-427c-9412-1cf8f2c95e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:11.985223 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52082254-776c-427c-9412-1cf8f2c95e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:11.985551 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52082254-776c-427c-9412-1cf8f2c95e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:11.985827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52082254-776c-427c-9412-1cf8f2c95e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:11.986521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52082254-776c-427c-9412-1cf8f2c95e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:11.988427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52082254-776c-427c-9412-1cf8f2c95e05 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:12.101004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1268/2554] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:11 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:12.105790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1255305-b9c9-46a5-9aa5-b987b5a50b11 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:12.118612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1255305-b9c9-46a5-9aa5-b987b5a50b11 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:12.192583 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a1bc7-d554-4ba0-89b7-7c7f15e68f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:12.193302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a1bc7-d554-4ba0-89b7-7c7f15e68f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:12.193698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a1bc7-d554-4ba0-89b7-7c7f15e68f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:12.193974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a1bc7-d554-4ba0-89b7-7c7f15e68f6a admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:12.194681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a1bc7-d554-4ba0-89b7-7c7f15e68f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:12.196775 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a1bc7-d554-4ba0-89b7-7c7f15e68f6a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:12.310400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1287/2555] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:12 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:36:12.314400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52082254-776c-427c-9412-1cf8f2c95e05 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:12.325897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52082254-776c-427c-9412-1cf8f2c95e05 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:12.331750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889c310-5fe1-45a7-82db-3b3dfaa70bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:12.332322 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889c310-5fe1-45a7-82db-3b3dfaa70bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:12.332610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889c310-5fe1-45a7-82db-3b3dfaa70bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:12.332886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889c310-5fe1-45a7-82db-3b3dfaa70bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:12.333738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889c310-5fe1-45a7-82db-3b3dfaa70bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:12.335324 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889c310-5fe1-45a7-82db-3b3dfaa70bf4 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:12.349827 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1269/2556] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:12.351092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a1bc7-d554-4ba0-89b7-7c7f15e68f6a admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:12.361929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a1bc7-d554-4ba0-89b7-7c7f15e68f6a admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:12.369756 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e5309-d34d-4997-96b3-6ca95e9be729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:12.373886 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e5309-d34d-4997-96b3-6ca95e9be729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:12.379335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e5309-d34d-4997-96b3-6ca95e9be729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:12.379751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e5309-d34d-4997-96b3-6ca95e9be729 admin admin] PATH_INFO: `/v3/projects/27d026b1110448feacae5924ce416940/users/b7a5417285f94d1297016886cc866a8a/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:12.404131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e5309-d34d-4997-96b3-6ca95e9be729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d026b1110448feacae5924ce416940, user_id=b7a5417285f94d1297016886cc866a8a, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:12.406109 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e5309-d34d-4997-96b3-6ca95e9be729 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:12.579657 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1288/2557] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:12 2022] PUT /identity/v3/projects/27d026b1110448feacae5924ce416940/users/b7a5417285f94d1297016886cc866a8a/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:12.583599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889c310-5fe1-45a7-82db-3b3dfaa70bf4 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:12.597183 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889c310-5fe1-45a7-82db-3b3dfaa70bf4 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:12.679677 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba37b2-0899-40f0-8ae0-61e6fc2b6732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:12.680929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba37b2-0899-40f0-8ae0-61e6fc2b6732 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:12.681291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba37b2-0899-40f0-8ae0-61e6fc2b6732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:12.681609 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba37b2-0899-40f0-8ae0-61e6fc2b6732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:12.688699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba37b2-0899-40f0-8ae0-61e6fc2b6732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:12.688699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba37b2-0899-40f0-8ae0-61e6fc2b6732 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:12.691366 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:12.700110 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1270/2558] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:36:12.701382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e5309-d34d-4997-96b3-6ca95e9be729 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:12.722212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e5309-d34d-4997-96b3-6ca95e9be729 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:12.722212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481565b7-7b55-47ca-9041-fec1f17a9388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:12.722212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481565b7-7b55-47ca-9041-fec1f17a9388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:12.722212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481565b7-7b55-47ca-9041-fec1f17a9388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:12.722713 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481565b7-7b55-47ca-9041-fec1f17a9388 admin admin] PATH_INFO: `/v3/projects/27d026b1110448feacae5924ce416940/users/b7a5417285f94d1297016886cc866a8a/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:12.724200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481565b7-7b55-47ca-9041-fec1f17a9388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d026b1110448feacae5924ce416940, user_id=b7a5417285f94d1297016886cc866a8a, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:12.727021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481565b7-7b55-47ca-9041-fec1f17a9388 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:12.741163 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1289/2559] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:12 2022] PUT /identity/v3/projects/27d026b1110448feacae5924ce416940/users/b7a5417285f94d1297016886cc866a8a/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:12.750453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b9833-c3b7-49d9-906a-c76c747b7b96 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:12.750911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b9833-c3b7-49d9-906a-c76c747b7b96 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:12.751757 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b9833-c3b7-49d9-906a-c76c747b7b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:12.781041 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-705b9833-c3b7-49d9-906a-c76c747b7b96 None None] MFA Rules not processed for user `b7a5417285f94d1297016886cc866a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:12.782533 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-705b9833-c3b7-49d9-906a-c76c747b7b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:12.861052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1271/2560] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:12.873601 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481565b7-7b55-47ca-9041-fec1f17a9388 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:12.875461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-481565b7-7b55-47ca-9041-fec1f17a9388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:12.939054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481565b7-7b55-47ca-9041-fec1f17a9388 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:12.943028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fd770-8cca-4e3c-9f5f-ab35f356b06f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:12.943785 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fd770-8cca-4e3c-9f5f-ab35f356b06f service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:12.944151 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fd770-8cca-4e3c-9f5f-ab35f356b06f service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:12.944433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fd770-8cca-4e3c-9f5f-ab35f356b06f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:12.955014 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fd770-8cca-4e3c-9f5f-ab35f356b06f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:12.956567 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fd770-8cca-4e3c-9f5f-ab35f356b06f service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:12.969224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1290/2561] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:13.241514 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b9833-c3b7-49d9-906a-c76c747b7b96 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:13.251497 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b9833-c3b7-49d9-906a-c76c747b7b96 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:13.255309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2753b5-8529-4736-a1a0-b66569099996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:13.255960 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2753b5-8529-4736-a1a0-b66569099996 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:13.256329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2753b5-8529-4736-a1a0-b66569099996 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:13.256605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2753b5-8529-4736-a1a0-b66569099996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:13.314111 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2753b5-8529-4736-a1a0-b66569099996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:13.315688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2753b5-8529-4736-a1a0-b66569099996 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:13.325274 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1272/2562] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:15.753159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fd770-8cca-4e3c-9f5f-ab35f356b06f service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:15.753159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-048fd770-8cca-4e3c-9f5f-ab35f356b06f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:15.757382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:15.817615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fd770-8cca-4e3c-9f5f-ab35f356b06f service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:15.822698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:15.823570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:15.823858 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:15.824133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] PATH_INFO: `/v3/users/09b67ac7b8d04e298b503f68e2e02a2c` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:15.825365 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b67ac7b8d04e298b503f68e2e02a2c)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:15.827287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:16.015218 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b67ac7b8d04e298b503f68e2e02a2c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:16.092088 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b67ac7b8d04e298b503f68e2e02a2c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:16.093222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b67ac7b8d04e298b503f68e2e02a2c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:16.108015 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b67ac7b8d04e298b503f68e2e02a2c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:16.114946 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b67ac7b8d04e298b503f68e2e02a2c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:16.121706 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1291/2563] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:15 2022] DELETE /identity/v3/users/09b67ac7b8d04e298b503f68e2e02a2c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:16.126222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b64a-25dd-4778-b34c-a00912bc9b67 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:16.126710 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b64a-25dd-4778-b34c-a00912bc9b67 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:16.126810 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b64a-25dd-4778-b34c-a00912bc9b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:16.143848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-1ae1b64a-25dd-4778-b34c-a00912bc9b67 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:16.145080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1ae1b64a-25dd-4778-b34c-a00912bc9b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:16.207265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1273/2564] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:16.217309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:16.218720 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:16.277422 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935292d-7039-41d7-b0ef-aa3c909eda15 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:16.280936 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365d207-1b26-4894-a3f6-f1042701d872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:16.281632 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365d207-1b26-4894-a3f6-f1042701d872 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:16.281913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365d207-1b26-4894-a3f6-f1042701d872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:16.282236 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365d207-1b26-4894-a3f6-f1042701d872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:16.292176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365d207-1b26-4894-a3f6-f1042701d872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:16.295187 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365d207-1b26-4894-a3f6-f1042701d872 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:16.303757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1292/2565] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:16.702411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b64a-25dd-4778-b34c-a00912bc9b67 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:16.703950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1ae1b64a-25dd-4778-b34c-a00912bc9b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:16.720897 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b64a-25dd-4778-b34c-a00912bc9b67 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:16.726275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c98c6c-9f85-4cc4-ad06-71f90e65db37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:16.727206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c98c6c-9f85-4cc4-ad06-71f90e65db37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:16.727569 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c98c6c-9f85-4cc4-ad06-71f90e65db37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:16.727909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c98c6c-9f85-4cc4-ad06-71f90e65db37 admin admin] PATH_INFO: `/v3/projects/bfccc9b52cb24cd3972a92c143a4baeb` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:16.730768 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c98c6c-9f85-4cc4-ad06-71f90e65db37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfccc9b52cb24cd3972a92c143a4baeb)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:16.740007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c98c6c-9f85-4cc4-ad06-71f90e65db37 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:16.756092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:16.875903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-56c98c6c-9f85-4cc4-ad06-71f90e65db37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfccc9b52cb24cd3972a92c143a4baeb', 'request_id': 'req-56c98c6c-9f85-4cc4-ad06-71f90e65db37'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:16.949408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-56c98c6c-9f85-4cc4-ad06-71f90e65db37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfccc9b52cb24cd3972a92c143a4baeb', 'request_id': 'req-56c98c6c-9f85-4cc4-ad06-71f90e65db37'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:16.961871 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-56c98c6c-9f85-4cc4-ad06-71f90e65db37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfccc9b52cb24cd3972a92c143a4baeb', 'request_id': 'req-56c98c6c-9f85-4cc4-ad06-71f90e65db37'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:16.975732 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-56c98c6c-9f85-4cc4-ad06-71f90e65db37 admin admin] The token cache is being invalidate because project bfccc9b52cb24cd3972a92c143a4baeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:16.976030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-56c98c6c-9f85-4cc4-ad06-71f90e65db37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:16.976779 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-56c98c6c-9f85-4cc4-ad06-71f90e65db37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:16.978836 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1274/2566] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:16 2022] DELETE /identity/v3/projects/bfccc9b52cb24cd3972a92c143a4baeb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:16.983727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f317d-cf54-4e79-bcbc-92871e8faaa7 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:16.990873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f317d-cf54-4e79-bcbc-92871e8faaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:16.990873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f317d-cf54-4e79-bcbc-92871e8faaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:17.002929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-4a9f317d-cf54-4e79-bcbc-92871e8faaa7 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:17.004128 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4a9f317d-cf54-4e79-bcbc-92871e8faaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:17.025912 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:17.067381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1293/2567] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:17.075092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5afa6-6ad5-4013-a4fb-2941870882d5 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:17.075383 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5afa6-6ad5-4013-a4fb-2941870882d5 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:17.075662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5afa6-6ad5-4013-a4fb-2941870882d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:17.094507 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-66e5afa6-6ad5-4013-a4fb-2941870882d5 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:17.095707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-66e5afa6-6ad5-4013-a4fb-2941870882d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:17.104158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1275/2568] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:17.108430 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f317d-cf54-4e79-bcbc-92871e8faaa7 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:17.118578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f317d-cf54-4e79-bcbc-92871e8faaa7 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:17.123485 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb3df5-ba86-4699-b4de-df5c18530127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:17.124152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb3df5-ba86-4699-b4de-df5c18530127 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:17.124430 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb3df5-ba86-4699-b4de-df5c18530127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:17.124700 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb3df5-ba86-4699-b4de-df5c18530127 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:17.125458 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb3df5-ba86-4699-b4de-df5c18530127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:36:17.125769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb3df5-ba86-4699-b4de-df5c18530127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:17.127365 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb3df5-ba86-4699-b4de-df5c18530127 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:17.139654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1294/2569] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:36:17.144003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5afa6-6ad5-4013-a4fb-2941870882d5 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:17.153870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5afa6-6ad5-4013-a4fb-2941870882d5 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:17.158892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19726-901d-42c4-b437-cefe22033133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:17.159228 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19726-901d-42c4-b437-cefe22033133 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:17.159455 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19726-901d-42c4-b437-cefe22033133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:17.159731 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19726-901d-42c4-b437-cefe22033133 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:17.160428 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd19726-901d-42c4-b437-cefe22033133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:17.162362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd19726-901d-42c4-b437-cefe22033133 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:17.261108 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1276/2570] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:17 2022] POST /identity/v3/projects => generated 357 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:17.265594 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb3df5-ba86-4699-b4de-df5c18530127 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:17.278589 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb3df5-ba86-4699-b4de-df5c18530127 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:17.341759 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de7fce-8bb8-45a3-9d50-d5d6e0514f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:17.344928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de7fce-8bb8-45a3-9d50-d5d6e0514f5c admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:17.344928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de7fce-8bb8-45a3-9d50-d5d6e0514f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:17.344928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de7fce-8bb8-45a3-9d50-d5d6e0514f5c admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:17.344928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de7fce-8bb8-45a3-9d50-d5d6e0514f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:17.345734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de7fce-8bb8-45a3-9d50-d5d6e0514f5c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:17.434834 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1295/2571] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:17 2022] POST /identity/v3/users => generated 279 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:17.438848 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19726-901d-42c4-b437-cefe22033133 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:17.452832 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19726-901d-42c4-b437-cefe22033133 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:17.468393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6ee72-0af9-4752-a2c7-95e05a19f8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:17.468393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ee72-0af9-4752-a2c7-95e05a19f8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:17.468393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ee72-0af9-4752-a2c7-95e05a19f8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:17.468393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ee72-0af9-4752-a2c7-95e05a19f8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:17.469393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6ee72-0af9-4752-a2c7-95e05a19f8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:17.469393 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6ee72-0af9-4752-a2c7-95e05a19f8f1 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:17.478594 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1277/2572] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:17.482654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de7fce-8bb8-45a3-9d50-d5d6e0514f5c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:17.492659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de7fce-8bb8-45a3-9d50-d5d6e0514f5c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:17.497948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45999230-09a4-4ed1-a108-47f651c927ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:17.498614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45999230-09a4-4ed1-a108-47f651c927ec admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:17.498901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45999230-09a4-4ed1-a108-47f651c927ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:17.499183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45999230-09a4-4ed1-a108-47f651c927ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:17.499910 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45999230-09a4-4ed1-a108-47f651c927ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:17.501562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45999230-09a4-4ed1-a108-47f651c927ec admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:17.512055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1296/2573] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:17.516079 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6ee72-0af9-4752-a2c7-95e05a19f8f1 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:17.526106 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6ee72-0af9-4752-a2c7-95e05a19f8f1 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:17.530786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181a4a6-eb3b-4a67-bf73-53f2ed576262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:17.531671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181a4a6-eb3b-4a67-bf73-53f2ed576262 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:17.531956 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181a4a6-eb3b-4a67-bf73-53f2ed576262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:17.532232 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181a4a6-eb3b-4a67-bf73-53f2ed576262 admin admin] PATH_INFO: `/v3/projects/67e28aa6c2d7486f911504d42097cb8a/users/c969efa19b0d4353a7bec21e6f9d8b38/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:17.547131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181a4a6-eb3b-4a67-bf73-53f2ed576262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e28aa6c2d7486f911504d42097cb8a, user_id=c969efa19b0d4353a7bec21e6f9d8b38, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:17.549877 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181a4a6-eb3b-4a67-bf73-53f2ed576262 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:17.673858 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1278/2574] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:17 2022] PUT /identity/v3/projects/67e28aa6c2d7486f911504d42097cb8a/users/c969efa19b0d4353a7bec21e6f9d8b38/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:17.684494 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e752180-38fd-4a64-a968-b5f43fa0a203 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:17.684936 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e752180-38fd-4a64-a968-b5f43fa0a203 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:17.685307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e752180-38fd-4a64-a968-b5f43fa0a203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:17.713931 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-2e752180-38fd-4a64-a968-b5f43fa0a203 None None] MFA Rules not processed for user `c969efa19b0d4353a7bec21e6f9d8b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:17.715175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-2e752180-38fd-4a64-a968-b5f43fa0a203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:17.786640 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1297/2575] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:17 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:17.791340 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181a4a6-eb3b-4a67-bf73-53f2ed576262 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:17.856928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181a4a6-eb3b-4a67-bf73-53f2ed576262 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:17.862011 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d7c3-ecf9-4e9f-8da6-efd8898eff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:17.862687 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d7c3-ecf9-4e9f-8da6-efd8898eff32 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:17.862971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d7c3-ecf9-4e9f-8da6-efd8898eff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:17.863401 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d7c3-ecf9-4e9f-8da6-efd8898eff32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:17.863972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783d7c3-ecf9-4e9f-8da6-efd8898eff32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:17.866001 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783d7c3-ecf9-4e9f-8da6-efd8898eff32 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:17.979327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1279/2576] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:17 2022] POST /identity/v3/projects => generated 357 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:17.985325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e752180-38fd-4a64-a968-b5f43fa0a203 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:17.996287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e752180-38fd-4a64-a968-b5f43fa0a203 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:18.013085 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:18.051292 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e1d68-4239-4f78-90bb-9b1ff06ccd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:18.051956 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e1d68-4239-4f78-90bb-9b1ff06ccd3e admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:18.052244 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e1d68-4239-4f78-90bb-9b1ff06ccd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:18.052537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e1d68-4239-4f78-90bb-9b1ff06ccd3e admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:18.053327 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e1d68-4239-4f78-90bb-9b1ff06ccd3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:18.055242 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e1d68-4239-4f78-90bb-9b1ff06ccd3e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:18.143425 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1298/2577] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:17 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:18.147525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d7c3-ecf9-4e9f-8da6-efd8898eff32 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:18.158065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d7c3-ecf9-4e9f-8da6-efd8898eff32 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:18.162816 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f52113-480e-4a8e-b2fc-a49fab9999a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:18.163533 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f52113-480e-4a8e-b2fc-a49fab9999a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:18.165588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f52113-480e-4a8e-b2fc-a49fab9999a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:18.165588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f52113-480e-4a8e-b2fc-a49fab9999a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:18.165588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f52113-480e-4a8e-b2fc-a49fab9999a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:18.166752 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f52113-480e-4a8e-b2fc-a49fab9999a2 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:18.177552 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1280/2578] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:18.181578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e1d68-4239-4f78-90bb-9b1ff06ccd3e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:18.191885 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e1d68-4239-4f78-90bb-9b1ff06ccd3e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:18.196485 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6d1a7-737b-44ed-9c93-e1ec2d5d8d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:18.199838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d1a7-737b-44ed-9c93-e1ec2d5d8d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:18.199838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d1a7-737b-44ed-9c93-e1ec2d5d8d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:18.199838 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d1a7-737b-44ed-9c93-e1ec2d5d8d66 admin admin] PATH_INFO: `/v3/projects/b3efcc206a294f57b8a44b09e72100f3/users/3424bddb690847dcade0ea1068b2785a/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:18.214485 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6d1a7-737b-44ed-9c93-e1ec2d5d8d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3efcc206a294f57b8a44b09e72100f3, user_id=3424bddb690847dcade0ea1068b2785a, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:18.217038 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6d1a7-737b-44ed-9c93-e1ec2d5d8d66 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:18.281045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1299/2579] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:18 2022] PUT /identity/v3/projects/b3efcc206a294f57b8a44b09e72100f3/users/3424bddb690847dcade0ea1068b2785a/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:18.285068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f52113-480e-4a8e-b2fc-a49fab9999a2 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:18.295903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f52113-480e-4a8e-b2fc-a49fab9999a2 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:18.308932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:18.352595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e5fbb-0346-4714-b1ee-24e3fa203f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:18.353293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e5fbb-0346-4714-b1ee-24e3fa203f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:18.353583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e5fbb-0346-4714-b1ee-24e3fa203f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:18.353863 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e5fbb-0346-4714-b1ee-24e3fa203f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:18.355091 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e5fbb-0346-4714-b1ee-24e3fa203f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:18.356686 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e5fbb-0346-4714-b1ee-24e3fa203f97 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:18.366888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1281/2580] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:18.372160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6d1a7-737b-44ed-9c93-e1ec2d5d8d66 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:18.382422 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6d1a7-737b-44ed-9c93-e1ec2d5d8d66 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:18.387127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ed00c-8392-4968-875d-d8b0e6781805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:18.388010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed00c-8392-4968-875d-d8b0e6781805 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:18.388294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed00c-8392-4968-875d-d8b0e6781805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:18.388571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed00c-8392-4968-875d-d8b0e6781805 admin admin] PATH_INFO: `/v3/projects/b3efcc206a294f57b8a44b09e72100f3/users/3424bddb690847dcade0ea1068b2785a/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:18.390585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ed00c-8392-4968-875d-d8b0e6781805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3efcc206a294f57b8a44b09e72100f3, user_id=3424bddb690847dcade0ea1068b2785a, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:18.393259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ed00c-8392-4968-875d-d8b0e6781805 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:18.403510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1300/2581] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:18 2022] PUT /identity/v3/projects/b3efcc206a294f57b8a44b09e72100f3/users/3424bddb690847dcade0ea1068b2785a/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:18.413922 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775603c-6d8d-4654-a9f0-644727336ecd None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:18.414241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775603c-6d8d-4654-a9f0-644727336ecd None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:18.414526 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775603c-6d8d-4654-a9f0-644727336ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:18.443688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-b775603c-6d8d-4654-a9f0-644727336ecd None None] MFA Rules not processed for user `3424bddb690847dcade0ea1068b2785a`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:18.445007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b775603c-6d8d-4654-a9f0-644727336ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:18.515431 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1282/2582] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:18 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:18.528795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ed00c-8392-4968-875d-d8b0e6781805 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:18.530949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c73ed00c-8392-4968-875d-d8b0e6781805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:18.597939 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ed00c-8392-4968-875d-d8b0e6781805 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:18.601672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab844ea3-c139-4274-9784-425bf31564ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:18.602329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844ea3-c139-4274-9784-425bf31564ec service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:18.602677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844ea3-c139-4274-9784-425bf31564ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:18.602891 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844ea3-c139-4274-9784-425bf31564ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:18.612563 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab844ea3-c139-4274-9784-425bf31564ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:18.614021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab844ea3-c139-4274-9784-425bf31564ec service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:18.624247 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1301/2583] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:18 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:18.825483 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775603c-6d8d-4654-a9f0-644727336ecd None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:18.835263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775603c-6d8d-4654-a9f0-644727336ecd None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:18.839419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c292f-c996-4d27-b205-f4d630c24c2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:18.840055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c292f-c996-4d27-b205-f4d630c24c2f service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:18.840339 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c292f-c996-4d27-b205-f4d630c24c2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:18.840674 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c292f-c996-4d27-b205-f4d630c24c2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:18.897546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c292f-c996-4d27-b205-f4d630c24c2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:18.898987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c292f-c996-4d27-b205-f4d630c24c2f service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:18.908606 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1283/2584] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:18 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:22.325243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab844ea3-c139-4274-9784-425bf31564ec service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:22.326959 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ab844ea3-c139-4274-9784-425bf31564ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:22.394396 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab844ea3-c139-4274-9784-425bf31564ec service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:22.399668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:22.400529 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:22.400820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:22.401100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] PATH_INFO: `/v3/users/e31b1fd79c7141c1afdfcbabfffeb04e` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:22.402866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31b1fd79c7141c1afdfcbabfffeb04e)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:22.404843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:22.423264 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:22.660551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31b1fd79c7141c1afdfcbabfffeb04e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:22.737584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31b1fd79c7141c1afdfcbabfffeb04e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:22.738743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31b1fd79c7141c1afdfcbabfffeb04e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:22.754378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31b1fd79c7141c1afdfcbabfffeb04e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:22.762429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31b1fd79c7141c1afdfcbabfffeb04e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:22.769149 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1302/2585] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:22 2022] DELETE /identity/v3/users/e31b1fd79c7141c1afdfcbabfffeb04e => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:22.773472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c981cd-93a8-49fe-9882-4f9832ed4192 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:22.773971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c981cd-93a8-49fe-9882-4f9832ed4192 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:22.774189 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c981cd-93a8-49fe-9882-4f9832ed4192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:22.793521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e7c981cd-93a8-49fe-9882-4f9832ed4192 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:22.794767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e7c981cd-93a8-49fe-9882-4f9832ed4192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:22.828057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:22.853709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1284/2586] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:22.863373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:22.864827 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:22.922061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07162590-bbee-47cc-8eee-678fe7946a88 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:22.925641 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cddef4-3e53-427e-a18a-51cfddd41167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:22.926286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cddef4-3e53-427e-a18a-51cfddd41167 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:22.926574 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cddef4-3e53-427e-a18a-51cfddd41167 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:22.926850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cddef4-3e53-427e-a18a-51cfddd41167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:22.935783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cddef4-3e53-427e-a18a-51cfddd41167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:22.937248 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cddef4-3e53-427e-a18a-51cfddd41167 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:22.946646 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1303/2587] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:23.384738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c981cd-93a8-49fe-9882-4f9832ed4192 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:23.386983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e7c981cd-93a8-49fe-9882-4f9832ed4192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:23.399991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c981cd-93a8-49fe-9882-4f9832ed4192 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:23.404662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:23.405570 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:23.406322 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:23.406322 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] PATH_INFO: `/v3/projects/17f782ceacea42c9a5ee8865395188c5` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:23.407492 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f782ceacea42c9a5ee8865395188c5)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:23.409479 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:23.527378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f782ceacea42c9a5ee8865395188c5', 'request_id': 'req-f496abb4-0263-48ac-b74f-8729855dc452'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:23.592480 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f782ceacea42c9a5ee8865395188c5', 'request_id': 'req-f496abb4-0263-48ac-b74f-8729855dc452'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:23.598993 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f782ceacea42c9a5ee8865395188c5', 'request_id': 'req-f496abb4-0263-48ac-b74f-8729855dc452'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:23.609955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] The token cache is being invalidate because project 17f782ceacea42c9a5ee8865395188c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:23.610244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:23.610866 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:23.612439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1285/2588] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:23 2022] DELETE /identity/v3/projects/17f782ceacea42c9a5ee8865395188c5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:23.616395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cddef4-3e53-427e-a18a-51cfddd41167 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:23.626626 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cddef4-3e53-427e-a18a-51cfddd41167 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:23.681065 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2804eb-8a03-4cbb-9d30-fe05671eafb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:23.681898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2804eb-8a03-4cbb-9d30-fe05671eafb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:23.682188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2804eb-8a03-4cbb-9d30-fe05671eafb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:23.682463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2804eb-8a03-4cbb-9d30-fe05671eafb5 admin admin] PATH_INFO: `/v3/users/b7a5417285f94d1297016886cc866a8a` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:23.684287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2804eb-8a03-4cbb-9d30-fe05671eafb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a5417285f94d1297016886cc866a8a)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:23.686318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2804eb-8a03-4cbb-9d30-fe05671eafb5 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:23.838395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:23.847052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5a2804eb-8a03-4cbb-9d30-fe05671eafb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a5417285f94d1297016886cc866a8a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:23.919055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5a2804eb-8a03-4cbb-9d30-fe05671eafb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a5417285f94d1297016886cc866a8a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:23.919708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5a2804eb-8a03-4cbb-9d30-fe05671eafb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a5417285f94d1297016886cc866a8a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:23.932513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5a2804eb-8a03-4cbb-9d30-fe05671eafb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a5417285f94d1297016886cc866a8a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:23.939519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5a2804eb-8a03-4cbb-9d30-fe05671eafb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a5417285f94d1297016886cc866a8a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:23.945789 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1304/2589] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:23 2022] DELETE /identity/v3/users/b7a5417285f94d1297016886cc866a8a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:24.444780 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:24.444780 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:24.456416 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496abb4-0263-48ac-b74f-8729855dc452 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:24.521080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baead4-0d7c-4352-8c31-bf5179fbfbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:24.522071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baead4-0d7c-4352-8c31-bf5179fbfbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:24.522429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baead4-0d7c-4352-8c31-bf5179fbfbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:24.522819 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baead4-0d7c-4352-8c31-bf5179fbfbda admin admin] PATH_INFO: `/v3/projects/27d026b1110448feacae5924ce416940` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:24.524309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baead4-0d7c-4352-8c31-bf5179fbfbda admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d026b1110448feacae5924ce416940)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:24.526344 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baead4-0d7c-4352-8c31-bf5179fbfbda admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:24.663883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-38baead4-0d7c-4352-8c31-bf5179fbfbda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d026b1110448feacae5924ce416940', 'request_id': 'req-38baead4-0d7c-4352-8c31-bf5179fbfbda'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:24.752553 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-38baead4-0d7c-4352-8c31-bf5179fbfbda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d026b1110448feacae5924ce416940', 'request_id': 'req-38baead4-0d7c-4352-8c31-bf5179fbfbda'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:24.758986 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-38baead4-0d7c-4352-8c31-bf5179fbfbda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d026b1110448feacae5924ce416940', 'request_id': 'req-38baead4-0d7c-4352-8c31-bf5179fbfbda'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:24.760955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:24.770098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-38baead4-0d7c-4352-8c31-bf5179fbfbda admin admin] The token cache is being invalidate because project 27d026b1110448feacae5924ce416940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:24.770382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-38baead4-0d7c-4352-8c31-bf5179fbfbda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:24.771063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-38baead4-0d7c-4352-8c31-bf5179fbfbda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:24.772630 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1286/2590] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:24 2022] DELETE /identity/v3/projects/27d026b1110448feacae5924ce416940 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:24.777711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e38457-6ff1-4c87-863d-0e70a94566bf None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:24.778214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e38457-6ff1-4c87-863d-0e70a94566bf None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:24.778328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e38457-6ff1-4c87-863d-0e70a94566bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:24.796616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-31e38457-6ff1-4c87-863d-0e70a94566bf None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:24.797860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-31e38457-6ff1-4c87-863d-0e70a94566bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:24.856980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1305/2591] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:24.865035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e267728-6e82-43f7-8fb6-ef6db97b0a33 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:24.865362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e267728-6e82-43f7-8fb6-ef6db97b0a33 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:24.865681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e267728-6e82-43f7-8fb6-ef6db97b0a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:24.884668 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-3e267728-6e82-43f7-8fb6-ef6db97b0a33 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:24.885896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3e267728-6e82-43f7-8fb6-ef6db97b0a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:24.894932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1287/2592] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:24.899318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e38457-6ff1-4c87-863d-0e70a94566bf None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:24.909176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e38457-6ff1-4c87-863d-0e70a94566bf None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:24.913933 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913d5bf-de28-466f-b50b-5fdda6cee9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:24.914587 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913d5bf-de28-466f-b50b-5fdda6cee9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:24.915132 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913d5bf-de28-466f-b50b-5fdda6cee9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:24.915411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913d5bf-de28-466f-b50b-5fdda6cee9bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:24.916167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913d5bf-de28-466f-b50b-5fdda6cee9bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:36:24.916477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913d5bf-de28-466f-b50b-5fdda6cee9bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:24.918182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913d5bf-de28-466f-b50b-5fdda6cee9bd admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:24.929804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1306/2593] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:36:24.940410 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e267728-6e82-43f7-8fb6-ef6db97b0a33 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:24.950344 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e267728-6e82-43f7-8fb6-ef6db97b0a33 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:24.955229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a1d2b-90b4-45a9-8b4e-d0771f46c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:24.955878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a1d2b-90b4-45a9-8b4e-d0771f46c5ed admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:24.956165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a1d2b-90b4-45a9-8b4e-d0771f46c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:24.956451 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a1d2b-90b4-45a9-8b4e-d0771f46c5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:24.957171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a1d2b-90b4-45a9-8b4e-d0771f46c5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:24.959137 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a1d2b-90b4-45a9-8b4e-d0771f46c5ed admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:25.063843 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1288/2594] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:24 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:25.084304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913d5bf-de28-466f-b50b-5fdda6cee9bd admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:25.094673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913d5bf-de28-466f-b50b-5fdda6cee9bd admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:25.151438 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940cb82-c602-4bba-956f-69bbff704f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:25.152109 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940cb82-c602-4bba-956f-69bbff704f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:25.152393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940cb82-c602-4bba-956f-69bbff704f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:25.152671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940cb82-c602-4bba-956f-69bbff704f78 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:25.153401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940cb82-c602-4bba-956f-69bbff704f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:25.155346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940cb82-c602-4bba-956f-69bbff704f78 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:25.272677 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1307/2595] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:25 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:36:25.276929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a1d2b-90b4-45a9-8b4e-d0771f46c5ed admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:25.288676 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a1d2b-90b4-45a9-8b4e-d0771f46c5ed admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:25.294032 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec12615-7bec-46d3-a9a0-5f26e20c0931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:25.294683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec12615-7bec-46d3-a9a0-5f26e20c0931 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:25.294965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec12615-7bec-46d3-a9a0-5f26e20c0931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:25.295319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec12615-7bec-46d3-a9a0-5f26e20c0931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:25.296042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec12615-7bec-46d3-a9a0-5f26e20c0931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:25.297660 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec12615-7bec-46d3-a9a0-5f26e20c0931 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:25.308921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1289/2596] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:25.313013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940cb82-c602-4bba-956f-69bbff704f78 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:25.323484 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940cb82-c602-4bba-956f-69bbff704f78 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:25.329099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb07dc7-90ab-4d23-ac04-32b26cd2d004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:25.329783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb07dc7-90ab-4d23-ac04-32b26cd2d004 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:25.330067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb07dc7-90ab-4d23-ac04-32b26cd2d004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:25.330344 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb07dc7-90ab-4d23-ac04-32b26cd2d004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:25.331076 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb07dc7-90ab-4d23-ac04-32b26cd2d004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:25.332676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb07dc7-90ab-4d23-ac04-32b26cd2d004 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:25.342983 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1308/2597] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:25.347177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec12615-7bec-46d3-a9a0-5f26e20c0931 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:25.358468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec12615-7bec-46d3-a9a0-5f26e20c0931 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:25.363136 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca8160-19ef-4996-b06e-a7798d92a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:25.364047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8160-19ef-4996-b06e-a7798d92a985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:25.364333 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8160-19ef-4996-b06e-a7798d92a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:25.364614 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8160-19ef-4996-b06e-a7798d92a985 admin admin] PATH_INFO: `/v3/projects/d92ea90387044716a8186b1f67a80867/users/ae6391cf081e4518885057695047db59/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:25.379909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca8160-19ef-4996-b06e-a7798d92a985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92ea90387044716a8186b1f67a80867, user_id=ae6391cf081e4518885057695047db59, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:25.385422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca8160-19ef-4996-b06e-a7798d92a985 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:25.496283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1290/2598] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:25 2022] PUT /identity/v3/projects/d92ea90387044716a8186b1f67a80867/users/ae6391cf081e4518885057695047db59/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:25.507727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d94f5b-c0ac-40a4-a9f7-f0e9cc8d859d None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:25.508021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d94f5b-c0ac-40a4-a9f7-f0e9cc8d859d None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:25.508308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d94f5b-c0ac-40a4-a9f7-f0e9cc8d859d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:25.535084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-69d94f5b-c0ac-40a4-a9f7-f0e9cc8d859d None None] MFA Rules not processed for user `ae6391cf081e4518885057695047db59`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:25.536283 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-69d94f5b-c0ac-40a4-a9f7-f0e9cc8d859d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:25.545912 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:25.605258 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1309/2599] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:25.616121 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca8160-19ef-4996-b06e-a7798d92a985 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:25.620945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d9ca8160-19ef-4996-b06e-a7798d92a985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:25.674682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca8160-19ef-4996-b06e-a7798d92a985 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:25.678394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43b065-f359-4b26-8e4e-ce952f7eca67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:25.679039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43b065-f359-4b26-8e4e-ce952f7eca67 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:25.679328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43b065-f359-4b26-8e4e-ce952f7eca67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:25.679606 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43b065-f359-4b26-8e4e-ce952f7eca67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:25.688499 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43b065-f359-4b26-8e4e-ce952f7eca67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:25.689961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43b065-f359-4b26-8e4e-ce952f7eca67 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:25.699264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1291/2600] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:32.536450 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d94f5b-c0ac-40a4-a9f7-f0e9cc8d859d None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:32.599491 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d94f5b-c0ac-40a4-a9f7-f0e9cc8d859d None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:32.604138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:32.605037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:32.605382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:32.605661 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] PATH_INFO: `/v3/users/ae6391cf081e4518885057695047db59` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:32.607360 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae6391cf081e4518885057695047db59)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:32.609304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:32.784813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae6391cf081e4518885057695047db59'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:32.845836 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae6391cf081e4518885057695047db59'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:32.846463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae6391cf081e4518885057695047db59'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:32.858981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae6391cf081e4518885057695047db59'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:32.865944 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae6391cf081e4518885057695047db59'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:32.872519 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1310/2601] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:32 2022] DELETE /identity/v3/users/ae6391cf081e4518885057695047db59 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:32.876996 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972525c8-ecbd-4c20-a50e-cf499f1274c8 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:32.877545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972525c8-ecbd-4c20-a50e-cf499f1274c8 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:32.877643 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972525c8-ecbd-4c20-a50e-cf499f1274c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:32.894030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-972525c8-ecbd-4c20-a50e-cf499f1274c8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:32.895229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-972525c8-ecbd-4c20-a50e-cf499f1274c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:32.953341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1292/2602] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:32.962862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:32.964271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:32.999152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:33.021402 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47ad3c-513f-4ae3-94b5-8a3a7f5d5dae admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:33.025021 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea945c-bb59-43fc-8328-afb25400c18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:33.025699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea945c-bb59-43fc-8328-afb25400c18c service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:33.025987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea945c-bb59-43fc-8328-afb25400c18c service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:33.026268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea945c-bb59-43fc-8328-afb25400c18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:33.037510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea945c-bb59-43fc-8328-afb25400c18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:33.037810 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea945c-bb59-43fc-8328-afb25400c18c service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:33.048179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1311/2603] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:33.464760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972525c8-ecbd-4c20-a50e-cf499f1274c8 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:33.467489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-972525c8-ecbd-4c20-a50e-cf499f1274c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:33.481282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972525c8-ecbd-4c20-a50e-cf499f1274c8 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:33.486114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67150b-4dd7-4f5e-8322-6a5164882a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:33.487217 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67150b-4dd7-4f5e-8322-6a5164882a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:33.487495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67150b-4dd7-4f5e-8322-6a5164882a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:33.487834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67150b-4dd7-4f5e-8322-6a5164882a22 admin admin] PATH_INFO: `/v3/projects/d92ea90387044716a8186b1f67a80867` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:33.489047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67150b-4dd7-4f5e-8322-6a5164882a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92ea90387044716a8186b1f67a80867)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:33.491049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67150b-4dd7-4f5e-8322-6a5164882a22 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:33.613338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:33.629615 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dd67150b-4dd7-4f5e-8322-6a5164882a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92ea90387044716a8186b1f67a80867', 'request_id': 'req-dd67150b-4dd7-4f5e-8322-6a5164882a22'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:33.734996 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dd67150b-4dd7-4f5e-8322-6a5164882a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92ea90387044716a8186b1f67a80867', 'request_id': 'req-dd67150b-4dd7-4f5e-8322-6a5164882a22'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:33.741699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dd67150b-4dd7-4f5e-8322-6a5164882a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92ea90387044716a8186b1f67a80867', 'request_id': 'req-dd67150b-4dd7-4f5e-8322-6a5164882a22'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:33.752376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dd67150b-4dd7-4f5e-8322-6a5164882a22 admin admin] The token cache is being invalidate because project d92ea90387044716a8186b1f67a80867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:33.752645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dd67150b-4dd7-4f5e-8322-6a5164882a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:33.753308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-dd67150b-4dd7-4f5e-8322-6a5164882a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:33.754846 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1293/2604] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:33 2022] DELETE /identity/v3/projects/d92ea90387044716a8186b1f67a80867 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:33.759964 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e7d2f-4d2f-4d4b-9f93-a81c5d66841c None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:33.760413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e7d2f-4d2f-4d4b-9f93-a81c5d66841c None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:33.760575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e7d2f-4d2f-4d4b-9f93-a81c5d66841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:33.778978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-496e7d2f-4d2f-4d4b-9f93-a81c5d66841c None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:33.780249 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-496e7d2f-4d2f-4d4b-9f93-a81c5d66841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:33.838941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1312/2605] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:33.846919 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78738202-d373-4b50-8110-ba656ead5d65 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:33.847213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78738202-d373-4b50-8110-ba656ead5d65 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:33.847494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78738202-d373-4b50-8110-ba656ead5d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:33.866755 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-78738202-d373-4b50-8110-ba656ead5d65 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:33.867900 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-78738202-d373-4b50-8110-ba656ead5d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:33.876378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1294/2606] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:33.880493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e7d2f-4d2f-4d4b-9f93-a81c5d66841c None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:33.890819 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e7d2f-4d2f-4d4b-9f93-a81c5d66841c None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:33.895480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6484f58-4b5d-4be8-b8c4-4b95eb9ac6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:33.896167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6484f58-4b5d-4be8-b8c4-4b95eb9ac6fa admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:33.896468 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6484f58-4b5d-4be8-b8c4-4b95eb9ac6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:33.896750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6484f58-4b5d-4be8-b8c4-4b95eb9ac6fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:33.897548 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6484f58-4b5d-4be8-b8c4-4b95eb9ac6fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:36:33.897859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6484f58-4b5d-4be8-b8c4-4b95eb9ac6fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:33.899450 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6484f58-4b5d-4be8-b8c4-4b95eb9ac6fa admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:33.911006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1313/2607] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:36:33.915544 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78738202-d373-4b50-8110-ba656ead5d65 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:33.924994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78738202-d373-4b50-8110-ba656ead5d65 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:33.929663 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e63eb-ad20-493a-b506-dae4069fbd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:33.930338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e63eb-ad20-493a-b506-dae4069fbd32 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:33.930628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e63eb-ad20-493a-b506-dae4069fbd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:33.930908 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e63eb-ad20-493a-b506-dae4069fbd32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:33.931606 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e63eb-ad20-493a-b506-dae4069fbd32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:33.933538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e63eb-ad20-493a-b506-dae4069fbd32 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:34.024643 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1295/2608] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:33 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:34.031403 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6484f58-4b5d-4be8-b8c4-4b95eb9ac6fa admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:34.041547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6484f58-4b5d-4be8-b8c4-4b95eb9ac6fa admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:34.096664 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f98d-d0bb-4e0f-8613-de4d91aa252b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:34.097365 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f98d-d0bb-4e0f-8613-de4d91aa252b admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:34.097655 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f98d-d0bb-4e0f-8613-de4d91aa252b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:34.097935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f98d-d0bb-4e0f-8613-de4d91aa252b admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:34.098635 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3f98d-d0bb-4e0f-8613-de4d91aa252b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:34.100548 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3f98d-d0bb-4e0f-8613-de4d91aa252b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:34.166511 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1314/2609] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:34 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:36:34.170577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e63eb-ad20-493a-b506-dae4069fbd32 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:34.181320 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e63eb-ad20-493a-b506-dae4069fbd32 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:34.185952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389143a5-7889-4ff5-8966-0b3dfe05028f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:34.186621 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389143a5-7889-4ff5-8966-0b3dfe05028f admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:34.186872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389143a5-7889-4ff5-8966-0b3dfe05028f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:34.187144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389143a5-7889-4ff5-8966-0b3dfe05028f admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:34.187933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389143a5-7889-4ff5-8966-0b3dfe05028f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:34.189540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389143a5-7889-4ff5-8966-0b3dfe05028f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:34.200522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1296/2610] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:34.204506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f98d-d0bb-4e0f-8613-de4d91aa252b admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:34.214774 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f98d-d0bb-4e0f-8613-de4d91aa252b admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:34.220023 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870bc5c-b195-4c51-979a-7462bce9df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:34.220678 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870bc5c-b195-4c51-979a-7462bce9df04 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:34.220964 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870bc5c-b195-4c51-979a-7462bce9df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:34.221275 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870bc5c-b195-4c51-979a-7462bce9df04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:34.222092 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870bc5c-b195-4c51-979a-7462bce9df04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:34.223695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870bc5c-b195-4c51-979a-7462bce9df04 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:34.233696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1315/2611] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:34.237770 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389143a5-7889-4ff5-8966-0b3dfe05028f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:34.247673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389143a5-7889-4ff5-8966-0b3dfe05028f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:34.252382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886d006-b199-4bda-b0ce-fcbf9321016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:34.253281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886d006-b199-4bda-b0ce-fcbf9321016f admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:34.253563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886d006-b199-4bda-b0ce-fcbf9321016f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:34.253835 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886d006-b199-4bda-b0ce-fcbf9321016f admin admin] PATH_INFO: `/v3/projects/bc0b69937f5948299f7b4fd7b947472d/users/b90ce2c23eed433bb4772e6e04fa8ff4/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:34.268475 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886d006-b199-4bda-b0ce-fcbf9321016f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc0b69937f5948299f7b4fd7b947472d, user_id=b90ce2c23eed433bb4772e6e04fa8ff4, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:34.271222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886d006-b199-4bda-b0ce-fcbf9321016f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:34.366526 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1297/2612] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:34 2022] PUT /identity/v3/projects/bc0b69937f5948299f7b4fd7b947472d/users/b90ce2c23eed433bb4772e6e04fa8ff4/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:34.377471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5f4bd-46b0-41c0-8b06-2268f6bb56ea None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:34.377772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5f4bd-46b0-41c0-8b06-2268f6bb56ea None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:34.378049 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5f4bd-46b0-41c0-8b06-2268f6bb56ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:34.404488 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-13e5f4bd-46b0-41c0-8b06-2268f6bb56ea None None] MFA Rules not processed for user `b90ce2c23eed433bb4772e6e04fa8ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:34.405729 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-13e5f4bd-46b0-41c0-8b06-2268f6bb56ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:34.434354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:34.471663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1316/2613] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:34.476126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886d006-b199-4bda-b0ce-fcbf9321016f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:34.537566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886d006-b199-4bda-b0ce-fcbf9321016f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:34.542567 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27afd95-b618-4a68-b294-6d8db83e2732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:34.543245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27afd95-b618-4a68-b294-6d8db83e2732 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:34.543515 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27afd95-b618-4a68-b294-6d8db83e2732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:34.543796 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27afd95-b618-4a68-b294-6d8db83e2732 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:34.544506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27afd95-b618-4a68-b294-6d8db83e2732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:34.546438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27afd95-b618-4a68-b294-6d8db83e2732 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:34.618766 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1298/2614] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:34 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:34.622913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5f4bd-46b0-41c0-8b06-2268f6bb56ea None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:34.634237 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5f4bd-46b0-41c0-8b06-2268f6bb56ea None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:34.690146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3961fe-18e4-4787-8080-b8d14c1c8a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:34.690752 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3961fe-18e4-4787-8080-b8d14c1c8a73 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:34.691037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3961fe-18e4-4787-8080-b8d14c1c8a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:34.691312 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3961fe-18e4-4787-8080-b8d14c1c8a73 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:34.692037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3961fe-18e4-4787-8080-b8d14c1c8a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:34.694043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3961fe-18e4-4787-8080-b8d14c1c8a73 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:34.769611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1317/2615] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:34 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:34.770958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27afd95-b618-4a68-b294-6d8db83e2732 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:34.781397 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27afd95-b618-4a68-b294-6d8db83e2732 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:34.786045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb2708-3b93-4779-896a-305396d099a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:34.786702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb2708-3b93-4779-896a-305396d099a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:34.786992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb2708-3b93-4779-896a-305396d099a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:34.787272 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb2708-3b93-4779-896a-305396d099a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:34.787998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb2708-3b93-4779-896a-305396d099a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:34.789935 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb2708-3b93-4779-896a-305396d099a1 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:34.804363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1299/2616] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:34.805738 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3961fe-18e4-4787-8080-b8d14c1c8a73 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:34.816604 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3961fe-18e4-4787-8080-b8d14c1c8a73 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:34.821588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16346a7d-eb82-4357-961d-dc7a56dc8ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:34.822261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346a7d-eb82-4357-961d-dc7a56dc8ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:34.822548 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346a7d-eb82-4357-961d-dc7a56dc8ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:34.822827 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346a7d-eb82-4357-961d-dc7a56dc8ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:34.823568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16346a7d-eb82-4357-961d-dc7a56dc8ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:34.825364 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16346a7d-eb82-4357-961d-dc7a56dc8ddc admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:34.836378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1318/2617] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:36:34.840432 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb2708-3b93-4779-896a-305396d099a1 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:34.850791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb2708-3b93-4779-896a-305396d099a1 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:34.855447 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6179d-3d3e-4a1f-96b9-3cb0564e29a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:34.856322 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6179d-3d3e-4a1f-96b9-3cb0564e29a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:34.856934 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6179d-3d3e-4a1f-96b9-3cb0564e29a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:34.857270 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6179d-3d3e-4a1f-96b9-3cb0564e29a8 admin admin] PATH_INFO: `/v3/projects/f92c1b56ed3e41f58d08ce965e1e3648/users/c88d511ec05c488daa219f24297b0f82/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:34.872561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6179d-3d3e-4a1f-96b9-3cb0564e29a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92c1b56ed3e41f58d08ce965e1e3648, user_id=c88d511ec05c488daa219f24297b0f82, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:34.875807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6179d-3d3e-4a1f-96b9-3cb0564e29a8 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:34.976996 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:34.981992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1300/2618] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:34 2022] PUT /identity/v3/projects/f92c1b56ed3e41f58d08ce965e1e3648/users/c88d511ec05c488daa219f24297b0f82/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:35.054659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddfc2c-27c1-4c1d-86f0-e0e1a2bc3f32 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:35.055000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddfc2c-27c1-4c1d-86f0-e0e1a2bc3f32 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:35.055284 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddfc2c-27c1-4c1d-86f0-e0e1a2bc3f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:35.080911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-eeddfc2c-27c1-4c1d-86f0-e0e1a2bc3f32 None None] MFA Rules not processed for user `c88d511ec05c488daa219f24297b0f82`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:35.082170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-eeddfc2c-27c1-4c1d-86f0-e0e1a2bc3f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:35.144962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1319/2619] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:35.149636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6179d-3d3e-4a1f-96b9-3cb0564e29a8 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:35.210715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6179d-3d3e-4a1f-96b9-3cb0564e29a8 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:35.215375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535242ac-a2f9-49e2-858c-62ec8ac39aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:35.216033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535242ac-a2f9-49e2-858c-62ec8ac39aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:35.220568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535242ac-a2f9-49e2-858c-62ec8ac39aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:35.220568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535242ac-a2f9-49e2-858c-62ec8ac39aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:35.220568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535242ac-a2f9-49e2-858c-62ec8ac39aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:35.220568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535242ac-a2f9-49e2-858c-62ec8ac39aa2 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:35.306396 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1301/2620] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:35 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:35.310362 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddfc2c-27c1-4c1d-86f0-e0e1a2bc3f32 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:35.321603 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddfc2c-27c1-4c1d-86f0-e0e1a2bc3f32 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:35.323372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535242ac-a2f9-49e2-858c-62ec8ac39aa2 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:35.325182 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-535242ac-a2f9-49e2-858c-62ec8ac39aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:35.358691 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:35.383015 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc2efb-23d0-499a-a041-3f0cd11e1c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:35.383699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc2efb-23d0-499a-a041-3f0cd11e1c3d admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:35.383990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc2efb-23d0-499a-a041-3f0cd11e1c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:35.384272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc2efb-23d0-499a-a041-3f0cd11e1c3d admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:35.384976 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc2efb-23d0-499a-a041-3f0cd11e1c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:35.386535 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535242ac-a2f9-49e2-858c-62ec8ac39aa2 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:35.386980 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc2efb-23d0-499a-a041-3f0cd11e1c3d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:35.390317 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26283e5e-1cbc-4bba-8f40-625acadcc9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:35.392645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26283e5e-1cbc-4bba-8f40-625acadcc9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:35.392645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26283e5e-1cbc-4bba-8f40-625acadcc9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:35.392645 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26283e5e-1cbc-4bba-8f40-625acadcc9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:35.393526 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-26283e5e-1cbc-4bba-8f40-625acadcc9e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:35.457945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26283e5e-1cbc-4bba-8f40-625acadcc9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:35.457945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26283e5e-1cbc-4bba-8f40-625acadcc9e3 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:35.466705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1302/2621] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:36:35.468238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1320/2622] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:35 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:35.472581 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26283e5e-1cbc-4bba-8f40-625acadcc9e3 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:35.483167 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26283e5e-1cbc-4bba-8f40-625acadcc9e3 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:35.487849 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8acac5-2e66-47fe-9a56-6e74668324e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:35.488505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8acac5-2e66-47fe-9a56-6e74668324e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:35.488791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8acac5-2e66-47fe-9a56-6e74668324e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:35.489069 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8acac5-2e66-47fe-9a56-6e74668324e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:35.489854 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8acac5-2e66-47fe-9a56-6e74668324e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:35.491523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8acac5-2e66-47fe-9a56-6e74668324e2 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:35.501694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1303/2623] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:35.506014 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc2efb-23d0-499a-a041-3f0cd11e1c3d admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:35.517039 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc2efb-23d0-499a-a041-3f0cd11e1c3d admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:35.522012 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965c320-052e-46c4-baf4-000161c48bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:35.523044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c320-052e-46c4-baf4-000161c48bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:35.523336 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c320-052e-46c4-baf4-000161c48bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:35.523618 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c320-052e-46c4-baf4-000161c48bdd admin admin] PATH_INFO: `/v3/projects/8bbae7c69c8544408c6014c1e4e3c0ca/users/cc4fbb645ca3473694be35ba79928ded/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:35.541161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965c320-052e-46c4-baf4-000161c48bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbae7c69c8544408c6014c1e4e3c0ca, user_id=cc4fbb645ca3473694be35ba79928ded, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:35.543859 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965c320-052e-46c4-baf4-000161c48bdd admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:35.638705 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1321/2624] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:35 2022] PUT /identity/v3/projects/8bbae7c69c8544408c6014c1e4e3c0ca/users/cc4fbb645ca3473694be35ba79928ded/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:35.643209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8acac5-2e66-47fe-9a56-6e74668324e2 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:35.653401 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8acac5-2e66-47fe-9a56-6e74668324e2 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:35.682598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:35.712992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c93d36-c606-499e-9616-906e2c75efb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:35.713693 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c93d36-c606-499e-9616-906e2c75efb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:35.713983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c93d36-c606-499e-9616-906e2c75efb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:35.714266 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c93d36-c606-499e-9616-906e2c75efb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:35.715076 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c93d36-c606-499e-9616-906e2c75efb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:35.716862 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c93d36-c606-499e-9616-906e2c75efb7 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:35.730743 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1304/2625] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:35.731929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965c320-052e-46c4-baf4-000161c48bdd admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:35.742263 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965c320-052e-46c4-baf4-000161c48bdd admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:35.746972 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a888cf1-1901-4a62-a843-3712b7401995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:35.747911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a888cf1-1901-4a62-a843-3712b7401995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:35.748199 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a888cf1-1901-4a62-a843-3712b7401995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:35.748475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a888cf1-1901-4a62-a843-3712b7401995 admin admin] PATH_INFO: `/v3/projects/8bbae7c69c8544408c6014c1e4e3c0ca/users/cc4fbb645ca3473694be35ba79928ded/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:35.750525 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a888cf1-1901-4a62-a843-3712b7401995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbae7c69c8544408c6014c1e4e3c0ca, user_id=cc4fbb645ca3473694be35ba79928ded, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:35.753208 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a888cf1-1901-4a62-a843-3712b7401995 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:35.764684 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1322/2626] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:35 2022] PUT /identity/v3/projects/8bbae7c69c8544408c6014c1e4e3c0ca/users/cc4fbb645ca3473694be35ba79928ded/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:35.775156 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fe3de-7864-43ba-a2de-6b3b5bc4c8cb None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:35.775452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fe3de-7864-43ba-a2de-6b3b5bc4c8cb None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:35.775731 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fe3de-7864-43ba-a2de-6b3b5bc4c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:35.803958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-1f9fe3de-7864-43ba-a2de-6b3b5bc4c8cb None None] MFA Rules not processed for user `cc4fbb645ca3473694be35ba79928ded`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:35.805208 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1f9fe3de-7864-43ba-a2de-6b3b5bc4c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:35.876867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1305/2627] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:35.888426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a888cf1-1901-4a62-a843-3712b7401995 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:35.890181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-2a888cf1-1901-4a62-a843-3712b7401995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:35.950753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a888cf1-1901-4a62-a843-3712b7401995 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:35.955177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d635cad-70cd-4765-af25-70fb1eac9d61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:35.955835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d635cad-70cd-4765-af25-70fb1eac9d61 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:35.956123 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d635cad-70cd-4765-af25-70fb1eac9d61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:35.956400 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d635cad-70cd-4765-af25-70fb1eac9d61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:36.016075 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d635cad-70cd-4765-af25-70fb1eac9d61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:36.017599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d635cad-70cd-4765-af25-70fb1eac9d61 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:36.026681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1323/2628] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:37.882239 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fe3de-7864-43ba-a2de-6b3b5bc4c8cb None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:37.883800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1f9fe3de-7864-43ba-a2de-6b3b5bc4c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:37.949818 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fe3de-7864-43ba-a2de-6b3b5bc4c8cb None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:37.954276 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:37.955135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:37.955422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:37.955696 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] PATH_INFO: `/v3/users/c969efa19b0d4353a7bec21e6f9d8b38` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:37.956863 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c969efa19b0d4353a7bec21e6f9d8b38)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:37.958863 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:38.120819 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d635cad-70cd-4765-af25-70fb1eac9d61 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:38.130601 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d635cad-70cd-4765-af25-70fb1eac9d61 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:38.134683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd39c37-b503-4b31-b426-f93e9c708157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:38.135340 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd39c37-b503-4b31-b426-f93e9c708157 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:38.135640 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd39c37-b503-4b31-b426-f93e9c708157 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:38.135906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd39c37-b503-4b31-b426-f93e9c708157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:38.146002 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c969efa19b0d4353a7bec21e6f9d8b38'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:38.149857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:38.182165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:38.197036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd39c37-b503-4b31-b426-f93e9c708157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:38.198595 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd39c37-b503-4b31-b426-f93e9c708157 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:38.207911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1324/2629] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:38.235202 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c969efa19b0d4353a7bec21e6f9d8b38'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:38.248243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c969efa19b0d4353a7bec21e6f9d8b38'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:38.248909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c969efa19b0d4353a7bec21e6f9d8b38'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:38.256381 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c969efa19b0d4353a7bec21e6f9d8b38'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:38.264291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1306/2630] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:37 2022] DELETE /identity/v3/users/c969efa19b0d4353a7bec21e6f9d8b38 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:38.267144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c35639-d196-4313-be05-b25e811916a9 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:38.267444 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c35639-d196-4313-be05-b25e811916a9 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:38.267726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c35639-d196-4313-be05-b25e811916a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:38.285447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-d7c35639-d196-4313-be05-b25e811916a9 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:38.298831 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d7c35639-d196-4313-be05-b25e811916a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:38.347788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1325/2631] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:36:38.375558 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:38.377338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:38.437440 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f835501-f6d3-4081-ba3a-c53ebfedce07 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:38.441761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29c66-fbe6-40c7-b5f9-5e80a3767149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:38.442610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29c66-fbe6-40c7-b5f9-5e80a3767149 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:38.442896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29c66-fbe6-40c7-b5f9-5e80a3767149 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:38.443197 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29c66-fbe6-40c7-b5f9-5e80a3767149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:38.459384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb29c66-fbe6-40c7-b5f9-5e80a3767149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:38.460851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb29c66-fbe6-40c7-b5f9-5e80a3767149 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:38.471841 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1307/2632] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:39.082499 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c35639-d196-4313-be05-b25e811916a9 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:39.084057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d7c35639-d196-4313-be05-b25e811916a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:39.100907 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c35639-d196-4313-be05-b25e811916a9 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:39.105788 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:39.106716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:39.106947 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:39.107226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] PATH_INFO: `/v3/projects/67e28aa6c2d7486f911504d42097cb8a` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:39.109007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e28aa6c2d7486f911504d42097cb8a)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:39.112138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:39.246338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e28aa6c2d7486f911504d42097cb8a', 'request_id': 'req-09cadde4-1e16-4117-b4a1-9375776c783e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:39.361287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e28aa6c2d7486f911504d42097cb8a', 'request_id': 'req-09cadde4-1e16-4117-b4a1-9375776c783e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:39.368975 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e28aa6c2d7486f911504d42097cb8a', 'request_id': 'req-09cadde4-1e16-4117-b4a1-9375776c783e'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:39.381935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] The token cache is being invalidate because project 67e28aa6c2d7486f911504d42097cb8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:39.382226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:39.382888 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:39.384439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1326/2633] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:39 2022] DELETE /identity/v3/projects/67e28aa6c2d7486f911504d42097cb8a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:39.388362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29c66-fbe6-40c7-b5f9-5e80a3767149 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:39.398490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29c66-fbe6-40c7-b5f9-5e80a3767149 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:39.456033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:39.457020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:39.457327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:39.457605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] PATH_INFO: `/v3/users/3424bddb690847dcade0ea1068b2785a` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:39.458917 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3424bddb690847dcade0ea1068b2785a)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:39.461030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:39.682147 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3424bddb690847dcade0ea1068b2785a'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:39.741469 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3424bddb690847dcade0ea1068b2785a'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:39.756074 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3424bddb690847dcade0ea1068b2785a'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:39.756753 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3424bddb690847dcade0ea1068b2785a'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:39.760081 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:39.767228 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3424bddb690847dcade0ea1068b2785a'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:39.773262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1308/2634] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:39 2022] DELETE /identity/v3/users/3424bddb690847dcade0ea1068b2785a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:39.808155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:39.809660 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:39.867520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cadde4-1e16-4117-b4a1-9375776c783e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:39.886253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:39.922207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51615c8b-c3dc-4953-952b-a5d061c2f93a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:39.922207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51615c8b-c3dc-4953-952b-a5d061c2f93a service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:39.922207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51615c8b-c3dc-4953-952b-a5d061c2f93a service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:39.922207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51615c8b-c3dc-4953-952b-a5d061c2f93a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:39.922658 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-51615c8b-c3dc-4953-952b-a5d061c2f93a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:39.980780 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51615c8b-c3dc-4953-952b-a5d061c2f93a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:39.982255 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51615c8b-c3dc-4953-952b-a5d061c2f93a service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:39.991672 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1327/2635] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:40.277535 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:40.280691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:40.379395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92065de9-6a8b-4f0b-8f57-39ef67490078 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:40.384403 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43e633-1d35-4d16-bd0f-4c67671a60f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:40.385298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43e633-1d35-4d16-bd0f-4c67671a60f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:40.385588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43e633-1d35-4d16-bd0f-4c67671a60f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:40.385870 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43e633-1d35-4d16-bd0f-4c67671a60f9 admin admin] PATH_INFO: `/v3/projects/b3efcc206a294f57b8a44b09e72100f3` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:40.387049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43e633-1d35-4d16-bd0f-4c67671a60f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3efcc206a294f57b8a44b09e72100f3)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:40.389015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43e633-1d35-4d16-bd0f-4c67671a60f9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:40.495637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3a43e633-1d35-4d16-bd0f-4c67671a60f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3efcc206a294f57b8a44b09e72100f3', 'request_id': 'req-3a43e633-1d35-4d16-bd0f-4c67671a60f9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:40.554499 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3a43e633-1d35-4d16-bd0f-4c67671a60f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3efcc206a294f57b8a44b09e72100f3', 'request_id': 'req-3a43e633-1d35-4d16-bd0f-4c67671a60f9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:40.561038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3a43e633-1d35-4d16-bd0f-4c67671a60f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3efcc206a294f57b8a44b09e72100f3', 'request_id': 'req-3a43e633-1d35-4d16-bd0f-4c67671a60f9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:40.572204 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3a43e633-1d35-4d16-bd0f-4c67671a60f9 admin admin] The token cache is being invalidate because project b3efcc206a294f57b8a44b09e72100f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:40.572500 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3a43e633-1d35-4d16-bd0f-4c67671a60f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:40.573162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3a43e633-1d35-4d16-bd0f-4c67671a60f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:40.574834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1309/2636] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:40 2022] DELETE /identity/v3/projects/b3efcc206a294f57b8a44b09e72100f3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:40.580424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31960136-cef9-4cda-b0a6-91e0203e92f0 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:40.580880 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31960136-cef9-4cda-b0a6-91e0203e92f0 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:40.580977 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31960136-cef9-4cda-b0a6-91e0203e92f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:40.598938 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-31960136-cef9-4cda-b0a6-91e0203e92f0 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:40.600138 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-31960136-cef9-4cda-b0a6-91e0203e92f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:40.660120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1328/2637] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:40.668059 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e386e-3a74-495a-9fcf-0e1555021c4d None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:40.668411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e386e-3a74-495a-9fcf-0e1555021c4d None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:40.668821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e386e-3a74-495a-9fcf-0e1555021c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:40.688004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-5e4e386e-3a74-495a-9fcf-0e1555021c4d None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:40.691516 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5e4e386e-3a74-495a-9fcf-0e1555021c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:40.697170 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1310/2638] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:40.701200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31960136-cef9-4cda-b0a6-91e0203e92f0 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:40.710778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31960136-cef9-4cda-b0a6-91e0203e92f0 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:40.715347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d2056-1ce3-4b43-95eb-d7e101bae71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:40.715995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d2056-1ce3-4b43-95eb-d7e101bae71f admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:40.716277 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d2056-1ce3-4b43-95eb-d7e101bae71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:40.716549 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d2056-1ce3-4b43-95eb-d7e101bae71f admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:40.717319 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d2056-1ce3-4b43-95eb-d7e101bae71f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:36:40.717625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d2056-1ce3-4b43-95eb-d7e101bae71f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:40.719208 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d2056-1ce3-4b43-95eb-d7e101bae71f admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:40.730570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1329/2639] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:36:40.735145 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e386e-3a74-495a-9fcf-0e1555021c4d None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:40.744383 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e386e-3a74-495a-9fcf-0e1555021c4d None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:40.749085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0f728-d9f4-4194-8418-592a13485988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:40.750333 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0f728-d9f4-4194-8418-592a13485988 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:40.750624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0f728-d9f4-4194-8418-592a13485988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:40.750901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0f728-d9f4-4194-8418-592a13485988 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:40.751583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0f728-d9f4-4194-8418-592a13485988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:40.753503 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0f728-d9f4-4194-8418-592a13485988 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:40.819435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1311/2640] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:40 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:40.823365 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d2056-1ce3-4b43-95eb-d7e101bae71f admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:40.833393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d2056-1ce3-4b43-95eb-d7e101bae71f admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:40.891228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78386f4f-5462-4255-9437-3bd60f32d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:40.891921 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386f4f-5462-4255-9437-3bd60f32d8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:40.892214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386f4f-5462-4255-9437-3bd60f32d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:40.892491 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386f4f-5462-4255-9437-3bd60f32d8a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:40.893224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78386f4f-5462-4255-9437-3bd60f32d8a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:40.895131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78386f4f-5462-4255-9437-3bd60f32d8a3 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:40.901726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:40.977446 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1330/2641] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:40 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:40.981517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0f728-d9f4-4194-8418-592a13485988 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:40.992550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0f728-d9f4-4194-8418-592a13485988 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:40.997909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1bdc4-10a8-4b93-8d14-400d1de0bc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:40.998564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1bdc4-10a8-4b93-8d14-400d1de0bc35 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:40.998851 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1bdc4-10a8-4b93-8d14-400d1de0bc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:40.999192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1bdc4-10a8-4b93-8d14-400d1de0bc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:41.000626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1bdc4-10a8-4b93-8d14-400d1de0bc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:41.002511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1bdc4-10a8-4b93-8d14-400d1de0bc35 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:41.013592 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1312/2642] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:41.017379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78386f4f-5462-4255-9437-3bd60f32d8a3 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:41.027116 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78386f4f-5462-4255-9437-3bd60f32d8a3 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:41.032220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08fb58-b190-446c-bec3-d0be4e8f74fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:41.032871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08fb58-b190-446c-bec3-d0be4e8f74fb admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:41.033191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08fb58-b190-446c-bec3-d0be4e8f74fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:41.033474 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08fb58-b190-446c-bec3-d0be4e8f74fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:41.034200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08fb58-b190-446c-bec3-d0be4e8f74fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:41.035790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08fb58-b190-446c-bec3-d0be4e8f74fb admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:41.045837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1331/2643] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:41.050335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1bdc4-10a8-4b93-8d14-400d1de0bc35 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:41.060023 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1bdc4-10a8-4b93-8d14-400d1de0bc35 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:41.064565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e823d-5442-4786-863c-4dbbdcefcf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:41.065460 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e823d-5442-4786-863c-4dbbdcefcf9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:41.065742 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e823d-5442-4786-863c-4dbbdcefcf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:41.066017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e823d-5442-4786-863c-4dbbdcefcf9a admin admin] PATH_INFO: `/v3/projects/acd87ac2f7dc4c21a71efb2a4b1a0980/users/a8fc78b6ff08499986e8a739cc1cb449/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:41.080211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e823d-5442-4786-863c-4dbbdcefcf9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd87ac2f7dc4c21a71efb2a4b1a0980, user_id=a8fc78b6ff08499986e8a739cc1cb449, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:41.082896 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e823d-5442-4786-863c-4dbbdcefcf9a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:41.143651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1313/2644] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:41 2022] PUT /identity/v3/projects/acd87ac2f7dc4c21a71efb2a4b1a0980/users/a8fc78b6ff08499986e8a739cc1cb449/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:41.154058 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d4de5-e9c8-48d6-b1c2-3abe43e9994e None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:41.154347 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d4de5-e9c8-48d6-b1c2-3abe43e9994e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:41.154627 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d4de5-e9c8-48d6-b1c2-3abe43e9994e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:41.181694 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-c71d4de5-e9c8-48d6-b1c2-3abe43e9994e None None] MFA Rules not processed for user `a8fc78b6ff08499986e8a739cc1cb449`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:41.182895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c71d4de5-e9c8-48d6-b1c2-3abe43e9994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:41.244747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1332/2645] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:41.249142 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e823d-5442-4786-863c-4dbbdcefcf9a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:41.268909 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:41.311345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e823d-5442-4786-863c-4dbbdcefcf9a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:41.316048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b75634-909f-4fb1-bd26-a2f0c8739dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:41.316699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b75634-909f-4fb1-bd26-a2f0c8739dbe admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:41.316985 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b75634-909f-4fb1-bd26-a2f0c8739dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:41.317329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b75634-909f-4fb1-bd26-a2f0c8739dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:41.318039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b75634-909f-4fb1-bd26-a2f0c8739dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:41.319941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b75634-909f-4fb1-bd26-a2f0c8739dbe admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:41.418067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1314/2646] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:41 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:41.419178 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d4de5-e9c8-48d6-b1c2-3abe43e9994e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:41.432019 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d4de5-e9c8-48d6-b1c2-3abe43e9994e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:41.508331 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f069994-ed38-455c-90fd-985d43ee8e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:41.509103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069994-ed38-455c-90fd-985d43ee8e30 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:41.509490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069994-ed38-455c-90fd-985d43ee8e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:41.509986 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069994-ed38-455c-90fd-985d43ee8e30 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:41.510743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f069994-ed38-455c-90fd-985d43ee8e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:41.512737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f069994-ed38-455c-90fd-985d43ee8e30 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:41.618373 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1333/2647] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:41 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:41.622377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b75634-909f-4fb1-bd26-a2f0c8739dbe admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:41.632925 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b75634-909f-4fb1-bd26-a2f0c8739dbe admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:41.637447 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3777e-2e49-4a26-8a7d-1b24628bf10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:41.638105 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3777e-2e49-4a26-8a7d-1b24628bf10f admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:41.638395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3777e-2e49-4a26-8a7d-1b24628bf10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:41.638678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3777e-2e49-4a26-8a7d-1b24628bf10f admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:41.639443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3777e-2e49-4a26-8a7d-1b24628bf10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:41.641588 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3777e-2e49-4a26-8a7d-1b24628bf10f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:41.653444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1315/2648] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:36:41.657991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f069994-ed38-455c-90fd-985d43ee8e30 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:41.669285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f069994-ed38-455c-90fd-985d43ee8e30 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:41.674491 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addebad-46f2-4e5b-938d-cacd29627c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:41.675535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addebad-46f2-4e5b-938d-cacd29627c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:41.675826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addebad-46f2-4e5b-938d-cacd29627c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:41.676185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addebad-46f2-4e5b-938d-cacd29627c6e admin admin] PATH_INFO: `/v3/projects/de1d4f3f819141199c80c0369e043fe3/users/de0f54cd2bcc4e5c940cc2f12ad3a0d3/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:41.707747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addebad-46f2-4e5b-938d-cacd29627c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1d4f3f819141199c80c0369e043fe3, user_id=de0f54cd2bcc4e5c940cc2f12ad3a0d3, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:41.707747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addebad-46f2-4e5b-938d-cacd29627c6e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:41.787616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1334/2649] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:41 2022] PUT /identity/v3/projects/de1d4f3f819141199c80c0369e043fe3/users/de0f54cd2bcc4e5c940cc2f12ad3a0d3/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:41.792068 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3777e-2e49-4a26-8a7d-1b24628bf10f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:41.797895 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addebad-46f2-4e5b-938d-cacd29627c6e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:41.800796 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-5addebad-46f2-4e5b-938d-cacd29627c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:41.802712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3777e-2e49-4a26-8a7d-1b24628bf10f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:41.836710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:41.867731 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb7c3d-1ba2-49a1-a7ab-28ab8c42a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:41.871119 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb7c3d-1ba2-49a1-a7ab-28ab8c42a469 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:41.871119 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb7c3d-1ba2-49a1-a7ab-28ab8c42a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:41.871119 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb7c3d-1ba2-49a1-a7ab-28ab8c42a469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:41.871119 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb7c3d-1ba2-49a1-a7ab-28ab8c42a469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:41.871637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb7c3d-1ba2-49a1-a7ab-28ab8c42a469 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:41.877229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addebad-46f2-4e5b-938d-cacd29627c6e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:41.881792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2404c-b400-4230-ac81-e5e04be597ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:41.882455 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2404c-b400-4230-ac81-e5e04be597ca service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:41.882798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2404c-b400-4230-ac81-e5e04be597ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:41.883121 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2404c-b400-4230-ac81-e5e04be597ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:41.886749 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1316/2650] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:41.887856 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb7c3d-1ba2-49a1-a7ab-28ab8c42a469 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:41.888048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-33d2404c-b400-4230-ac81-e5e04be597ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:41.899258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb7c3d-1ba2-49a1-a7ab-28ab8c42a469 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:41.902783 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2404c-b400-4230-ac81-e5e04be597ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:41.904256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2404c-b400-4230-ac81-e5e04be597ca service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:41.904793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecdafe-51e2-4231-a890-29935709c28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:41.905855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecdafe-51e2-4231-a890-29935709c28b admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:41.906241 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecdafe-51e2-4231-a890-29935709c28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:41.906618 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecdafe-51e2-4231-a890-29935709c28b admin admin] PATH_INFO: `/v3/projects/de1d4f3f819141199c80c0369e043fe3/users/de0f54cd2bcc4e5c940cc2f12ad3a0d3/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:41.916590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecdafe-51e2-4231-a890-29935709c28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1d4f3f819141199c80c0369e043fe3, user_id=de0f54cd2bcc4e5c940cc2f12ad3a0d3, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:41.916590 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecdafe-51e2-4231-a890-29935709c28b admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:41.923120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1335/2651] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:36:41.923359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1317/2652] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:41 2022] PUT /identity/v3/projects/de1d4f3f819141199c80c0369e043fe3/users/de0f54cd2bcc4e5c940cc2f12ad3a0d3/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:41.934407 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b70fe6-0a85-4f8f-9a05-f069eaf055a8 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:41.934790 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b70fe6-0a85-4f8f-9a05-f069eaf055a8 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:41.935274 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b70fe6-0a85-4f8f-9a05-f069eaf055a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:41.963995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-53b70fe6-0a85-4f8f-9a05-f069eaf055a8 None None] MFA Rules not processed for user `de0f54cd2bcc4e5c940cc2f12ad3a0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:41.965268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-53b70fe6-0a85-4f8f-9a05-f069eaf055a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:42.047873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1336/2653] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:36:42.059672 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecdafe-51e2-4231-a890-29935709c28b admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:42.061392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-40ecdafe-51e2-4231-a890-29935709c28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:42.122910 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecdafe-51e2-4231-a890-29935709c28b admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:42.127561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26676bbb-4fcb-4f2c-b21d-0072ceb7445b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:42.128243 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26676bbb-4fcb-4f2c-b21d-0072ceb7445b service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:42.128530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26676bbb-4fcb-4f2c-b21d-0072ceb7445b service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:42.128807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26676bbb-4fcb-4f2c-b21d-0072ceb7445b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:42.138465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26676bbb-4fcb-4f2c-b21d-0072ceb7445b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:42.143596 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26676bbb-4fcb-4f2c-b21d-0072ceb7445b service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:42.151123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1318/2654] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:42.216487 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b70fe6-0a85-4f8f-9a05-f069eaf055a8 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:42.282589 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b70fe6-0a85-4f8f-9a05-f069eaf055a8 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:42.287227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:42.292034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:42.292034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:42.292034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] PATH_INFO: `/v3/users/a8fc78b6ff08499986e8a739cc1cb449` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:42.292034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8fc78b6ff08499986e8a739cc1cb449)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:42.292034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:42.575214 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8fc78b6ff08499986e8a739cc1cb449'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:42.672683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8fc78b6ff08499986e8a739cc1cb449'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:42.673374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8fc78b6ff08499986e8a739cc1cb449'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:42.680832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:42.686061 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8fc78b6ff08499986e8a739cc1cb449'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:42.692747 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8fc78b6ff08499986e8a739cc1cb449'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:42.698948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1337/2655] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:42 2022] DELETE /identity/v3/users/a8fc78b6ff08499986e8a739cc1cb449 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:42.703486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157addfa-b0b3-4215-88ff-fa1baa2b7510 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:42.703975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157addfa-b0b3-4215-88ff-fa1baa2b7510 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:42.710406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157addfa-b0b3-4215-88ff-fa1baa2b7510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:42.721489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-157addfa-b0b3-4215-88ff-fa1baa2b7510 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:42.722775 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-157addfa-b0b3-4215-88ff-fa1baa2b7510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:42.735333 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:42.782044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1319/2656] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:42.791853 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:42.798145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:42.849531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d8ebd-45ca-4a54-a8f1-ccbd22f5640a admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:42.853266 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37f888-39db-48c2-9490-f2b21faba46e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:42.853919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37f888-39db-48c2-9490-f2b21faba46e service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:42.854206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37f888-39db-48c2-9490-f2b21faba46e service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:42.854486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37f888-39db-48c2-9490-f2b21faba46e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:42.864475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37f888-39db-48c2-9490-f2b21faba46e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:42.865953 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37f888-39db-48c2-9490-f2b21faba46e service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:42.876322 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1338/2657] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:43.505838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157addfa-b0b3-4215-88ff-fa1baa2b7510 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:43.507743 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-157addfa-b0b3-4215-88ff-fa1baa2b7510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:43.537653 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157addfa-b0b3-4215-88ff-fa1baa2b7510 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:43.543047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:43.544048 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:43.544426 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:43.544777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] PATH_INFO: `/v3/projects/acd87ac2f7dc4c21a71efb2a4b1a0980` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:43.546169 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd87ac2f7dc4c21a71efb2a4b1a0980)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:43.548238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:43.666646 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd87ac2f7dc4c21a71efb2a4b1a0980', 'request_id': 'req-daec4e39-6905-4dca-a639-c5be2768b636'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:43.729432 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd87ac2f7dc4c21a71efb2a4b1a0980', 'request_id': 'req-daec4e39-6905-4dca-a639-c5be2768b636'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:43.736910 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd87ac2f7dc4c21a71efb2a4b1a0980', 'request_id': 'req-daec4e39-6905-4dca-a639-c5be2768b636'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:43.747547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] The token cache is being invalidate because project acd87ac2f7dc4c21a71efb2a4b1a0980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:43.747840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:43.748505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:43.751226 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1320/2658] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:43 2022] DELETE /identity/v3/projects/acd87ac2f7dc4c21a71efb2a4b1a0980 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:43.754961 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37f888-39db-48c2-9490-f2b21faba46e service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:43.765346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37f888-39db-48c2-9490-f2b21faba46e service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:43.839776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:43.840674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:43.840942 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:43.841271 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] PATH_INFO: `/v3/users/de0f54cd2bcc4e5c940cc2f12ad3a0d3` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:43.842879 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0f54cd2bcc4e5c940cc2f12ad3a0d3)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:43.844978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:44.041908 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0f54cd2bcc4e5c940cc2f12ad3a0d3'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:44.132024 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0f54cd2bcc4e5c940cc2f12ad3a0d3'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:44.132767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0f54cd2bcc4e5c940cc2f12ad3a0d3'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:44.148150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0f54cd2bcc4e5c940cc2f12ad3a0d3'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:44.156663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0f54cd2bcc4e5c940cc2f12ad3a0d3'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:44.163297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1339/2659] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:43 2022] DELETE /identity/v3/users/de0f54cd2bcc4e5c940cc2f12ad3a0d3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:44.775918 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:44.777530 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:44.777647 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:44.779072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:44.784818 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:44.792980 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec4e39-6905-4dca-a639-c5be2768b636 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:44.855803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b117f45-dba5-4510-b30d-7205cdffa2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:44.856711 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b117f45-dba5-4510-b30d-7205cdffa2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:44.857216 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b117f45-dba5-4510-b30d-7205cdffa2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:44.857505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b117f45-dba5-4510-b30d-7205cdffa2c7 admin admin] PATH_INFO: `/v3/projects/de1d4f3f819141199c80c0369e043fe3` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:44.858735 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b117f45-dba5-4510-b30d-7205cdffa2c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1d4f3f819141199c80c0369e043fe3)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:44.860675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b117f45-dba5-4510-b30d-7205cdffa2c7 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:44.862183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c339c46-6833-4d11-9321-b33fe7057d44 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:44.866813 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb8e04-1492-49d3-8627-267cab1602eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:44.867686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb8e04-1492-49d3-8627-267cab1602eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:44.867967 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb8e04-1492-49d3-8627-267cab1602eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:44.868235 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb8e04-1492-49d3-8627-267cab1602eb admin admin] PATH_INFO: `/v3/users/b90ce2c23eed433bb4772e6e04fa8ff4` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:44.869557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb8e04-1492-49d3-8627-267cab1602eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90ce2c23eed433bb4772e6e04fa8ff4)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:44.871471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb8e04-1492-49d3-8627-267cab1602eb admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:44.969441 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:44.973060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9b117f45-dba5-4510-b30d-7205cdffa2c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1d4f3f819141199c80c0369e043fe3', 'request_id': 'req-9b117f45-dba5-4510-b30d-7205cdffa2c7'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:45.062655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9b117f45-dba5-4510-b30d-7205cdffa2c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1d4f3f819141199c80c0369e043fe3', 'request_id': 'req-9b117f45-dba5-4510-b30d-7205cdffa2c7'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:45.062655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9b117f45-dba5-4510-b30d-7205cdffa2c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1d4f3f819141199c80c0369e043fe3', 'request_id': 'req-9b117f45-dba5-4510-b30d-7205cdffa2c7'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:45.062655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9b117f45-dba5-4510-b30d-7205cdffa2c7 admin admin] The token cache is being invalidate because project de1d4f3f819141199c80c0369e043fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:45.062655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9b117f45-dba5-4510-b30d-7205cdffa2c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:45.063534 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9b117f45-dba5-4510-b30d-7205cdffa2c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:45.065084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1321/2660] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:44 2022] DELETE /identity/v3/projects/de1d4f3f819141199c80c0369e043fe3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:45.085413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdef5b-5023-4c7b-97ea-67767ed40e50 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:45.085799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdef5b-5023-4c7b-97ea-67767ed40e50 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:45.086034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdef5b-5023-4c7b-97ea-67767ed40e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:45.107996 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-f4fdef5b-5023-4c7b-97ea-67767ed40e50 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:45.109465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f4fdef5b-5023-4c7b-97ea-67767ed40e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:45.175096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1322/2661] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:45.182734 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c75d5-8677-40d8-b39f-b58592804cde None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:45.183031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c75d5-8677-40d8-b39f-b58592804cde None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:45.183376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c75d5-8677-40d8-b39f-b58592804cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:45.201702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-ed0c75d5-8677-40d8-b39f-b58592804cde None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:45.203076 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-ed0c75d5-8677-40d8-b39f-b58592804cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:45.206841 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b3cb8e04-1492-49d3-8627-267cab1602eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90ce2c23eed433bb4772e6e04fa8ff4'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:45.211282 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1323/2662] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:36:45.215360 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c75d5-8677-40d8-b39f-b58592804cde None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:45.224298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c75d5-8677-40d8-b39f-b58592804cde None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:45.229005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc37ec0-b57a-4ecb-88e0-342e87e5baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:45.229679 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc37ec0-b57a-4ecb-88e0-342e87e5baa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:45.229969 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc37ec0-b57a-4ecb-88e0-342e87e5baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:45.230250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc37ec0-b57a-4ecb-88e0-342e87e5baa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:45.230979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc37ec0-b57a-4ecb-88e0-342e87e5baa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:36:45.231290 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc37ec0-b57a-4ecb-88e0-342e87e5baa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:45.232889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc37ec0-b57a-4ecb-88e0-342e87e5baa9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:45.245776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1324/2663] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:36:45.250529 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc37ec0-b57a-4ecb-88e0-342e87e5baa9 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:45.261105 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc37ec0-b57a-4ecb-88e0-342e87e5baa9 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:45.268928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20862e2-02b4-476c-99e6-9ae4b72a108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:45.268928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20862e2-02b4-476c-99e6-9ae4b72a108a admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:45.268928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20862e2-02b4-476c-99e6-9ae4b72a108a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:45.268928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20862e2-02b4-476c-99e6-9ae4b72a108a admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:45.269406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20862e2-02b4-476c-99e6-9ae4b72a108a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:45.270950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20862e2-02b4-476c-99e6-9ae4b72a108a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:45.292227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b3cb8e04-1492-49d3-8627-267cab1602eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90ce2c23eed433bb4772e6e04fa8ff4'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:45.292227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b3cb8e04-1492-49d3-8627-267cab1602eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90ce2c23eed433bb4772e6e04fa8ff4'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:45.327467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b3cb8e04-1492-49d3-8627-267cab1602eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90ce2c23eed433bb4772e6e04fa8ff4'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:45.339323 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b3cb8e04-1492-49d3-8627-267cab1602eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90ce2c23eed433bb4772e6e04fa8ff4'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:45.360639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1340/2664] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:44 2022] DELETE /identity/v3/users/b90ce2c23eed433bb4772e6e04fa8ff4 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:45.362105 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98af996-5801-4064-8d72-2a896191724a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:45.362541 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98af996-5801-4064-8d72-2a896191724a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:45.362945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98af996-5801-4064-8d72-2a896191724a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:45.386619 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e98af996-5801-4064-8d72-2a896191724a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:45.387869 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e98af996-5801-4064-8d72-2a896191724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:45.430397 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1325/2665] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:45 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:36:45.431504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20862e2-02b4-476c-99e6-9ae4b72a108a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:45.438493 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f20862e2-02b4-476c-99e6-9ae4b72a108a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:45.482127 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1341/2666] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:45.497303 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98af996-5801-4064-8d72-2a896191724a None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:45.499054 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e98af996-5801-4064-8d72-2a896191724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:45.541739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20862e2-02b4-476c-99e6-9ae4b72a108a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:45.548609 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112fbe0-eee1-44c0-8ab6-180a3df00bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:45.549451 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112fbe0-eee1-44c0-8ab6-180a3df00bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:45.549806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112fbe0-eee1-44c0-8ab6-180a3df00bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:45.550098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112fbe0-eee1-44c0-8ab6-180a3df00bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:45.550801 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112fbe0-eee1-44c0-8ab6-180a3df00bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:45.550917 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:45.553742 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112fbe0-eee1-44c0-8ab6-180a3df00bd9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:45.594301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98af996-5801-4064-8d72-2a896191724a None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:45.628098 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1326/2667] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:45 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:45.632425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112fbe0-eee1-44c0-8ab6-180a3df00bd9 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:45.643410 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112fbe0-eee1-44c0-8ab6-180a3df00bd9 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:45.649518 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c9093-cbfe-45f4-a4c9-a70b88874887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:45.653444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9093-cbfe-45f4-a4c9-a70b88874887 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:45.653444 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9093-cbfe-45f4-a4c9-a70b88874887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:45.653683 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccef4e-b6b1-4d65-b64f-5e595a2bfedc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:45.653807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9093-cbfe-45f4-a4c9-a70b88874887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:45.653914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccef4e-b6b1-4d65-b64f-5e595a2bfedc service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:45.653914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccef4e-b6b1-4d65-b64f-5e595a2bfedc service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:45.653914 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccef4e-b6b1-4d65-b64f-5e595a2bfedc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:45.654177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c9093-cbfe-45f4-a4c9-a70b88874887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:45.655047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c9093-cbfe-45f4-a4c9-a70b88874887 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:45.665009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccef4e-b6b1-4d65-b64f-5e595a2bfedc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:45.666506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1327/2668] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:36:45.666774 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccef4e-b6b1-4d65-b64f-5e595a2bfedc service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:45.670265 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c9093-cbfe-45f4-a4c9-a70b88874887 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:45.680876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c9093-cbfe-45f4-a4c9-a70b88874887 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:45.681302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1342/2669] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:45.686069 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32969033-e752-42e3-bf70-f634bb07547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:45.686741 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969033-e752-42e3-bf70-f634bb07547c admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:45.687073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969033-e752-42e3-bf70-f634bb07547c admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:45.687566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969033-e752-42e3-bf70-f634bb07547c admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:45.688334 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32969033-e752-42e3-bf70-f634bb07547c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:45.689973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32969033-e752-42e3-bf70-f634bb07547c admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:45.692319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:45.704889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1328/2670] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:36:45.711131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccef4e-b6b1-4d65-b64f-5e595a2bfedc service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:45.728524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccef4e-b6b1-4d65-b64f-5e595a2bfedc service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:45.733281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dfb59-4776-486a-8887-06e5b80eabee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:45.737614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dfb59-4776-486a-8887-06e5b80eabee admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:45.737614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dfb59-4776-486a-8887-06e5b80eabee admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:45.737614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dfb59-4776-486a-8887-06e5b80eabee admin admin] PATH_INFO: `/v3/projects/078d874db76141dea510ec614a5142aa/users/1329c44d88c648e89b40e7f44a231907/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:45.752761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dfb59-4776-486a-8887-06e5b80eabee admin admin] RBAC: Authorizing `identity:create_grant(project_id=078d874db76141dea510ec614a5142aa, user_id=1329c44d88c648e89b40e7f44a231907, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:45.759560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dfb59-4776-486a-8887-06e5b80eabee admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:45.864607 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1343/2671] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:45 2022] PUT /identity/v3/projects/078d874db76141dea510ec614a5142aa/users/1329c44d88c648e89b40e7f44a231907/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:45.874806 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d41d3-2812-43c4-b6ac-8f679f39352a None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:45.875240 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d41d3-2812-43c4-b6ac-8f679f39352a None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:45.875454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d41d3-2812-43c4-b6ac-8f679f39352a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:45.904748 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-1e1d41d3-2812-43c4-b6ac-8f679f39352a None None] MFA Rules not processed for user `1329c44d88c648e89b40e7f44a231907`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:45.906727 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1e1d41d3-2812-43c4-b6ac-8f679f39352a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:45.986769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1329/2672] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:45.991115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dfb59-4776-486a-8887-06e5b80eabee admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:46.052916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dfb59-4776-486a-8887-06e5b80eabee admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:46.057761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdc285-6fdb-4154-928f-27a056c742c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:46.058427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdc285-6fdb-4154-928f-27a056c742c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:46.058710 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdc285-6fdb-4154-928f-27a056c742c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:46.059017 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdc285-6fdb-4154-928f-27a056c742c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:46.059700 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdc285-6fdb-4154-928f-27a056c742c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:46.061622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdc285-6fdb-4154-928f-27a056c742c7 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:46.171639 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d41d3-2812-43c4-b6ac-8f679f39352a None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:46.173193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1e1d41d3-2812-43c4-b6ac-8f679f39352a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:46.185465 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1344/2673] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:45 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:46.189510 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdc285-6fdb-4154-928f-27a056c742c7 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:46.191777 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d41d3-2812-43c4-b6ac-8f679f39352a None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:46.258187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:46.259075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:46.259360 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:46.259636 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] PATH_INFO: `/v3/projects/bc0b69937f5948299f7b4fd7b947472d` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:46.259757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:46.261100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc0b69937f5948299f7b4fd7b947472d)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:46.263090 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:46.280471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdc285-6fdb-4154-928f-27a056c742c7 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:46.286709 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42ffbe-fde6-4cfc-ad03-fbcc69a14dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:46.287529 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42ffbe-fde6-4cfc-ad03-fbcc69a14dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:46.288225 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42ffbe-fde6-4cfc-ad03-fbcc69a14dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:46.288767 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42ffbe-fde6-4cfc-ad03-fbcc69a14dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:46.290233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42ffbe-fde6-4cfc-ad03-fbcc69a14dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:46.292288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42ffbe-fde6-4cfc-ad03-fbcc69a14dd9 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:46.374099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc0b69937f5948299f7b4fd7b947472d', 'request_id': 'req-5036fe83-f550-49fe-9f72-59e77c9ab617'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:46.407390 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1345/2674] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:46 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:46.408714 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42ffbe-fde6-4cfc-ad03-fbcc69a14dd9 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:46.419471 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42ffbe-fde6-4cfc-ad03-fbcc69a14dd9 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:46.458998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc0b69937f5948299f7b4fd7b947472d', 'request_id': 'req-5036fe83-f550-49fe-9f72-59e77c9ab617'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:46.468059 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc0b69937f5948299f7b4fd7b947472d', 'request_id': 'req-5036fe83-f550-49fe-9f72-59e77c9ab617'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:46.483025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] The token cache is being invalidate because project bc0b69937f5948299f7b4fd7b947472d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:46.483336 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:46.491191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a4bbc-9329-4b80-bb80-16a45ee1361b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:46.491365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:46.492019 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a4bbc-9329-4b80-bb80-16a45ee1361b admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:46.492377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a4bbc-9329-4b80-bb80-16a45ee1361b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:46.492725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a4bbc-9329-4b80-bb80-16a45ee1361b admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:46.493478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1330/2675] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:46 2022] DELETE /identity/v3/projects/bc0b69937f5948299f7b4fd7b947472d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:46.496324 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a4bbc-9329-4b80-bb80-16a45ee1361b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:46.497094 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:46.498194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a4bbc-9329-4b80-bb80-16a45ee1361b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:46.498591 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:46.510292 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1346/2676] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:46.514823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036fe83-f550-49fe-9f72-59e77c9ab617 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:46.520227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a4bbc-9329-4b80-bb80-16a45ee1361b admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:46.520398 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:46.521414 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:46.521803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:46.522183 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] PATH_INFO: `/v3/users/c88d511ec05c488daa219f24297b0f82` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:46.522359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0d8a4bbc-9329-4b80-bb80-16a45ee1361b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:46.524467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88d511ec05c488daa219f24297b0f82)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:46.525765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:46.536059 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a4bbc-9329-4b80-bb80-16a45ee1361b admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:46.541306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04923577-8fd2-4ac5-b39c-5a2ce3a40e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:46.542132 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:46.542288 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04923577-8fd2-4ac5-b39c-5a2ce3a40e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:46.542482 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04923577-8fd2-4ac5-b39c-5a2ce3a40e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:46.542762 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04923577-8fd2-4ac5-b39c-5a2ce3a40e8a admin admin] PATH_INFO: `/v3/projects/4ee17c3523314a0b800dbfad4003db86/users/dbd6d6b7c1424fcc853ae33a9c3d15aa/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:46.558611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04923577-8fd2-4ac5-b39c-5a2ce3a40e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee17c3523314a0b800dbfad4003db86, user_id=dbd6d6b7c1424fcc853ae33a9c3d15aa, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:46.561329 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04923577-8fd2-4ac5-b39c-5a2ce3a40e8a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:46.647659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1347/2677] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:46 2022] PUT /identity/v3/projects/4ee17c3523314a0b800dbfad4003db86/users/dbd6d6b7c1424fcc853ae33a9c3d15aa/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:46.651421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04923577-8fd2-4ac5-b39c-5a2ce3a40e8a admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:46.706941 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88d511ec05c488daa219f24297b0f82'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:46.715991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04923577-8fd2-4ac5-b39c-5a2ce3a40e8a admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:46.720903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41c490-abb5-4b26-98d1-39c37dc2d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:46.721616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41c490-abb5-4b26-98d1-39c37dc2d965 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:46.724292 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41c490-abb5-4b26-98d1-39c37dc2d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:46.724292 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41c490-abb5-4b26-98d1-39c37dc2d965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:46.724292 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41c490-abb5-4b26-98d1-39c37dc2d965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:46.724621 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41c490-abb5-4b26-98d1-39c37dc2d965 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:46.735162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1348/2678] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:36:46.739155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41c490-abb5-4b26-98d1-39c37dc2d965 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:46.749412 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41c490-abb5-4b26-98d1-39c37dc2d965 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:46.754714 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12418ac2-b802-4e6b-b2a2-ce60edb87423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:46.755588 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12418ac2-b802-4e6b-b2a2-ce60edb87423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:46.755877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12418ac2-b802-4e6b-b2a2-ce60edb87423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:46.756156 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12418ac2-b802-4e6b-b2a2-ce60edb87423 admin admin] PATH_INFO: `/v3/projects/4ee17c3523314a0b800dbfad4003db86/users/dbd6d6b7c1424fcc853ae33a9c3d15aa/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:46.758334 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12418ac2-b802-4e6b-b2a2-ce60edb87423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee17c3523314a0b800dbfad4003db86, user_id=dbd6d6b7c1424fcc853ae33a9c3d15aa, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:46.761067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12418ac2-b802-4e6b-b2a2-ce60edb87423 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:46.765809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88d511ec05c488daa219f24297b0f82'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:46.772295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1349/2679] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:46 2022] PUT /identity/v3/projects/4ee17c3523314a0b800dbfad4003db86/users/dbd6d6b7c1424fcc853ae33a9c3d15aa/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:46.782025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88d511ec05c488daa219f24297b0f82'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:46.782025 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88d511ec05c488daa219f24297b0f82'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:46.783889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b006e-ff8e-4386-8029-b6413ad285e4 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:46.784187 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b006e-ff8e-4386-8029-b6413ad285e4 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:46.784469 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b006e-ff8e-4386-8029-b6413ad285e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:46.789338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88d511ec05c488daa219f24297b0f82'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:46.796039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1331/2680] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:46 2022] DELETE /identity/v3/users/c88d511ec05c488daa219f24297b0f82 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:46.813821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-ea4b006e-ff8e-4386-8029-b6413ad285e4 None None] MFA Rules not processed for user `dbd6d6b7c1424fcc853ae33a9c3d15aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:46.815043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ea4b006e-ff8e-4386-8029-b6413ad285e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:46.830292 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:46.893521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1350/2681] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:46.904624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:46.906708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:46.966553 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d53e-3ad6-4f64-848b-8fdca17c53b3 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:46.970837 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3c2dc-ac30-4223-bf0e-bfb14ac2a5ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:46.972448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3c2dc-ac30-4223-bf0e-bfb14ac2a5ca service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:46.972448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3c2dc-ac30-4223-bf0e-bfb14ac2a5ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:46.972448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3c2dc-ac30-4223-bf0e-bfb14ac2a5ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:46.983401 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3c2dc-ac30-4223-bf0e-bfb14ac2a5ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:46.985504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3c2dc-ac30-4223-bf0e-bfb14ac2a5ca service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:46.996135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1332/2682] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:47.449644 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b006e-ff8e-4386-8029-b6413ad285e4 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:47.455247 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-ea4b006e-ff8e-4386-8029-b6413ad285e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:47.533388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b006e-ff8e-4386-8029-b6413ad285e4 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:47.538146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:47.539266 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:47.539817 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:47.540094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] PATH_INFO: `/v3/projects/f92c1b56ed3e41f58d08ce965e1e3648` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:47.541608 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92c1b56ed3e41f58d08ce965e1e3648)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:47.543523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:47.667159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92c1b56ed3e41f58d08ce965e1e3648', 'request_id': 'req-7e38dee4-f328-43d9-8f5c-e943642627b7'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:47.743408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92c1b56ed3e41f58d08ce965e1e3648', 'request_id': 'req-7e38dee4-f328-43d9-8f5c-e943642627b7'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:47.752301 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92c1b56ed3e41f58d08ce965e1e3648', 'request_id': 'req-7e38dee4-f328-43d9-8f5c-e943642627b7'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:47.766869 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] The token cache is being invalidate because project f92c1b56ed3e41f58d08ce965e1e3648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:47.767177 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:47.767924 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:47.769983 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1351/2683] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:47 2022] DELETE /identity/v3/projects/f92c1b56ed3e41f58d08ce965e1e3648 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:47.773889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3c2dc-ac30-4223-bf0e-bfb14ac2a5ca service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:47.787508 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3c2dc-ac30-4223-bf0e-bfb14ac2a5ca service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:47.882186 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:47.883132 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:47.883421 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:47.883699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] PATH_INFO: `/v3/users/cc4fbb645ca3473694be35ba79928ded` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:47.885163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4fbb645ca3473694be35ba79928ded)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:47.887157 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:48.069857 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:48.087361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4fbb645ca3473694be35ba79928ded'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.177905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4fbb645ca3473694be35ba79928ded'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.196117 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4fbb645ca3473694be35ba79928ded'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.196864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4fbb645ca3473694be35ba79928ded'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.204095 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4fbb645ca3473694be35ba79928ded'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.211017 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1333/2684] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:47 2022] DELETE /identity/v3/users/cc4fbb645ca3473694be35ba79928ded => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:48.261734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:48.263426 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:48.279495 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38dee4-f328-43d9-8f5c-e943642627b7 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:48.330270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:48.350115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3500b-3501-42d4-8c5c-d61a046f8e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:48.351052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3500b-3501-42d4-8c5c-d61a046f8e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:48.351285 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3500b-3501-42d4-8c5c-d61a046f8e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:48.351557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3500b-3501-42d4-8c5c-d61a046f8e4c admin admin] PATH_INFO: `/v3/users/1329c44d88c648e89b40e7f44a231907` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:48.352743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3500b-3501-42d4-8c5c-d61a046f8e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1329c44d88c648e89b40e7f44a231907)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:48.354873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3500b-3501-42d4-8c5c-d61a046f8e4c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:48.587922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bef3500b-3501-42d4-8c5c-d61a046f8e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1329c44d88c648e89b40e7f44a231907'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.690014 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bef3500b-3501-42d4-8c5c-d61a046f8e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1329c44d88c648e89b40e7f44a231907'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.691086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bef3500b-3501-42d4-8c5c-d61a046f8e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1329c44d88c648e89b40e7f44a231907'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.697412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:48.699053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:48.708258 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bef3500b-3501-42d4-8c5c-d61a046f8e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1329c44d88c648e89b40e7f44a231907'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.719683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a706d-8ea2-459a-b035-eb26750ece23 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:48.728923 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-bef3500b-3501-42d4-8c5c-d61a046f8e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1329c44d88c648e89b40e7f44a231907'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.736523 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eda02-8f81-4879-9df6-269f9433a3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:48.737468 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eda02-8f81-4879-9df6-269f9433a3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:48.738040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eda02-8f81-4879-9df6-269f9433a3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:48.738327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eda02-8f81-4879-9df6-269f9433a3ca admin admin] PATH_INFO: `/v3/projects/8bbae7c69c8544408c6014c1e4e3c0ca` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:48.739754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1eda02-8f81-4879-9df6-269f9433a3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bbae7c69c8544408c6014c1e4e3c0ca)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:48.743271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1eda02-8f81-4879-9df6-269f9433a3ca admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:48.751940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1352/2685] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:48 2022] DELETE /identity/v3/users/1329c44d88c648e89b40e7f44a231907 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:48.758828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6faf-e781-47bd-87a4-a67f4d4467fa None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:48.758828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6faf-e781-47bd-87a4-a67f4d4467fa None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:48.758828 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f6faf-e781-47bd-87a4-a67f4d4467fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:48.781310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-c70f6faf-e781-47bd-87a4-a67f4d4467fa None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:48.781310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c70f6faf-e781-47bd-87a4-a67f4d4467fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:48.844504 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1353/2686] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:36:48.853878 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6faf-e781-47bd-87a4-a67f4d4467fa None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:48.855477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c70f6faf-e781-47bd-87a4-a67f4d4467fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:48.875874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7d1eda02-8f81-4879-9df6-269f9433a3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bbae7c69c8544408c6014c1e4e3c0ca', 'request_id': 'req-7d1eda02-8f81-4879-9df6-269f9433a3ca'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.919453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f6faf-e781-47bd-87a4-a67f4d4467fa None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:48.937454 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7d1eda02-8f81-4879-9df6-269f9433a3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bbae7c69c8544408c6014c1e4e3c0ca', 'request_id': 'req-7d1eda02-8f81-4879-9df6-269f9433a3ca'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.951684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7d1eda02-8f81-4879-9df6-269f9433a3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bbae7c69c8544408c6014c1e4e3c0ca', 'request_id': 'req-7d1eda02-8f81-4879-9df6-269f9433a3ca'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.966262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7d1eda02-8f81-4879-9df6-269f9433a3ca admin admin] The token cache is being invalidate because project 8bbae7c69c8544408c6014c1e4e3c0ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:48.966655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7d1eda02-8f81-4879-9df6-269f9433a3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.969481 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7d1eda02-8f81-4879-9df6-269f9433a3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:48.971256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d42079-c9f2-4ef8-a22b-35edaa081ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:48.971943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1334/2687] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:48 2022] DELETE /identity/v3/projects/8bbae7c69c8544408c6014c1e4e3c0ca => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:48.975375 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d42079-c9f2-4ef8-a22b-35edaa081ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:48.986603 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d42079-c9f2-4ef8-a22b-35edaa081ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:48.986603 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d42079-c9f2-4ef8-a22b-35edaa081ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:48.988207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ab3db-f8a4-464a-90d8-3878f7f03845 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:48.988207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ab3db-f8a4-464a-90d8-3878f7f03845 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:48.988207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ab3db-f8a4-464a-90d8-3878f7f03845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:48.988464 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-91d42079-c9f2-4ef8-a22b-35edaa081ba0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:49.010470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-7b7ab3db-f8a4-464a-90d8-3878f7f03845 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:49.011772 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-7b7ab3db-f8a4-464a-90d8-3878f7f03845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:49.070945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d42079-c9f2-4ef8-a22b-35edaa081ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:49.072675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d42079-c9f2-4ef8-a22b-35edaa081ba0 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:49.091190 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1354/2688] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:36:49.106391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1335/2689] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:36:49.114654 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449eb612-800e-4a28-bd87-f8053d6d4953 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:49.120893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449eb612-800e-4a28-bd87-f8053d6d4953 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:49.120893 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449eb612-800e-4a28-bd87-f8053d6d4953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:49.137247 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-449eb612-800e-4a28-bd87-f8053d6d4953 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:49.138959 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-449eb612-800e-4a28-bd87-f8053d6d4953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:49.152332 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1355/2690] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:36:49.157130 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ab3db-f8a4-464a-90d8-3878f7f03845 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:49.169924 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ab3db-f8a4-464a-90d8-3878f7f03845 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:49.176355 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afc72e-d0d6-462d-8eee-b78511da96a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:49.177033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afc72e-d0d6-462d-8eee-b78511da96a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:49.178085 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afc72e-d0d6-462d-8eee-b78511da96a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:49.178379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afc72e-d0d6-462d-8eee-b78511da96a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:49.179128 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afc72e-d0d6-462d-8eee-b78511da96a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:36:49.179435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afc72e-d0d6-462d-8eee-b78511da96a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:49.184648 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afc72e-d0d6-462d-8eee-b78511da96a9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:49.201415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1336/2691] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:36:49.203077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449eb612-800e-4a28-bd87-f8053d6d4953 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:49.212425 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449eb612-800e-4a28-bd87-f8053d6d4953 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:49.217460 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5eee86-a616-474b-9e38-46a7fb625426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:49.219008 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5eee86-a616-474b-9e38-46a7fb625426 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:49.219290 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5eee86-a616-474b-9e38-46a7fb625426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:49.219565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5eee86-a616-474b-9e38-46a7fb625426 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:49.220456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5eee86-a616-474b-9e38-46a7fb625426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:49.222159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5eee86-a616-474b-9e38-46a7fb625426 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:49.351889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1356/2692] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:49 2022] POST /identity/v3/projects => generated 391 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:49.353031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afc72e-d0d6-462d-8eee-b78511da96a9 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:49.363450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afc72e-d0d6-462d-8eee-b78511da96a9 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:49.385433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:49.423290 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:49.434704 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b24cd-9c5d-455a-a9cd-1cf12a197616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:49.435485 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b24cd-9c5d-455a-a9cd-1cf12a197616 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:49.435719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b24cd-9c5d-455a-a9cd-1cf12a197616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:49.436003 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b24cd-9c5d-455a-a9cd-1cf12a197616 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:49.436707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b24cd-9c5d-455a-a9cd-1cf12a197616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:49.440226 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b24cd-9c5d-455a-a9cd-1cf12a197616 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:49.524820 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1337/2693] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:49 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:49.529047 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5eee86-a616-474b-9e38-46a7fb625426 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:49.545135 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5eee86-a616-474b-9e38-46a7fb625426 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:49.558913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57bb0e-b073-424a-8ebf-dc4bf01781c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:49.559751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57bb0e-b073-424a-8ebf-dc4bf01781c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:49.560102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57bb0e-b073-424a-8ebf-dc4bf01781c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:49.560538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57bb0e-b073-424a-8ebf-dc4bf01781c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:49.561643 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57bb0e-b073-424a-8ebf-dc4bf01781c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:49.566003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57bb0e-b073-424a-8ebf-dc4bf01781c7 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:49.585134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1357/2694] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:49.589374 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b24cd-9c5d-455a-a9cd-1cf12a197616 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:49.601088 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b24cd-9c5d-455a-a9cd-1cf12a197616 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:49.615906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbb8a8-f164-4fd5-854f-4a723a1969b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:49.616710 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbb8a8-f164-4fd5-854f-4a723a1969b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:49.617075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbb8a8-f164-4fd5-854f-4a723a1969b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:49.617548 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbb8a8-f164-4fd5-854f-4a723a1969b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:49.618405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbb8a8-f164-4fd5-854f-4a723a1969b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:49.620286 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbb8a8-f164-4fd5-854f-4a723a1969b3 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:49.632716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1338/2695] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:49.636998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57bb0e-b073-424a-8ebf-dc4bf01781c7 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:49.650307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57bb0e-b073-424a-8ebf-dc4bf01781c7 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:49.655887 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da2a4b-61b2-4a6b-83e7-943f393e7aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:49.656913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da2a4b-61b2-4a6b-83e7-943f393e7aad admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:49.657343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da2a4b-61b2-4a6b-83e7-943f393e7aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:49.657742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da2a4b-61b2-4a6b-83e7-943f393e7aad admin admin] PATH_INFO: `/v3/projects/1f6af6282e164e83b464c1334b364fd0/users/b2dc76e4e25a41c695f8a8b34f151f74/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:49.676081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da2a4b-61b2-4a6b-83e7-943f393e7aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6af6282e164e83b464c1334b364fd0, user_id=b2dc76e4e25a41c695f8a8b34f151f74, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:49.678565 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da2a4b-61b2-4a6b-83e7-943f393e7aad admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:49.727655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbb8a8-f164-4fd5-854f-4a723a1969b3 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:49.732354 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-eabbb8a8-f164-4fd5-854f-4a723a1969b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:49.744958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbb8a8-f164-4fd5-854f-4a723a1969b3 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:49.754670 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:49.755559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:49.755847 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:49.756123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] PATH_INFO: `/v3/projects/078d874db76141dea510ec614a5142aa` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:49.757406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] RBAC: Authorizing `identity:delete_project(project_id=078d874db76141dea510ec614a5142aa)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:49.758570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1358/2696] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:49 2022] PUT /identity/v3/projects/1f6af6282e164e83b464c1334b364fd0/users/b2dc76e4e25a41c695f8a8b34f151f74/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:49.761199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:49.773000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b13e35-bfe0-42e6-87c5-4e9c0e1f9b85 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:49.773000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b13e35-bfe0-42e6-87c5-4e9c0e1f9b85 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:49.773000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b13e35-bfe0-42e6-87c5-4e9c0e1f9b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:49.807699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-64b13e35-bfe0-42e6-87c5-4e9c0e1f9b85 None None] MFA Rules not processed for user `b2dc76e4e25a41c695f8a8b34f151f74`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:49.808826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-64b13e35-bfe0-42e6-87c5-4e9c0e1f9b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:49.873141 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1359/2697] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:49.884578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b13e35-bfe0-42e6-87c5-4e9c0e1f9b85 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:49.886000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-64b13e35-bfe0-42e6-87c5-4e9c0e1f9b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:49.939525 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078d874db76141dea510ec614a5142aa', 'request_id': 'req-3f465373-85ab-4064-b033-dfc52d78506f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:49.959585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b13e35-bfe0-42e6-87c5-4e9c0e1f9b85 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:50.021791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c10855-0879-485f-91b5-3053360cca6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:50.022524 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c10855-0879-485f-91b5-3053360cca6e service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:50.022814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c10855-0879-485f-91b5-3053360cca6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:50.023093 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c10855-0879-485f-91b5-3053360cca6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:50.038874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078d874db76141dea510ec614a5142aa', 'request_id': 'req-3f465373-85ab-4064-b033-dfc52d78506f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.048511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078d874db76141dea510ec614a5142aa', 'request_id': 'req-3f465373-85ab-4064-b033-dfc52d78506f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.059881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] The token cache is being invalidate because project 078d874db76141dea510ec614a5142aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:50.060171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.060837 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.062721 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1339/2698] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:49 2022] DELETE /identity/v3/projects/078d874db76141dea510ec614a5142aa => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:50.066225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:50.067543 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:50.087559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c10855-0879-485f-91b5-3053360cca6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:50.087559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c10855-0879-485f-91b5-3053360cca6e service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:50.097513 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1360/2699] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:36:50.144699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f465373-85ab-4064-b033-dfc52d78506f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:50.150283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:50.151702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:50.152060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:50.152395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] PATH_INFO: `/v3/users/dbd6d6b7c1424fcc853ae33a9c3d15aa` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:50.153947 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd6d6b7c1424fcc853ae33a9c3d15aa)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:50.156537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:50.276616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c10855-0879-485f-91b5-3053360cca6e service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:50.278320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a2c10855-0879-485f-91b5-3053360cca6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:50.293369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c10855-0879-485f-91b5-3053360cca6e service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:50.298751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:50.300254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:50.300254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:50.300254 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] PATH_INFO: `/v3/users/69b42355f861405898d6c4af8f24a75a` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:50.301415 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b42355f861405898d6c4af8f24a75a)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:50.303330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:50.387235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:50.513236 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd6d6b7c1424fcc853ae33a9c3d15aa'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.530051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:50.599544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b42355f861405898d6c4af8f24a75a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.614532 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd6d6b7c1424fcc853ae33a9c3d15aa'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.628603 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd6d6b7c1424fcc853ae33a9c3d15aa'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.629399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd6d6b7c1424fcc853ae33a9c3d15aa'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.637940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd6d6b7c1424fcc853ae33a9c3d15aa'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.644376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1340/2700] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:50 2022] DELETE /identity/v3/users/dbd6d6b7c1424fcc853ae33a9c3d15aa => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:50.740544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b42355f861405898d6c4af8f24a75a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.741206 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b42355f861405898d6c4af8f24a75a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.753920 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b42355f861405898d6c4af8f24a75a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.760688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b42355f861405898d6c4af8f24a75a'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:50.767210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1361/2701] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:50 2022] DELETE /identity/v3/users/69b42355f861405898d6c4af8f24a75a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:51.102069 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:51.104730 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:51.169779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:51.169779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:51.175878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c20af6-b47d-466e-8700-2d0cd3dace97 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:51.192064 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:51.236682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:51.237578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:51.237895 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:51.238171 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] PATH_INFO: `/v3/projects/e1701b12b86645c482964c83f5cf7cc7` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:51.240671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1701b12b86645c482964c83f5cf7cc7)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:51.242608 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:51.248468 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bea809-2afb-4620-bd94-6679659f8ff4 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:51.253763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7e366-3b40-486d-9c15-e6bd512d61e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:51.254629 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e366-3b40-486d-9c15-e6bd512d61e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:51.254913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e366-3b40-486d-9c15-e6bd512d61e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:51.255195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e366-3b40-486d-9c15-e6bd512d61e0 admin admin] PATH_INFO: `/v3/projects/4ee17c3523314a0b800dbfad4003db86` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:51.256427 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7e366-3b40-486d-9c15-e6bd512d61e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee17c3523314a0b800dbfad4003db86)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:51.258374 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7e366-3b40-486d-9c15-e6bd512d61e0 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:51.376625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1701b12b86645c482964c83f5cf7cc7', 'request_id': 'req-32f7693e-e40c-40a9-80ec-250e9fbb2054'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.379121 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:51.410238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0aa7e366-3b40-486d-9c15-e6bd512d61e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee17c3523314a0b800dbfad4003db86', 'request_id': 'req-0aa7e366-3b40-486d-9c15-e6bd512d61e0'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.445683 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1701b12b86645c482964c83f5cf7cc7', 'request_id': 'req-32f7693e-e40c-40a9-80ec-250e9fbb2054'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.452733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1701b12b86645c482964c83f5cf7cc7', 'request_id': 'req-32f7693e-e40c-40a9-80ec-250e9fbb2054'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.465449 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] The token cache is being invalidate because project e1701b12b86645c482964c83f5cf7cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:51.465746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.466406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.467952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1341/2702] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:51 2022] DELETE /identity/v3/projects/e1701b12b86645c482964c83f5cf7cc7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:51.471712 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:51.473141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:51.497225 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0aa7e366-3b40-486d-9c15-e6bd512d61e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee17c3523314a0b800dbfad4003db86', 'request_id': 'req-0aa7e366-3b40-486d-9c15-e6bd512d61e0'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.503866 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0aa7e366-3b40-486d-9c15-e6bd512d61e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee17c3523314a0b800dbfad4003db86', 'request_id': 'req-0aa7e366-3b40-486d-9c15-e6bd512d61e0'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.515734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0aa7e366-3b40-486d-9c15-e6bd512d61e0 admin admin] The token cache is being invalidate because project 4ee17c3523314a0b800dbfad4003db86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:51.516103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0aa7e366-3b40-486d-9c15-e6bd512d61e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.516816 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0aa7e366-3b40-486d-9c15-e6bd512d61e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.518394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1362/2703] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:51 2022] DELETE /identity/v3/projects/4ee17c3523314a0b800dbfad4003db86 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:51.523338 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc89a6-cabe-4a9d-ac83-fe7a9a12e9f3 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:51.523753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc89a6-cabe-4a9d-ac83-fe7a9a12e9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:51.526287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc89a6-cabe-4a9d-ac83-fe7a9a12e9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:51.537992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7693e-e40c-40a9-80ec-250e9fbb2054 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:51.543945 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-8cfc89a6-cabe-4a9d-ac83-fe7a9a12e9f3 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:51.545188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8cfc89a6-cabe-4a9d-ac83-fe7a9a12e9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:51.594277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:51.595161 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:51.595460 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:51.595734 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] PATH_INFO: `/v3/users/c451fe6d0ce144bd9865f5a1b3b882b1` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:51.596975 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c451fe6d0ce144bd9865f5a1b3b882b1)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:51.598936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:51.604918 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1363/2704] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:51.613393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51139-eaf2-450e-ac9a-c3d5ed10d5cc None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:51.613903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51139-eaf2-450e-ac9a-c3d5ed10d5cc None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:51.614185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51139-eaf2-450e-ac9a-c3d5ed10d5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:51.632073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-54b51139-eaf2-450e-ac9a-c3d5ed10d5cc None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:51.635253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-54b51139-eaf2-450e-ac9a-c3d5ed10d5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:51.641875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1364/2705] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:36:51.645784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b51139-eaf2-450e-ac9a-c3d5ed10d5cc None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:51.654381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b51139-eaf2-450e-ac9a-c3d5ed10d5cc None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:51.659388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fa71b-82d2-49bd-a35c-72d075303aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:51.662220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fa71b-82d2-49bd-a35c-72d075303aac admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:51.662220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fa71b-82d2-49bd-a35c-72d075303aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:51.662220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fa71b-82d2-49bd-a35c-72d075303aac admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:51.662220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fa71b-82d2-49bd-a35c-72d075303aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:36:51.662220 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fa71b-82d2-49bd-a35c-72d075303aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:51.663146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fa71b-82d2-49bd-a35c-72d075303aac admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:51.675219 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1365/2706] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:36:51.679229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fa71b-82d2-49bd-a35c-72d075303aac admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:51.688265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fa71b-82d2-49bd-a35c-72d075303aac admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:51.692755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aa7db-c0e3-45d7-afb2-79293950190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:51.693382 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa7db-c0e3-45d7-afb2-79293950190e admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:51.693664 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa7db-c0e3-45d7-afb2-79293950190e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:51.693940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa7db-c0e3-45d7-afb2-79293950190e admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:51.694598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aa7db-c0e3-45d7-afb2-79293950190e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:51.696483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aa7db-c0e3-45d7-afb2-79293950190e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:51.798746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c451fe6d0ce144bd9865f5a1b3b882b1'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.802571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1366/2707] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:51 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:36:51.806634 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aa7db-c0e3-45d7-afb2-79293950190e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:51.866286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aa7db-c0e3-45d7-afb2-79293950190e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:51.871071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8600b-2595-4d17-a57d-fe4d1f47a2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:51.871737 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8600b-2595-4d17-a57d-fe4d1f47a2fb admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:51.872024 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8600b-2595-4d17-a57d-fe4d1f47a2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:51.872302 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8600b-2595-4d17-a57d-fe4d1f47a2fb admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:51.873000 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8600b-2595-4d17-a57d-fe4d1f47a2fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:51.874997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8600b-2595-4d17-a57d-fe4d1f47a2fb admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:51.901184 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c451fe6d0ce144bd9865f5a1b3b882b1'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.901306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:51.915005 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c451fe6d0ce144bd9865f5a1b3b882b1'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.915823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c451fe6d0ce144bd9865f5a1b3b882b1'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.923538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c451fe6d0ce144bd9865f5a1b3b882b1'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:51.929624 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1342/2708] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:51 2022] DELETE /identity/v3/users/c451fe6d0ce144bd9865f5a1b3b882b1 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:36:52.004456 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1367/2709] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:51 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:36:52.009375 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:52.010940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:52.050550 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:52.129785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8af892-ca46-498d-a83f-8a540747e7ec admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:52.134461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585e758-2cc7-4ed3-8638-80083109f80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:52.135179 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585e758-2cc7-4ed3-8638-80083109f80b admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:52.135467 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585e758-2cc7-4ed3-8638-80083109f80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:52.135742 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585e758-2cc7-4ed3-8638-80083109f80b admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:52.136458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585e758-2cc7-4ed3-8638-80083109f80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:52.138096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585e758-2cc7-4ed3-8638-80083109f80b admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:52.148139 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1343/2710] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:52.152368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8600b-2595-4d17-a57d-fe4d1f47a2fb admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:52.198158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585e758-2cc7-4ed3-8638-80083109f80b admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:52.200055 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-3585e758-2cc7-4ed3-8638-80083109f80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:52.204493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8600b-2595-4d17-a57d-fe4d1f47a2fb admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:52.209445 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9784420-24df-4ca5-bfab-a0564ffcecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:52.210158 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9784420-24df-4ca5-bfab-a0564ffcecd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:52.210579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9784420-24df-4ca5-bfab-a0564ffcecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:52.210797 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9784420-24df-4ca5-bfab-a0564ffcecd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:52.211424 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9784420-24df-4ca5-bfab-a0564ffcecd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:52.213051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9784420-24df-4ca5-bfab-a0564ffcecd3 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:52.214656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585e758-2cc7-4ed3-8638-80083109f80b admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:52.220536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:52.221571 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:52.221968 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:52.222351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] PATH_INFO: `/v3/projects/0a361dd523264c73bb2ebd41ab4599ff` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:52.223671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a361dd523264c73bb2ebd41ab4599ff)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:52.228743 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:52.228911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1368/2711] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:52.229840 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9784420-24df-4ca5-bfab-a0564ffcecd3 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:52.246582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9784420-24df-4ca5-bfab-a0564ffcecd3 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:52.251532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b16ed-aac0-455d-b42f-0155c85b6291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:52.252411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b16ed-aac0-455d-b42f-0155c85b6291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:52.252695 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b16ed-aac0-455d-b42f-0155c85b6291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:52.252973 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b16ed-aac0-455d-b42f-0155c85b6291 admin admin] PATH_INFO: `/v3/projects/690b1b7b50594c559cbc2eada4f810a7/users/076ffdd49ebc4969ae9d4964d124a697/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:52.268070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b16ed-aac0-455d-b42f-0155c85b6291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=690b1b7b50594c559cbc2eada4f810a7, user_id=076ffdd49ebc4969ae9d4964d124a697, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:52.270763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b16ed-aac0-455d-b42f-0155c85b6291 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:52.395492 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1369/2712] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:52 2022] PUT /identity/v3/projects/690b1b7b50594c559cbc2eada4f810a7/users/076ffdd49ebc4969ae9d4964d124a697/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:52.403642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a361dd523264c73bb2ebd41ab4599ff', 'request_id': 'req-f48409b9-69f2-445a-82dd-15863782141e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:52.406739 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd785e-e782-4225-a36d-4e95313fb3d5 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:52.407105 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd785e-e782-4225-a36d-4e95313fb3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:52.407453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd785e-e782-4225-a36d-4e95313fb3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:52.433280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-efdd785e-e782-4225-a36d-4e95313fb3d5 None None] MFA Rules not processed for user `076ffdd49ebc4969ae9d4964d124a697`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:52.434486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-efdd785e-e782-4225-a36d-4e95313fb3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:52.459551 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:52.511878 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1370/2713] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:36:52.514352 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a361dd523264c73bb2ebd41ab4599ff', 'request_id': 'req-f48409b9-69f2-445a-82dd-15863782141e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:52.517825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd785e-e782-4225-a36d-4e95313fb3d5 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:52.522928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a361dd523264c73bb2ebd41ab4599ff', 'request_id': 'req-f48409b9-69f2-445a-82dd-15863782141e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:52.533610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] The token cache is being invalidate because project 0a361dd523264c73bb2ebd41ab4599ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:52.533901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:52.534572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:52.536583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1344/2714] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:52 2022] DELETE /identity/v3/projects/0a361dd523264c73bb2ebd41ab4599ff => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:52.586990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd785e-e782-4225-a36d-4e95313fb3d5 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:52.591888 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c0395-ba34-4fd2-97be-c77c523b1f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:52.592650 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c0395-ba34-4fd2-97be-c77c523b1f6b admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:52.593167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c0395-ba34-4fd2-97be-c77c523b1f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:52.593514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c0395-ba34-4fd2-97be-c77c523b1f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:52.594287 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c0395-ba34-4fd2-97be-c77c523b1f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:52.597073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c0395-ba34-4fd2-97be-c77c523b1f6b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:52.706537 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1371/2715] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:52 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:52.707882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:52.709395 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:52.723359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48409b9-69f2-445a-82dd-15863782141e admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:52.770971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:52.786561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a41fe-b8a9-47d5-878d-8f3f84718629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:52.787252 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a41fe-b8a9-47d5-878d-8f3f84718629 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:52.787536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a41fe-b8a9-47d5-878d-8f3f84718629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:52.787812 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a41fe-b8a9-47d5-878d-8f3f84718629 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:52.788524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a41fe-b8a9-47d5-878d-8f3f84718629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:52.790743 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a41fe-b8a9-47d5-878d-8f3f84718629 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:52.872079 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1345/2716] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:52 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:36:52.876031 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c0395-ba34-4fd2-97be-c77c523b1f6b admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:52.886307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c0395-ba34-4fd2-97be-c77c523b1f6b admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:52.891491 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3382ec-1136-47db-b971-256d058be0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:52.892145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3382ec-1136-47db-b971-256d058be0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:52.892434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3382ec-1136-47db-b971-256d058be0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:52.892711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3382ec-1136-47db-b971-256d058be0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:52.893517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3382ec-1136-47db-b971-256d058be0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:52.895168 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3382ec-1136-47db-b971-256d058be0c3 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:52.906375 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1372/2717] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:52.910512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a41fe-b8a9-47d5-878d-8f3f84718629 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:52.920887 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a41fe-b8a9-47d5-878d-8f3f84718629 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:52.925874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa95891-14ec-4c16-abc1-15fff010fe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:52.928180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa95891-14ec-4c16-abc1-15fff010fe21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:52.928180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa95891-14ec-4c16-abc1-15fff010fe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:52.928180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa95891-14ec-4c16-abc1-15fff010fe21 admin admin] PATH_INFO: `/v3/projects/51d6a312376b4b31963261df3e1b117e/users/bb5df5d38d7248c499e717de35e527d3/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:52.942299 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa95891-14ec-4c16-abc1-15fff010fe21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d6a312376b4b31963261df3e1b117e, user_id=bb5df5d38d7248c499e717de35e527d3, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:52.944951 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa95891-14ec-4c16-abc1-15fff010fe21 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:53.032840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1346/2718] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:52 2022] PUT /identity/v3/projects/51d6a312376b4b31963261df3e1b117e/users/bb5df5d38d7248c499e717de35e527d3/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:53.036799 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3382ec-1136-47db-b971-256d058be0c3 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:53.046989 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3382ec-1136-47db-b971-256d058be0c3 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:53.102393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685aa69-af62-463c-989c-cd74558fbeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:53.103055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685aa69-af62-463c-989c-cd74558fbeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:53.103343 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685aa69-af62-463c-989c-cd74558fbeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:53.103616 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685aa69-af62-463c-989c-cd74558fbeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:53.104335 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685aa69-af62-463c-989c-cd74558fbeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:53.106018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685aa69-af62-463c-989c-cd74558fbeb6 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:53.115680 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1373/2719] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:53.119952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa95891-14ec-4c16-abc1-15fff010fe21 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:53.130714 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa95891-14ec-4c16-abc1-15fff010fe21 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:53.135882 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ee3f2-0860-4cf1-831c-deba1946c98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:53.139453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ee3f2-0860-4cf1-831c-deba1946c98f admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:53.139453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ee3f2-0860-4cf1-831c-deba1946c98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:53.139453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ee3f2-0860-4cf1-831c-deba1946c98f admin admin] PATH_INFO: `/v3/projects/51d6a312376b4b31963261df3e1b117e/users/bb5df5d38d7248c499e717de35e527d3/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:53.139453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ee3f2-0860-4cf1-831c-deba1946c98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d6a312376b4b31963261df3e1b117e, user_id=bb5df5d38d7248c499e717de35e527d3, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:53.142536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ee3f2-0860-4cf1-831c-deba1946c98f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:53.152963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1347/2720] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:53 2022] PUT /identity/v3/projects/51d6a312376b4b31963261df3e1b117e/users/bb5df5d38d7248c499e717de35e527d3/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:53.163221 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a643e-1930-44e5-bdb3-eea88f138226 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:53.163512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a643e-1930-44e5-bdb3-eea88f138226 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:53.163792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a643e-1930-44e5-bdb3-eea88f138226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:53.190325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-574a643e-1930-44e5-bdb3-eea88f138226 None None] MFA Rules not processed for user `bb5df5d38d7248c499e717de35e527d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:53.191535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-574a643e-1930-44e5-bdb3-eea88f138226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:53.204559 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:53.258643 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1374/2721] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:53.270053 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ee3f2-0860-4cf1-831c-deba1946c98f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:53.276995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a83ee3f2-0860-4cf1-831c-deba1946c98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:53.344673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ee3f2-0860-4cf1-831c-deba1946c98f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:53.348387 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa011bb-d234-4694-bcdb-fd864996de26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:53.349031 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa011bb-d234-4694-bcdb-fd864996de26 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:53.349335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa011bb-d234-4694-bcdb-fd864996de26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:53.349612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa011bb-d234-4694-bcdb-fd864996de26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:53.358538 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa011bb-d234-4694-bcdb-fd864996de26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:53.359964 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa011bb-d234-4694-bcdb-fd864996de26 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:53.369378 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1348/2722] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:53.966295 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a643e-1930-44e5-bdb3-eea88f138226 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:54.028272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a643e-1930-44e5-bdb3-eea88f138226 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:54.033615 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:54.034535 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:54.034826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:54.035108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] PATH_INFO: `/v3/users/076ffdd49ebc4969ae9d4964d124a697` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:54.036459 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=076ffdd49ebc4969ae9d4964d124a697)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:54.038533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:54.260228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076ffdd49ebc4969ae9d4964d124a697'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:54.383002 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076ffdd49ebc4969ae9d4964d124a697'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:54.383612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076ffdd49ebc4969ae9d4964d124a697'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:54.396627 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076ffdd49ebc4969ae9d4964d124a697'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:54.403367 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076ffdd49ebc4969ae9d4964d124a697'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:54.410757 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1375/2723] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:53 2022] DELETE /identity/v3/users/076ffdd49ebc4969ae9d4964d124a697 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:54.416662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d50e-6b08-4225-9186-bc4c9e25134b None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:54.417291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d50e-6b08-4225-9186-bc4c9e25134b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:54.417814 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d50e-6b08-4225-9186-bc4c9e25134b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:54.447631 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-93e4d50e-6b08-4225-9186-bc4c9e25134b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:54.448936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-93e4d50e-6b08-4225-9186-bc4c9e25134b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:54.520408 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1349/2724] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:54.532887 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:54.536568 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:54.572548 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:54.596719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408173-2a26-42df-9655-52a191ec5530 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:54.600299 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b9e3d-ee95-4bed-affc-0254da082e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:54.600949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b9e3d-ee95-4bed-affc-0254da082e42 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:54.601268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b9e3d-ee95-4bed-affc-0254da082e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:54.601548 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b9e3d-ee95-4bed-affc-0254da082e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:54.610521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b9e3d-ee95-4bed-affc-0254da082e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:54.612110 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b9e3d-ee95-4bed-affc-0254da082e42 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:54.622155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1376/2725] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:36:55.019948 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4d50e-6b08-4225-9186-bc4c9e25134b None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:55.021697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-93e4d50e-6b08-4225-9186-bc4c9e25134b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:55.036506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4d50e-6b08-4225-9186-bc4c9e25134b None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:55.041583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:55.042445 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:55.045254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:55.045254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] PATH_INFO: `/v3/projects/690b1b7b50594c559cbc2eada4f810a7` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:55.045254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] RBAC: Authorizing `identity:delete_project(project_id=690b1b7b50594c559cbc2eada4f810a7)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:55.046453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:55.058622 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:55.187987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690b1b7b50594c559cbc2eada4f810a7', 'request_id': 'req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:55.279914 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690b1b7b50594c559cbc2eada4f810a7', 'request_id': 'req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:55.287609 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690b1b7b50594c559cbc2eada4f810a7', 'request_id': 'req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:55.298346 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] The token cache is being invalidate because project 690b1b7b50594c559cbc2eada4f810a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:55.298629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:55.299264 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:55.303199 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1350/2726] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:55 2022] DELETE /identity/v3/projects/690b1b7b50594c559cbc2eada4f810a7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:55.310042 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b9e3d-ee95-4bed-affc-0254da082e42 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:55.322069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b9e3d-ee95-4bed-affc-0254da082e42 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:55.380325 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55220e-04b1-4f59-bc09-a7d4a461bc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:55.381248 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55220e-04b1-4f59-bc09-a7d4a461bc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:55.381532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55220e-04b1-4f59-bc09-a7d4a461bc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:55.381804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55220e-04b1-4f59-bc09-a7d4a461bc6d admin admin] PATH_INFO: `/v3/users/bb5df5d38d7248c499e717de35e527d3` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:55.383070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55220e-04b1-4f59-bc09-a7d4a461bc6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5df5d38d7248c499e717de35e527d3)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:55.385134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55220e-04b1-4f59-bc09-a7d4a461bc6d admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:55.543135 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-aa55220e-04b1-4f59-bc09-a7d4a461bc6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5df5d38d7248c499e717de35e527d3'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:55.605570 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-aa55220e-04b1-4f59-bc09-a7d4a461bc6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5df5d38d7248c499e717de35e527d3'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:55.606194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-aa55220e-04b1-4f59-bc09-a7d4a461bc6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5df5d38d7248c499e717de35e527d3'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:55.618693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-aa55220e-04b1-4f59-bc09-a7d4a461bc6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5df5d38d7248c499e717de35e527d3'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:55.626084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-aa55220e-04b1-4f59-bc09-a7d4a461bc6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5df5d38d7248c499e717de35e527d3'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:55.631960 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1377/2727] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:36:55 2022] DELETE /identity/v3/users/bb5df5d38d7248c499e717de35e527d3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:56.019037 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:56.020803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:56.035322 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5059ba-8aa9-4eb3-ba6d-0d783815834f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:56.092270 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89513f0-f9d0-466a-b023-69f956852c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:56.093160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89513f0-f9d0-466a-b023-69f956852c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:56.093453 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89513f0-f9d0-466a-b023-69f956852c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:56.093736 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89513f0-f9d0-466a-b023-69f956852c66 admin admin] PATH_INFO: `/v3/projects/51d6a312376b4b31963261df3e1b117e` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:56.094914 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89513f0-f9d0-466a-b023-69f956852c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d6a312376b4b31963261df3e1b117e)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:56.096814 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89513f0-f9d0-466a-b023-69f956852c66 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:56.183248 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e89513f0-f9d0-466a-b023-69f956852c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d6a312376b4b31963261df3e1b117e', 'request_id': 'req-e89513f0-f9d0-466a-b023-69f956852c66'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:56.228439 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e89513f0-f9d0-466a-b023-69f956852c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d6a312376b4b31963261df3e1b117e', 'request_id': 'req-e89513f0-f9d0-466a-b023-69f956852c66'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:56.235662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e89513f0-f9d0-466a-b023-69f956852c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d6a312376b4b31963261df3e1b117e', 'request_id': 'req-e89513f0-f9d0-466a-b023-69f956852c66'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:56.246187 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e89513f0-f9d0-466a-b023-69f956852c66 admin admin] The token cache is being invalidate because project 51d6a312376b4b31963261df3e1b117e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:36:56.246474 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e89513f0-f9d0-466a-b023-69f956852c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:56.247103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e89513f0-f9d0-466a-b023-69f956852c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:36:56.248646 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1351/2728] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:36:56 2022] DELETE /identity/v3/projects/51d6a312376b4b31963261df3e1b117e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:56.254056 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162feb8-fa7f-4d2e-bd8b-5a431e608d8a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:56.254345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162feb8-fa7f-4d2e-bd8b-5a431e608d8a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:56.254622 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162feb8-fa7f-4d2e-bd8b-5a431e608d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:56.302276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-3162feb8-fa7f-4d2e-bd8b-5a431e608d8a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:56.303433 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3162feb8-fa7f-4d2e-bd8b-5a431e608d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:56.327803 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:56.362950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1378/2729] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:56.380113 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815abaea-5115-4a92-8880-5054099b7695 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:56.380412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815abaea-5115-4a92-8880-5054099b7695 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:56.380698 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815abaea-5115-4a92-8880-5054099b7695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:56.401744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-815abaea-5115-4a92-8880-5054099b7695 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:56.401744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-815abaea-5115-4a92-8880-5054099b7695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:56.409821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1352/2730] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:56.414268 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162feb8-fa7f-4d2e-bd8b-5a431e608d8a None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:56.425699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162feb8-fa7f-4d2e-bd8b-5a431e608d8a None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:56.430480 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb427be-0c29-41e7-960b-cd07adf8ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:56.431152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb427be-0c29-41e7-960b-cd07adf8ba53 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:56.431439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb427be-0c29-41e7-960b-cd07adf8ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:56.431718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb427be-0c29-41e7-960b-cd07adf8ba53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:56.432447 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb427be-0c29-41e7-960b-cd07adf8ba53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:36:56.432758 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb427be-0c29-41e7-960b-cd07adf8ba53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:56.434393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb427be-0c29-41e7-960b-cd07adf8ba53 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:56.450820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1379/2731] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:36:56.451754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815abaea-5115-4a92-8880-5054099b7695 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:56.463912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815abaea-5115-4a92-8880-5054099b7695 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:56.469891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafddf8-681c-4b33-b5b5-60f97c9dd9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:56.470616 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafddf8-681c-4b33-b5b5-60f97c9dd9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:56.471027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafddf8-681c-4b33-b5b5-60f97c9dd9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:56.471313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafddf8-681c-4b33-b5b5-60f97c9dd9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:56.472015 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafddf8-681c-4b33-b5b5-60f97c9dd9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:56.473995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafddf8-681c-4b33-b5b5-60f97c9dd9b0 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:56.599244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1353/2732] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:36:56 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:36:56.600348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb427be-0c29-41e7-960b-cd07adf8ba53 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:56.611074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb427be-0c29-41e7-960b-cd07adf8ba53 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:56.673342 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26846d73-403c-428c-a67b-362bb4a1bdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:56.674013 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26846d73-403c-428c-a67b-362bb4a1bdda admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:56.674297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26846d73-403c-428c-a67b-362bb4a1bdda admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:56.674575 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26846d73-403c-428c-a67b-362bb4a1bdda admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:56.675276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26846d73-403c-428c-a67b-362bb4a1bdda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:56.677212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26846d73-403c-428c-a67b-362bb4a1bdda admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:56.763858 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1380/2733] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:36:56 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:36:56.771744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafddf8-681c-4b33-b5b5-60f97c9dd9b0 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:56.777404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:36:56.783521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafddf8-681c-4b33-b5b5-60f97c9dd9b0 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:56.788329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa491bc9-c868-482f-8e77-67c39a6f9df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:56.789000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa491bc9-c868-482f-8e77-67c39a6f9df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:56.789568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa491bc9-c868-482f-8e77-67c39a6f9df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:56.789855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa491bc9-c868-482f-8e77-67c39a6f9df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:56.790586 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa491bc9-c868-482f-8e77-67c39a6f9df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:56.796127 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa491bc9-c868-482f-8e77-67c39a6f9df2 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:56.812026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1354/2734] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:56.813279 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26846d73-403c-428c-a67b-362bb4a1bdda admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:56.824707 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26846d73-403c-428c-a67b-362bb4a1bdda admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:56.832376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a78dc-0f2a-4178-acd3-3fb4593d330c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:56.832376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a78dc-0f2a-4178-acd3-3fb4593d330c admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:56.832376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a78dc-0f2a-4178-acd3-3fb4593d330c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:56.832376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a78dc-0f2a-4178-acd3-3fb4593d330c admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:56.832782 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a78dc-0f2a-4178-acd3-3fb4593d330c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:56.833246 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a78dc-0f2a-4178-acd3-3fb4593d330c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:56.844708 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1381/2735] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:36:56.848649 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa491bc9-c868-482f-8e77-67c39a6f9df2 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:56.859661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa491bc9-c868-482f-8e77-67c39a6f9df2 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:56.864415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51e2e7-4af3-4fcd-85d8-68532a6b7502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:56.866410 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51e2e7-4af3-4fcd-85d8-68532a6b7502 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:56.866410 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51e2e7-4af3-4fcd-85d8-68532a6b7502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:56.866410 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51e2e7-4af3-4fcd-85d8-68532a6b7502 admin admin] PATH_INFO: `/v3/projects/c816754f32fd4ed79a93709f457d0a91/users/8f65b554ab31496da9a2d0d789a316ce/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:56.884123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51e2e7-4af3-4fcd-85d8-68532a6b7502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c816754f32fd4ed79a93709f457d0a91, user_id=8f65b554ab31496da9a2d0d789a316ce, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:56.887063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51e2e7-4af3-4fcd-85d8-68532a6b7502 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:56.949075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1355/2736] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:36:56 2022] PUT /identity/v3/projects/c816754f32fd4ed79a93709f457d0a91/users/8f65b554ab31496da9a2d0d789a316ce/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:36:57.015571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4252663-154c-4a1f-8991-8cbb8b212c86 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:57.015854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4252663-154c-4a1f-8991-8cbb8b212c86 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:57.016134 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4252663-154c-4a1f-8991-8cbb8b212c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:57.050161 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-b4252663-154c-4a1f-8991-8cbb8b212c86 None None] MFA Rules not processed for user `8f65b554ab31496da9a2d0d789a316ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:36:57.051141 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b4252663-154c-4a1f-8991-8cbb8b212c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:57.115212 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1382/2737] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:36:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:36:57.126955 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51e2e7-4af3-4fcd-85d8-68532a6b7502 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:36:57.128688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-bd51e2e7-4af3-4fcd-85d8-68532a6b7502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:36:57.189354 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51e2e7-4af3-4fcd-85d8-68532a6b7502 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:36:57.193007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9403e1-1e1e-4be0-afdb-cf6407dfe184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:36:57.193688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9403e1-1e1e-4be0-afdb-cf6407dfe184 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:36:57.195554 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9403e1-1e1e-4be0-afdb-cf6407dfe184 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:36:57.195554 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9403e1-1e1e-4be0-afdb-cf6407dfe184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:36:57.202992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9403e1-1e1e-4be0-afdb-cf6407dfe184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:36:57.204425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9403e1-1e1e-4be0-afdb-cf6407dfe184 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:36:57.213315 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1356/2738] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:36:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:37:00.197388 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4252663-154c-4a1f-8991-8cbb8b212c86 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:00.225509 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:37:00.260452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4252663-154c-4a1f-8991-8cbb8b212c86 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:00.264963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:00.264963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:00.267711 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:00.267983 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] PATH_INFO: `/v3/users/8f65b554ab31496da9a2d0d789a316ce` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:00.269226 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f65b554ab31496da9a2d0d789a316ce)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:00.271159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:00.519920 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f65b554ab31496da9a2d0d789a316ce'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:00.595037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f65b554ab31496da9a2d0d789a316ce'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:00.599685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f65b554ab31496da9a2d0d789a316ce'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:00.611991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f65b554ab31496da9a2d0d789a316ce'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:00.620502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f65b554ab31496da9a2d0d789a316ce'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:00.628532 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1383/2739] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:37:00 2022] DELETE /identity/v3/users/8f65b554ab31496da9a2d0d789a316ce => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:37:00.632902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040e730-8e06-45e3-88b6-c76d38c95dbb None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:00.633406 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040e730-8e06-45e3-88b6-c76d38c95dbb None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:00.633555 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040e730-8e06-45e3-88b6-c76d38c95dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:00.651537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-5040e730-8e06-45e3-88b6-c76d38c95dbb None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:00.652779 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5040e730-8e06-45e3-88b6-c76d38c95dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:00.718177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1357/2740] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:37:00.730912 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:00.732369 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:00.793928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb33b8-f240-4331-980e-699b87761736 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:00.797659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859af46-4702-4ef4-ba64-48f25beed56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:00.798315 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859af46-4702-4ef4-ba64-48f25beed56e service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:00.798753 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859af46-4702-4ef4-ba64-48f25beed56e service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:00.799034 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859af46-4702-4ef4-ba64-48f25beed56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:00.809417 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859af46-4702-4ef4-ba64-48f25beed56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:00.810911 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859af46-4702-4ef4-ba64-48f25beed56e service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:00.824289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1384/2741] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:37:01.250560 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040e730-8e06-45e3-88b6-c76d38c95dbb None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:01.252244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-5040e730-8e06-45e3-88b6-c76d38c95dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:01.265013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040e730-8e06-45e3-88b6-c76d38c95dbb None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:01.272360 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c96d9c-becc-4331-93ba-e4cbf62254ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:01.273700 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c96d9c-becc-4331-93ba-e4cbf62254ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:01.274061 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c96d9c-becc-4331-93ba-e4cbf62254ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:01.274419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c96d9c-becc-4331-93ba-e4cbf62254ff admin admin] PATH_INFO: `/v3/projects/c816754f32fd4ed79a93709f457d0a91` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:01.275925 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c96d9c-becc-4331-93ba-e4cbf62254ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c816754f32fd4ed79a93709f457d0a91)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:01.278362 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c96d9c-becc-4331-93ba-e4cbf62254ff admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:01.469124 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e8c96d9c-becc-4331-93ba-e4cbf62254ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c816754f32fd4ed79a93709f457d0a91', 'request_id': 'req-e8c96d9c-becc-4331-93ba-e4cbf62254ff'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:01.563350 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e8c96d9c-becc-4331-93ba-e4cbf62254ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c816754f32fd4ed79a93709f457d0a91', 'request_id': 'req-e8c96d9c-becc-4331-93ba-e4cbf62254ff'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:01.573809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e8c96d9c-becc-4331-93ba-e4cbf62254ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c816754f32fd4ed79a93709f457d0a91', 'request_id': 'req-e8c96d9c-becc-4331-93ba-e4cbf62254ff'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:01.574369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:37:01.581667 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e8c96d9c-becc-4331-93ba-e4cbf62254ff admin admin] The token cache is being invalidate because project c816754f32fd4ed79a93709f457d0a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:37:01.581963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e8c96d9c-becc-4331-93ba-e4cbf62254ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:01.582600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e8c96d9c-becc-4331-93ba-e4cbf62254ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:01.584155 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1358/2742] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:37:01 2022] DELETE /identity/v3/projects/c816754f32fd4ed79a93709f457d0a91 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:37:01.589157 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6ab22-51cb-4abf-8020-aa3bc65bc5b3 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:01.589623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6ab22-51cb-4abf-8020-aa3bc65bc5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:01.589725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6ab22-51cb-4abf-8020-aa3bc65bc5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:01.612912 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-4fa6ab22-51cb-4abf-8020-aa3bc65bc5b3 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:01.614158 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-4fa6ab22-51cb-4abf-8020-aa3bc65bc5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:01.656986 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:37:01.674742 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1385/2743] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:37:01.682426 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dedef-8f55-4568-8881-99af2371c38f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:01.682988 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dedef-8f55-4568-8881-99af2371c38f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:01.682988 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dedef-8f55-4568-8881-99af2371c38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:01.700854 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-bf8dedef-8f55-4568-8881-99af2371c38f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:01.702083 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-bf8dedef-8f55-4568-8881-99af2371c38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:01.710647 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1359/2744] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:37:01.714820 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6ab22-51cb-4abf-8020-aa3bc65bc5b3 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:01.724771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6ab22-51cb-4abf-8020-aa3bc65bc5b3 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:01.729344 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dd502-130b-43df-b8e7-2e85dc99b50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:01.736071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dd502-130b-43df-b8e7-2e85dc99b50e admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:01.736071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dd502-130b-43df-b8e7-2e85dc99b50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:01.736071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dd502-130b-43df-b8e7-2e85dc99b50e admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:01.736071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dd502-130b-43df-b8e7-2e85dc99b50e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:37:01.736071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dd502-130b-43df-b8e7-2e85dc99b50e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:01.736071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dd502-130b-43df-b8e7-2e85dc99b50e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:01.744378 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1386/2745] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:37:01.748695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dedef-8f55-4568-8881-99af2371c38f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:01.757912 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dedef-8f55-4568-8881-99af2371c38f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:01.762574 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c81f9-0143-4044-a12c-32fe0e30d43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:01.763218 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c81f9-0143-4044-a12c-32fe0e30d43b admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:01.763504 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c81f9-0143-4044-a12c-32fe0e30d43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:01.763783 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c81f9-0143-4044-a12c-32fe0e30d43b admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:01.764520 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c81f9-0143-4044-a12c-32fe0e30d43b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:01.766948 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c81f9-0143-4044-a12c-32fe0e30d43b admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:01.841545 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1360/2746] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:37:01 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:37:01.844096 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dd502-130b-43df-b8e7-2e85dc99b50e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:01.854144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dd502-130b-43df-b8e7-2e85dc99b50e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:01.886391 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c81f9-0143-4044-a12c-32fe0e30d43b admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:01.888194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c42c81f9-0143-4044-a12c-32fe0e30d43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:01.922528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a6442-d394-490e-9525-b655c245d3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:01.923165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6442-d394-490e-9525-b655c245d3bd admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:01.923452 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6442-d394-490e-9525-b655c245d3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:01.923725 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6442-d394-490e-9525-b655c245d3bd admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:01.924443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a6442-d394-490e-9525-b655c245d3bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:01.926393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a6442-d394-490e-9525-b655c245d3bd admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:01.959181 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c81f9-0143-4044-a12c-32fe0e30d43b admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:01.963903 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96bc22-a510-4ee9-8cc0-9a7a5ee2dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:01.964778 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96bc22-a510-4ee9-8cc0-9a7a5ee2dec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:01.965058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96bc22-a510-4ee9-8cc0-9a7a5ee2dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:01.965363 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96bc22-a510-4ee9-8cc0-9a7a5ee2dec2 admin admin] PATH_INFO: `/v3/users/b2dc76e4e25a41c695f8a8b34f151f74` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:01.966595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96bc22-a510-4ee9-8cc0-9a7a5ee2dec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2dc76e4e25a41c695f8a8b34f151f74)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:01.969099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96bc22-a510-4ee9-8cc0-9a7a5ee2dec2 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:02.021267 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1387/2747] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:37:01 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:37:02.022512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a6442-d394-490e-9525-b655c245d3bd admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:02.033175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a6442-d394-490e-9525-b655c245d3bd admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:02.037887 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b9be0-7387-4756-955c-f8bfe4e6ffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:02.038547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b9be0-7387-4756-955c-f8bfe4e6ffda admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:02.038837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b9be0-7387-4756-955c-f8bfe4e6ffda admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:02.039111 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b9be0-7387-4756-955c-f8bfe4e6ffda admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:02.040157 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b9be0-7387-4756-955c-f8bfe4e6ffda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:02.041722 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b9be0-7387-4756-955c-f8bfe4e6ffda admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:02.051718 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1388/2748] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:37:02.059431 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b9be0-7387-4756-955c-f8bfe4e6ffda admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:02.069754 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b9be0-7387-4756-955c-f8bfe4e6ffda admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:02.074341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df0c51-3025-434b-8c6d-37465efc2bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:02.074994 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df0c51-3025-434b-8c6d-37465efc2bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:02.075278 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df0c51-3025-434b-8c6d-37465efc2bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:02.075557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df0c51-3025-434b-8c6d-37465efc2bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:02.076281 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df0c51-3025-434b-8c6d-37465efc2bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:02.078555 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df0c51-3025-434b-8c6d-37465efc2bf0 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:02.091611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1389/2749] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:37:02.094461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df0c51-3025-434b-8c6d-37465efc2bf0 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:02.104505 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df0c51-3025-434b-8c6d-37465efc2bf0 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:02.109529 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0402e3-d055-4ebb-a1d7-0815dd890281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:02.110423 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0402e3-d055-4ebb-a1d7-0815dd890281 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:02.115814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0402e3-d055-4ebb-a1d7-0815dd890281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:02.115814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0402e3-d055-4ebb-a1d7-0815dd890281 admin admin] PATH_INFO: `/v3/projects/f1d8959267774fd2a231c9d32785990d/users/4b4067be81c44d4e9d0fab26b01d4682/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:02.126685 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0402e3-d055-4ebb-a1d7-0815dd890281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d8959267774fd2a231c9d32785990d, user_id=4b4067be81c44d4e9d0fab26b01d4682, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:02.130120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0402e3-d055-4ebb-a1d7-0815dd890281 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:02.152419 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-cb96bc22-a510-4ee9-8cc0-9a7a5ee2dec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2dc76e4e25a41c695f8a8b34f151f74'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:02.227055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1390/2750] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:37:02 2022] PUT /identity/v3/projects/f1d8959267774fd2a231c9d32785990d/users/4b4067be81c44d4e9d0fab26b01d4682/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:37:02.232182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f8e41-16cb-494a-ac05-20f434906719 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:02.232479 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f8e41-16cb-494a-ac05-20f434906719 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:02.232761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f8e41-16cb-494a-ac05-20f434906719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:02.243666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-cb96bc22-a510-4ee9-8cc0-9a7a5ee2dec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2dc76e4e25a41c695f8a8b34f151f74'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:02.251293 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-237f8e41-16cb-494a-ac05-20f434906719 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:02.252521 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-237f8e41-16cb-494a-ac05-20f434906719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:02.259792 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-cb96bc22-a510-4ee9-8cc0-9a7a5ee2dec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2dc76e4e25a41c695f8a8b34f151f74'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:02.260471 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-cb96bc22-a510-4ee9-8cc0-9a7a5ee2dec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2dc76e4e25a41c695f8a8b34f151f74'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:02.268524 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-cb96bc22-a510-4ee9-8cc0-9a7a5ee2dec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2dc76e4e25a41c695f8a8b34f151f74'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:02.277234 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1361/2751] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:37:01 2022] DELETE /identity/v3/users/b2dc76e4e25a41c695f8a8b34f151f74 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:37:02.279240 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4f6cd-5bf7-4e17-9468-35599467e42e None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:02.279540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4f6cd-5bf7-4e17-9468-35599467e42e None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:02.279830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4f6cd-5bf7-4e17-9468-35599467e42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:02.301697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a3d4f6cd-5bf7-4e17-9468-35599467e42e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:02.302932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a3d4f6cd-5bf7-4e17-9468-35599467e42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:02.335676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1391/2752] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 16:37:02.345652 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f8e41-16cb-494a-ac05-20f434906719 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:02.347044 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-237f8e41-16cb-494a-ac05-20f434906719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:02.352096 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:37:02.371437 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:37:02.383784 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1362/2753] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:37:02.389834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4f6cd-5bf7-4e17-9468-35599467e42e None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:02.392066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a3d4f6cd-5bf7-4e17-9468-35599467e42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:02.411159 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f8e41-16cb-494a-ac05-20f434906719 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:02.472656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4f6cd-5bf7-4e17-9468-35599467e42e None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:02.476609 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e657a0-7d09-499c-b301-95e3264fa4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:02.477176 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b5b06-e5bd-4978-af63-a49a16a470e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:02.477311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e657a0-7d09-499c-b301-95e3264fa4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:02.477593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e657a0-7d09-499c-b301-95e3264fa4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:02.477877 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e657a0-7d09-499c-b301-95e3264fa4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:02.478003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b5b06-e5bd-4978-af63-a49a16a470e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:02.478217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b5b06-e5bd-4978-af63-a49a16a470e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:02.478523 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b5b06-e5bd-4978-af63-a49a16a470e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:02.489746 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b5b06-e5bd-4978-af63-a49a16a470e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:02.490809 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e657a0-7d09-499c-b301-95e3264fa4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:02.491560 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b5b06-e5bd-4978-af63-a49a16a470e3 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:02.492261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e657a0-7d09-499c-b301-95e3264fa4f4 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:02.503363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1392/2754] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:37:02.504092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1363/2755] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:37:03.053304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b5b06-e5bd-4978-af63-a49a16a470e3 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:03.054745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1e5b5b06-e5bd-4978-af63-a49a16a470e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:03.070017 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b5b06-e5bd-4978-af63-a49a16a470e3 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:03.075965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:03.077144 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:03.077317 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:03.077600 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] PATH_INFO: `/v3/projects/1f6af6282e164e83b464c1334b364fd0` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:03.079014 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6af6282e164e83b464c1334b364fd0)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:03.081243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:03.198299 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6af6282e164e83b464c1334b364fd0', 'request_id': 'req-938664c6-ed15-4312-b6ce-fe45b5dd7d00'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:03.308546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6af6282e164e83b464c1334b364fd0', 'request_id': 'req-938664c6-ed15-4312-b6ce-fe45b5dd7d00'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:03.315822 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6af6282e164e83b464c1334b364fd0', 'request_id': 'req-938664c6-ed15-4312-b6ce-fe45b5dd7d00'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:03.330006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] The token cache is being invalidate because project 1f6af6282e164e83b464c1334b364fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:37:03.330250 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:03.331051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:37:03.344467 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1393/2756] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:37:03 2022] DELETE /identity/v3/projects/1f6af6282e164e83b464c1334b364fd0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:37:03.917195 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f3e1d-93ff-496c-a419-75dc9c470aca None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:03.917761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f3e1d-93ff-496c-a419-75dc9c470aca None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:03.917865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f3e1d-93ff-496c-a419-75dc9c470aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:03.947309 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-ef9f3e1d-93ff-496c-a419-75dc9c470aca None None] MFA Rules not processed for user `4b4067be81c44d4e9d0fab26b01d4682`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:03.948452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-ef9f3e1d-93ff-496c-a419-75dc9c470aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:04.016883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1364/2757] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:37:04.027716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:04.029210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:04.089243 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938664c6-ed15-4312-b6ce-fe45b5dd7d00 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:04.092823 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee37776-35e7-418a-ae3c-b96017ed220c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:04.093578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee37776-35e7-418a-ae3c-b96017ed220c service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:04.093877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee37776-35e7-418a-ae3c-b96017ed220c service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:04.094160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee37776-35e7-418a-ae3c-b96017ed220c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:04.102611 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee37776-35e7-418a-ae3c-b96017ed220c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:04.104049 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee37776-35e7-418a-ae3c-b96017ed220c service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:04.113703 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1394/2758] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:37:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:37:05.861350 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256129f-361d-4c6f-aa0b-12990d582439 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:05.861872 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256129f-361d-4c6f-aa0b-12990d582439 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:05.862006 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256129f-361d-4c6f-aa0b-12990d582439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:05.881437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-6256129f-361d-4c6f-aa0b-12990d582439 None None] MFA Rules not processed for user `4b4067be81c44d4e9d0fab26b01d4682`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:05.882646 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-6256129f-361d-4c6f-aa0b-12990d582439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:05.889563 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1365/2759] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:37:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:37:09.315919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee37776-35e7-418a-ae3c-b96017ed220c service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:09.317431 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-7ee37776-35e7-418a-ae3c-b96017ed220c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:09.322321 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:37:09.446694 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee37776-35e7-418a-ae3c-b96017ed220c service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:09.451940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac31d2-b6f1-4afb-a91c-31af63934444 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b62795a6111a4c05a24e69efc7a0faba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:09.452686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac31d2-b6f1-4afb-a91c-31af63934444 service placement] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:09.453051 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac31d2-b6f1-4afb-a91c-31af63934444 service placement] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:09.453449 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac31d2-b6f1-4afb-a91c-31af63934444 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:09.455403 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c2ac31d2-b6f1-4afb-a91c-31af63934444 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:09.468167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac31d2-b6f1-4afb-a91c-31af63934444 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:09.469826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac31d2-b6f1-4afb-a91c-31af63934444 service placement] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:09.481152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1395/2760] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:37:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:37:13.572599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965398a-b1f0-48d5-8d33-184f8b40c20b None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:13.573103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965398a-b1f0-48d5-8d33-184f8b40c20b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:13.573254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965398a-b1f0-48d5-8d33-184f8b40c20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:13.591285 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-a965398a-b1f0-48d5-8d33-184f8b40c20b None None] MFA Rules not processed for user `a727df3cf06746b8929de45d8ab5493c`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:13.592490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a965398a-b1f0-48d5-8d33-184f8b40c20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:13.647699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1366/2761] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:37:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:37:19.497094 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=40 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:37:23.640275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=93 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:37:36.538070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274355e-54b4-4b35-b7db-88ece59309a8 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:36.538624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274355e-54b4-4b35-b7db-88ece59309a8 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:36.538624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274355e-54b4-4b35-b7db-88ece59309a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:36.557557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a274355e-54b4-4b35-b7db-88ece59309a8 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:36.558768 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a274355e-54b4-4b35-b7db-88ece59309a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:36.616279 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1396/2762] 10.222.0.61 () {58 vars in 1016 bytes} [Tue Jul 12 16:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:37:36.634103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965398a-b1f0-48d5-8d33-184f8b40c20b None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:36.635511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a965398a-b1f0-48d5-8d33-184f8b40c20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:36.733628 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965398a-b1f0-48d5-8d33-184f8b40c20b None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:36.739367 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b67dda-a94e-4b8b-87c6-40f1511e0d90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:36.740014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b67dda-a94e-4b8b-87c6-40f1511e0d90 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:36.740301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b67dda-a94e-4b8b-87c6-40f1511e0d90 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:36.740582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b67dda-a94e-4b8b-87c6-40f1511e0d90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:36.748803 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b67dda-a94e-4b8b-87c6-40f1511e0d90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:36.750486 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b67dda-a94e-4b8b-87c6-40f1511e0d90 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:36.760335 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1367/2763] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:37:40.928336 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45326d1e-5182-4552-a44f-017e684d4910 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:40.928875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45326d1e-5182-4552-a44f-017e684d4910 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:40.928875 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45326d1e-5182-4552-a44f-017e684d4910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:40.947638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-45326d1e-5182-4552-a44f-017e684d4910 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:40.948821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-45326d1e-5182-4552-a44f-017e684d4910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:40.956594 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1397/2764] 10.222.0.61 () {58 vars in 1016 bytes} [Tue Jul 12 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:37:40.971470 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b67dda-a94e-4b8b-87c6-40f1511e0d90 service nova] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:40.972861 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b4b67dda-a94e-4b8b-87c6-40f1511e0d90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:40.987829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b67dda-a94e-4b8b-87c6-40f1511e0d90 service nova] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:40.993323 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a93d0c-3b8e-4628-9c97-2aca34d8d8ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:40.993958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a93d0c-3b8e-4628-9c97-2aca34d8d8ef service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:40.994245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a93d0c-3b8e-4628-9c97-2aca34d8d8ef service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:40.994522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a93d0c-3b8e-4628-9c97-2aca34d8d8ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:41.002863 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a93d0c-3b8e-4628-9c97-2aca34d8d8ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:41.004509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a93d0c-3b8e-4628-9c97-2aca34d8d8ef service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:41.013951 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1368/2765] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:37:44.322566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1210b-1202-493c-b005-96dbe5502874 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:44.323175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1210b-1202-493c-b005-96dbe5502874 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:44.323175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1210b-1202-493c-b005-96dbe5502874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:44.341217 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-1aa1210b-1202-493c-b005-96dbe5502874 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:44.342413 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1aa1210b-1202-493c-b005-96dbe5502874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:44.351007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1398/2766] 10.222.0.61 () {58 vars in 1016 bytes} [Tue Jul 12 16:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:37:44.366089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a93d0c-3b8e-4628-9c97-2aca34d8d8ef service nova] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:44.378207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a93d0c-3b8e-4628-9c97-2aca34d8d8ef service nova] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:44.383808 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e3895-063d-4699-b707-a9de1020ca7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:44.384473 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e3895-063d-4699-b707-a9de1020ca7c service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:44.384761 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e3895-063d-4699-b707-a9de1020ca7c service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:44.385042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e3895-063d-4699-b707-a9de1020ca7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:44.393494 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e3895-063d-4699-b707-a9de1020ca7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:44.395097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e3895-063d-4699-b707-a9de1020ca7c service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:44.404561 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1369/2767] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:37:47.224745 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6184083-d66c-4480-9dd9-9592b9c3343f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:47.225300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6184083-d66c-4480-9dd9-9592b9c3343f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:47.225300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6184083-d66c-4480-9dd9-9592b9c3343f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:47.243003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a6184083-d66c-4480-9dd9-9592b9c3343f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:47.244228 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a6184083-d66c-4480-9dd9-9592b9c3343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:47.256256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1399/2768] 10.222.0.61 () {58 vars in 1016 bytes} [Tue Jul 12 16:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:37:47.268695 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e3895-063d-4699-b707-a9de1020ca7c service nova] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:47.280014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e3895-063d-4699-b707-a9de1020ca7c service nova] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:47.285509 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433aa7d-64f7-45d2-8eed-3d57abe817ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:47.286135 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433aa7d-64f7-45d2-8eed-3d57abe817ce service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:47.286423 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433aa7d-64f7-45d2-8eed-3d57abe817ce service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:47.286702 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433aa7d-64f7-45d2-8eed-3d57abe817ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:47.296078 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433aa7d-64f7-45d2-8eed-3d57abe817ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:47.298973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433aa7d-64f7-45d2-8eed-3d57abe817ce service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:47.312587 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1370/2769] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:37:50.471048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b9df6-1dcd-432f-bbc4-42e8270af33a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:50.471473 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b9df6-1dcd-432f-bbc4-42e8270af33a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:50.471649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b9df6-1dcd-432f-bbc4-42e8270af33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:50.490934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-f27b9df6-1dcd-432f-bbc4-42e8270af33a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:50.492133 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-f27b9df6-1dcd-432f-bbc4-42e8270af33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:50.500103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1400/2770] 10.222.0.61 () {58 vars in 1016 bytes} [Tue Jul 12 16:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:37:50.515320 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433aa7d-64f7-45d2-8eed-3d57abe817ce service nova] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:50.527564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433aa7d-64f7-45d2-8eed-3d57abe817ce service nova] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:50.532946 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b1f15-4f01-47b0-b6b1-d124428c8232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:50.533602 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1f15-4f01-47b0-b6b1-d124428c8232 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:50.533888 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1f15-4f01-47b0-b6b1-d124428c8232 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:50.534164 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1f15-4f01-47b0-b6b1-d124428c8232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:50.542448 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b1f15-4f01-47b0-b6b1-d124428c8232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:50.544007 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b1f15-4f01-47b0-b6b1-d124428c8232 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:50.553854 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1371/2771] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:37:53.706948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e2d6e-322e-47a9-9b84-ba1a0e1b6169 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:53.708860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e2d6e-322e-47a9-9b84-ba1a0e1b6169 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:53.708860 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e2d6e-322e-47a9-9b84-ba1a0e1b6169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:53.726072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-9a5e2d6e-322e-47a9-9b84-ba1a0e1b6169 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:37:53.727270 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-9a5e2d6e-322e-47a9-9b84-ba1a0e1b6169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:37:53.735136 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1401/2772] 10.222.0.61 () {58 vars in 1016 bytes} [Tue Jul 12 16:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:37:53.751972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b1f15-4f01-47b0-b6b1-d124428c8232 service nova] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:37:53.763070 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b1f15-4f01-47b0-b6b1-d124428c8232 service nova] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:37:53.768651 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfbb8e-a453-49e9-81fb-a6246797492a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:37:53.769339 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfbb8e-a453-49e9-81fb-a6246797492a service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:37:53.769691 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfbb8e-a453-49e9-81fb-a6246797492a service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:37:53.770064 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfbb8e-a453-49e9-81fb-a6246797492a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:37:53.778262 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfbb8e-a453-49e9-81fb-a6246797492a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:37:53.779828 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfbb8e-a453-49e9-81fb-a6246797492a service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:37:53.790080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1372/2773] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:38:03.720451 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=42 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:38:03.785708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=76 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:38:10.807898 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d99bb6-84e6-47ba-9042-f19873939b63 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:38:10.808393 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d99bb6-84e6-47ba-9042-f19873939b63 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:38:10.808508 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d99bb6-84e6-47ba-9042-f19873939b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:38:10.825886 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-34d99bb6-84e6-47ba-9042-f19873939b63 None None] MFA Rules not processed for user `4b4067be81c44d4e9d0fab26b01d4682`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:38:10.827108 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-34d99bb6-84e6-47ba-9042-f19873939b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:38:10.834024 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1402/2774] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:38:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:38:20.821951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:38:23.403360 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f08c1-8934-4d69-bb11-fdfa98c7ad1c None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:38:23.403938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f08c1-8934-4d69-bb11-fdfa98c7ad1c None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:38:23.403938 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f08c1-8934-4d69-bb11-fdfa98c7ad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:38:23.421661 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-b85f08c1-8934-4d69-bb11-fdfa98c7ad1c None None] MFA Rules not processed for user `a727df3cf06746b8929de45d8ab5493c`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:38:23.422867 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b85f08c1-8934-4d69-bb11-fdfa98c7ad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:38:23.430379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1373/2775] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:38:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:38:28.176693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d057945-9688-4958-a651-0b1f2c58085a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:38:28.176693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d057945-9688-4958-a651-0b1f2c58085a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:38:28.177381 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d057945-9688-4958-a651-0b1f2c58085a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:38:28.205533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-0d057945-9688-4958-a651-0b1f2c58085a None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:38:28.207124 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0d057945-9688-4958-a651-0b1f2c58085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:38:28.217229 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1403/2776] 10.222.0.61 () {58 vars in 1016 bytes} [Tue Jul 12 16:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:38:28.234379 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f08c1-8934-4d69-bb11-fdfa98c7ad1c None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:38:28.250932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f08c1-8934-4d69-bb11-fdfa98c7ad1c None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:38:28.257907 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f701cb-929c-4d3b-8f63-a76755d49a7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:38:28.258813 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f701cb-929c-4d3b-8f63-a76755d49a7e service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:38:28.260929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f701cb-929c-4d3b-8f63-a76755d49a7e service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:38:28.260929 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f701cb-929c-4d3b-8f63-a76755d49a7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:38:28.269922 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f701cb-929c-4d3b-8f63-a76755d49a7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:38:28.272790 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f701cb-929c-4d3b-8f63-a76755d49a7e service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:38:28.285029 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1374/2777] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:38:31.625876 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d903-8689-402a-8e36-ca988f3b3aca None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:38:31.626461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d903-8689-402a-8e36-ca988f3b3aca None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:38:31.626461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d903-8689-402a-8e36-ca988f3b3aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:38:31.644090 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-8793d903-8689-402a-8e36-ca988f3b3aca None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:38:31.645326 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8793d903-8689-402a-8e36-ca988f3b3aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:38:31.653585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1404/2778] 10.222.0.61 () {58 vars in 1016 bytes} [Tue Jul 12 16:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:38:31.677830 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f701cb-929c-4d3b-8f63-a76755d49a7e service nova] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:38:31.689043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f701cb-929c-4d3b-8f63-a76755d49a7e service nova] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:38:31.694556 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc3493-cf77-482a-8b21-850afb331122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:38:31.695209 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc3493-cf77-482a-8b21-850afb331122 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:38:31.695497 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc3493-cf77-482a-8b21-850afb331122 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:38:31.695776 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc3493-cf77-482a-8b21-850afb331122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:38:31.704398 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc3493-cf77-482a-8b21-850afb331122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:38:31.706008 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc3493-cf77-482a-8b21-850afb331122 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:38:31.716511 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1375/2779] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:38:34.484849 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97301fa-b8e8-40f4-a063-8a7b04768d87 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:38:34.485457 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97301fa-b8e8-40f4-a063-8a7b04768d87 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:38:34.485457 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97301fa-b8e8-40f4-a063-8a7b04768d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:38:34.504715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e97301fa-b8e8-40f4-a063-8a7b04768d87 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:38:34.506311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e97301fa-b8e8-40f4-a063-8a7b04768d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:38:34.515645 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1405/2780] 10.222.0.61 () {58 vars in 1016 bytes} [Tue Jul 12 16:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:38:34.556063 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc3493-cf77-482a-8b21-850afb331122 service nova] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:38:34.567287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc3493-cf77-482a-8b21-850afb331122 service nova] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:38:34.574062 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13295fe9-aaa4-4f24-a18f-f2a2a69bab8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:38:34.574715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13295fe9-aaa4-4f24-a18f-f2a2a69bab8a service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:38:34.575004 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13295fe9-aaa4-4f24-a18f-f2a2a69bab8a service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:38:34.575286 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13295fe9-aaa4-4f24-a18f-f2a2a69bab8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:38:34.584211 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13295fe9-aaa4-4f24-a18f-f2a2a69bab8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:38:34.585962 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13295fe9-aaa4-4f24-a18f-f2a2a69bab8a service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:38:34.595825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1376/2781] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:38:38.697527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04b664-b10b-4e2e-af6b-0f032a893a98 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:38:38.700642 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04b664-b10b-4e2e-af6b-0f032a893a98 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:38:38.700642 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04b664-b10b-4e2e-af6b-0f032a893a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:38:38.718696 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-8d04b664-b10b-4e2e-af6b-0f032a893a98 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:38:38.720222 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-8d04b664-b10b-4e2e-af6b-0f032a893a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:38:38.728890 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1406/2782] 10.222.0.61 () {58 vars in 1016 bytes} [Tue Jul 12 16:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:38:38.743581 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13295fe9-aaa4-4f24-a18f-f2a2a69bab8a service nova] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:38:38.755411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13295fe9-aaa4-4f24-a18f-f2a2a69bab8a service nova] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:38:38.761618 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc41d6-5c38-437b-ace5-b1c7cdb72ed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:38:38.762971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc41d6-5c38-437b-ace5-b1c7cdb72ed1 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:38:38.763625 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc41d6-5c38-437b-ace5-b1c7cdb72ed1 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:38:38.764067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc41d6-5c38-437b-ace5-b1c7cdb72ed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:38:38.774356 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc41d6-5c38-437b-ace5-b1c7cdb72ed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:38:38.776183 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc41d6-5c38-437b-ace5-b1c7cdb72ed1 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:38:38.788030 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1377/2783] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:38:43.986434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600889e1-d8fd-4b4f-8ebe-0842980bc433 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:38:43.986929 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600889e1-d8fd-4b4f-8ebe-0842980bc433 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:38:43.987042 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600889e1-d8fd-4b4f-8ebe-0842980bc433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:38:44.005327 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-600889e1-d8fd-4b4f-8ebe-0842980bc433 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:38:44.006546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-600889e1-d8fd-4b4f-8ebe-0842980bc433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:38:44.014345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1407/2784] 10.222.0.61 () {58 vars in 1016 bytes} [Tue Jul 12 16:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:38:44.029774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc41d6-5c38-437b-ace5-b1c7cdb72ed1 service nova] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:38:44.035425 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=28 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:38:44.042107 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc41d6-5c38-437b-ace5-b1c7cdb72ed1 service nova] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:38:44.047789 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7800a-3150-4a24-b027-b207e30a2002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:38:44.048434 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7800a-3150-4a24-b027-b207e30a2002 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:38:44.048759 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7800a-3150-4a24-b027-b207e30a2002 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:38:44.048994 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7800a-3150-4a24-b027-b207e30a2002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:38:44.057969 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7800a-3150-4a24-b027-b207e30a2002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:38:44.059572 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7800a-3150-4a24-b027-b207e30a2002 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:38:44.069547 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1378/2785] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:38:54.000411 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=15 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:38:54.070258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:15.864798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600889e1-d8fd-4b4f-8ebe-0842980bc433 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:15.867006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-600889e1-d8fd-4b4f-8ebe-0842980bc433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:15.901808 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600889e1-d8fd-4b4f-8ebe-0842980bc433 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:15.905520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0b4c3-7b1c-49c3-b997-3fb4da630a4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:15.906827 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0b4c3-7b1c-49c3-b997-3fb4da630a4a service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:15.907185 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0b4c3-7b1c-49c3-b997-3fb4da630a4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:15.907470 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0b4c3-7b1c-49c3-b997-3fb4da630a4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:15.909304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-90f0b4c3-7b1c-49c3-b997-3fb4da630a4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:15.923835 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0b4c3-7b1c-49c3-b997-3fb4da630a4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:15.925313 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0b4c3-7b1c-49c3-b997-3fb4da630a4a service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:15.936425 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1408/2786] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:39:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:39:16.124251 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7800a-3150-4a24-b027-b207e30a2002 service nova] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:16.125757 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c4c7800a-3150-4a24-b027-b207e30a2002 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:16.146629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7800a-3150-4a24-b027-b207e30a2002 service nova] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:16.146629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:16.146629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:16.146629 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:16.147052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] PATH_INFO: `/v3/users/4b4067be81c44d4e9d0fab26b01d4682` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:16.147052 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b4067be81c44d4e9d0fab26b01d4682)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:16.148842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:16.357283 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b4067be81c44d4e9d0fab26b01d4682'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:16.459125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b4067be81c44d4e9d0fab26b01d4682'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:16.476383 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b4067be81c44d4e9d0fab26b01d4682'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:16.477089 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b4067be81c44d4e9d0fab26b01d4682'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:16.483965 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b4067be81c44d4e9d0fab26b01d4682'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:16.490039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1379/2787] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:39:16 2022] DELETE /identity/v3/users/4b4067be81c44d4e9d0fab26b01d4682 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:16.724776 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0b4c3-7b1c-49c3-b997-3fb4da630a4a service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:16.739005 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0b4c3-7b1c-49c3-b997-3fb4da630a4a service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:16.801928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:16.802823 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:16.803106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:16.803376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] PATH_INFO: `/v3/projects/f1d8959267774fd2a231c9d32785990d` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:16.804572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d8959267774fd2a231c9d32785990d)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:16.806648 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:16.883931 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d8959267774fd2a231c9d32785990d', 'request_id': 'req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:16.928903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d8959267774fd2a231c9d32785990d', 'request_id': 'req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:16.935121 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d8959267774fd2a231c9d32785990d', 'request_id': 'req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:16.946961 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] The token cache is being invalidate because project f1d8959267774fd2a231c9d32785990d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:39:16.947256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:16.947994 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:16.949625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1409/2788] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:39:16 2022] DELETE /identity/v3/projects/f1d8959267774fd2a231c9d32785990d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:18.969733 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:18.971141 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:19.027978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cf42f-961d-45a8-bafd-a596185d4f20 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:19.077484 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28be93c-cdb8-4468-96ae-b19acc1ac447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:19.078678 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28be93c-cdb8-4468-96ae-b19acc1ac447 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:19.078973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28be93c-cdb8-4468-96ae-b19acc1ac447 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:19.079250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28be93c-cdb8-4468-96ae-b19acc1ac447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:19.081062 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-a28be93c-cdb8-4468-96ae-b19acc1ac447 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:19.125642 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:19.153466 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28be93c-cdb8-4468-96ae-b19acc1ac447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:19.155258 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28be93c-cdb8-4468-96ae-b19acc1ac447 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:19.167312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1380/2789] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:39:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:39:26.943668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:29.240877 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=14 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:35.054825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:35.056408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:35.125649 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cdfe0-d6de-42b2-a4a2-385cc8f2c661 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:35.130638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb56cb-22a3-4033-a1cc-bb623453a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:35.131516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb56cb-22a3-4033-a1cc-bb623453a641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:35.131801 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb56cb-22a3-4033-a1cc-bb623453a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:35.132079 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb56cb-22a3-4033-a1cc-bb623453a641 admin admin] PATH_INFO: `/v3/users/a727df3cf06746b8929de45d8ab5493c` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:35.133311 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb56cb-22a3-4033-a1cc-bb623453a641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a727df3cf06746b8929de45d8ab5493c)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:35.135227 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb56cb-22a3-4033-a1cc-bb623453a641 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:35.350988 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5adb56cb-22a3-4033-a1cc-bb623453a641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a727df3cf06746b8929de45d8ab5493c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:35.425244 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5adb56cb-22a3-4033-a1cc-bb623453a641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a727df3cf06746b8929de45d8ab5493c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:35.425862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5adb56cb-22a3-4033-a1cc-bb623453a641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a727df3cf06746b8929de45d8ab5493c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:35.438070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5adb56cb-22a3-4033-a1cc-bb623453a641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a727df3cf06746b8929de45d8ab5493c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:35.445009 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-5adb56cb-22a3-4033-a1cc-bb623453a641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a727df3cf06746b8929de45d8ab5493c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:35.451536 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1410/2790] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:39:35 2022] DELETE /identity/v3/users/a727df3cf06746b8929de45d8ab5493c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:35.753181 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28be93c-cdb8-4468-96ae-b19acc1ac447 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:35.764356 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28be93c-cdb8-4468-96ae-b19acc1ac447 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:35.822886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:35.823750 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:35.824036 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:35.824314 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880 admin admin] PATH_INFO: `/v3/projects/a25dceaf62a349efbe2d66be7be91fd4` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:35.825521 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25dceaf62a349efbe2d66be7be91fd4)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:35.827427 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:35.958144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25dceaf62a349efbe2d66be7be91fd4', 'request_id': 'req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:36.048126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25dceaf62a349efbe2d66be7be91fd4', 'request_id': 'req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:36.055166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25dceaf62a349efbe2d66be7be91fd4', 'request_id': 'req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:36.065834 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880 admin admin] The token cache is being invalidate because project a25dceaf62a349efbe2d66be7be91fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:39:36.066123 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:36.067442 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-7b16dc91-82d8-4f2c-95a4-cfba1ca8b880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:36.069026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1381/2791] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:39:35 2022] DELETE /identity/v3/projects/a25dceaf62a349efbe2d66be7be91fd4 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:36.074113 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84d64-168f-403b-886c-5226e2cabdd5 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:36.076179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84d64-168f-403b-886c-5226e2cabdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:36.076179 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84d64-168f-403b-886c-5226e2cabdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:36.092985 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-3fe84d64-168f-403b-886c-5226e2cabdd5 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:36.094224 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3fe84d64-168f-403b-886c-5226e2cabdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:36.152443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1411/2792] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:36.159998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab794d53-9e0f-42e8-876c-a1123d4544f0 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:36.160293 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab794d53-9e0f-42e8-876c-a1123d4544f0 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:36.160569 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab794d53-9e0f-42e8-876c-a1123d4544f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:36.179109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-ab794d53-9e0f-42e8-876c-a1123d4544f0 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:36.180299 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-ab794d53-9e0f-42e8-876c-a1123d4544f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:36.188121 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1382/2793] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:36.192794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84d64-168f-403b-886c-5226e2cabdd5 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:36.202639 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84d64-168f-403b-886c-5226e2cabdd5 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:36.207182 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fd50f-08b9-4eb1-ada9-4b1c56d0ef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:36.207831 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fd50f-08b9-4eb1-ada9-4b1c56d0ef0e admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:36.208121 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fd50f-08b9-4eb1-ada9-4b1c56d0ef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:36.208406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fd50f-08b9-4eb1-ada9-4b1c56d0ef0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:36.209162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fd50f-08b9-4eb1-ada9-4b1c56d0ef0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:39:36.209474 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fd50f-08b9-4eb1-ada9-4b1c56d0ef0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:36.211100 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fd50f-08b9-4eb1-ada9-4b1c56d0ef0e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:36.222477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1412/2794] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 16:39:36.233610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab794d53-9e0f-42e8-876c-a1123d4544f0 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:36.243437 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab794d53-9e0f-42e8-876c-a1123d4544f0 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:36.248075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ee81e-9af5-4d62-8c17-6a79320654b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:36.248723 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ee81e-9af5-4d62-8c17-6a79320654b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:36.249014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ee81e-9af5-4d62-8c17-6a79320654b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:36.249328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ee81e-9af5-4d62-8c17-6a79320654b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:36.250019 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ee81e-9af5-4d62-8c17-6a79320654b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:36.251936 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ee81e-9af5-4d62-8c17-6a79320654b7 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:36.353247 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1383/2795] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:39:36 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:36.357420 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fd50f-08b9-4eb1-ada9-4b1c56d0ef0e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:36.368183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fd50f-08b9-4eb1-ada9-4b1c56d0ef0e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:36.371905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:36.424304 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5d3e1-f7cb-4eba-a6ca-883df64d936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:36.424975 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5d3e1-f7cb-4eba-a6ca-883df64d936e admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:36.425291 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5d3e1-f7cb-4eba-a6ca-883df64d936e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:36.425602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5d3e1-f7cb-4eba-a6ca-883df64d936e admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:36.426870 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5d3e1-f7cb-4eba-a6ca-883df64d936e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:36.428851 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5d3e1-f7cb-4eba-a6ca-883df64d936e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:36.575105 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1413/2796] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:39:36 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:36.579142 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ee81e-9af5-4d62-8c17-6a79320654b7 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:36.590181 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ee81e-9af5-4d62-8c17-6a79320654b7 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:36.594767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4bee0-77a4-47f7-959f-031e49b25e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:36.595436 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4bee0-77a4-47f7-959f-031e49b25e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:36.595778 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4bee0-77a4-47f7-959f-031e49b25e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:36.596058 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4bee0-77a4-47f7-959f-031e49b25e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:36.596785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4bee0-77a4-47f7-959f-031e49b25e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:36.598402 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4bee0-77a4-47f7-959f-031e49b25e3d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:36.608465 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1384/2797] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:36.612186 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5d3e1-f7cb-4eba-a6ca-883df64d936e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:36.622394 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5d3e1-f7cb-4eba-a6ca-883df64d936e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:36.627010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5639564-9d74-4f2c-b1d2-8e7596ed0e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:36.627661 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5639564-9d74-4f2c-b1d2-8e7596ed0e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:36.627965 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5639564-9d74-4f2c-b1d2-8e7596ed0e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:36.628239 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5639564-9d74-4f2c-b1d2-8e7596ed0e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:36.629714 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5639564-9d74-4f2c-b1d2-8e7596ed0e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:36.631300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5639564-9d74-4f2c-b1d2-8e7596ed0e1f admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:36.641202 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1414/2798] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:36.646014 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4bee0-77a4-47f7-959f-031e49b25e3d admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:36.656172 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4bee0-77a4-47f7-959f-031e49b25e3d admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:36.660743 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bea1b1-26e9-4625-9fcc-c2c810a120b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:36.661635 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bea1b1-26e9-4625-9fcc-c2c810a120b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:36.661969 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bea1b1-26e9-4625-9fcc-c2c810a120b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:36.662253 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bea1b1-26e9-4625-9fcc-c2c810a120b7 admin admin] PATH_INFO: `/v3/projects/166f91d68b524d9994fdee07e3347136/users/8433769bc80e43abb0d852b9f0ebae6b/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:36.676675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bea1b1-26e9-4625-9fcc-c2c810a120b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=166f91d68b524d9994fdee07e3347136, user_id=8433769bc80e43abb0d852b9f0ebae6b, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:36.679345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bea1b1-26e9-4625-9fcc-c2c810a120b7 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:36.774332 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1385/2799] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:39:36 2022] PUT /identity/v3/projects/166f91d68b524d9994fdee07e3347136/users/8433769bc80e43abb0d852b9f0ebae6b/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:36.785140 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ce787-ddef-4401-936f-fdf0d64ce2f0 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:36.785445 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ce787-ddef-4401-936f-fdf0d64ce2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:36.785726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ce787-ddef-4401-936f-fdf0d64ce2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:36.812175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-b89ce787-ddef-4401-936f-fdf0d64ce2f0 None None] MFA Rules not processed for user `8433769bc80e43abb0d852b9f0ebae6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:36.813407 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b89ce787-ddef-4401-936f-fdf0d64ce2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:36.874825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1415/2800] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:36.886505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bea1b1-26e9-4625-9fcc-c2c810a120b7 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:36.888222 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-38bea1b1-26e9-4625-9fcc-c2c810a120b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:36.908291 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:36.960296 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bea1b1-26e9-4625-9fcc-c2c810a120b7 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:36.965967 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbabe30-3876-4a00-95de-989d6b778221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f36355ce7ff841f3bd9e228fbad64a83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:36.966612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbabe30-3876-4a00-95de-989d6b778221 service nova] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:36.966901 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbabe30-3876-4a00-95de-989d6b778221 service nova] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:36.967200 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbabe30-3876-4a00-95de-989d6b778221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:36.975412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbabe30-3876-4a00-95de-989d6b778221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:36.977022 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbabe30-3876-4a00-95de-989d6b778221 service nova] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:36.985658 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1386/2801] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:39:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:39:40.158948 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ce787-ddef-4401-936f-fdf0d64ce2f0 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:40.219131 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ce787-ddef-4401-936f-fdf0d64ce2f0 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:40.223623 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:40.224484 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:40.224772 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:40.225052 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] PATH_INFO: `/v3/users/8433769bc80e43abb0d852b9f0ebae6b` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:40.226259 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8433769bc80e43abb0d852b9f0ebae6b)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:40.228167 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:40.243609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:40.443253 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8433769bc80e43abb0d852b9f0ebae6b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:40.511175 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8433769bc80e43abb0d852b9f0ebae6b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:40.511798 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8433769bc80e43abb0d852b9f0ebae6b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:40.524743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8433769bc80e43abb0d852b9f0ebae6b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:40.531771 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8433769bc80e43abb0d852b9f0ebae6b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:40.538210 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1416/2802] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:39:40 2022] DELETE /identity/v3/users/8433769bc80e43abb0d852b9f0ebae6b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:40.542822 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cd372-652e-4900-89d3-b4ca4dbb3828 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:40.543298 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cd372-652e-4900-89d3-b4ca4dbb3828 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:40.543420 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cd372-652e-4900-89d3-b4ca4dbb3828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:40.560341 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-c21cd372-652e-4900-89d3-b4ca4dbb3828 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:40.561567 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c21cd372-652e-4900-89d3-b4ca4dbb3828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:40.619177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1387/2803] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:40.628864 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:40.630923 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:40.708999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609b11c-8e48-4db6-8028-c87edff830b6 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:40.712592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07690daa-ef15-42e0-9560-6dcdfa96d008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:40.713280 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07690daa-ef15-42e0-9560-6dcdfa96d008 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:40.713561 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07690daa-ef15-42e0-9560-6dcdfa96d008 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:40.713831 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07690daa-ef15-42e0-9560-6dcdfa96d008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:40.722715 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07690daa-ef15-42e0-9560-6dcdfa96d008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:40.724160 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07690daa-ef15-42e0-9560-6dcdfa96d008 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:40.733359 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1417/2804] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:39:41.133301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cd372-652e-4900-89d3-b4ca4dbb3828 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:41.134752 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-c21cd372-652e-4900-89d3-b4ca4dbb3828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:41.147043 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cd372-652e-4900-89d3-b4ca4dbb3828 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:41.152088 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34fa51-e857-47f3-9a33-aeda916cb30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:41.155260 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34fa51-e857-47f3-9a33-aeda916cb30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:41.155260 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34fa51-e857-47f3-9a33-aeda916cb30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:41.155260 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34fa51-e857-47f3-9a33-aeda916cb30b admin admin] PATH_INFO: `/v3/projects/166f91d68b524d9994fdee07e3347136` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:41.155260 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34fa51-e857-47f3-9a33-aeda916cb30b admin admin] RBAC: Authorizing `identity:delete_project(project_id=166f91d68b524d9994fdee07e3347136)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:41.156728 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34fa51-e857-47f3-9a33-aeda916cb30b admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:41.265394 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-6f34fa51-e857-47f3-9a33-aeda916cb30b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166f91d68b524d9994fdee07e3347136', 'request_id': 'req-6f34fa51-e857-47f3-9a33-aeda916cb30b'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:41.328116 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-6f34fa51-e857-47f3-9a33-aeda916cb30b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166f91d68b524d9994fdee07e3347136', 'request_id': 'req-6f34fa51-e857-47f3-9a33-aeda916cb30b'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:41.335194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-6f34fa51-e857-47f3-9a33-aeda916cb30b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166f91d68b524d9994fdee07e3347136', 'request_id': 'req-6f34fa51-e857-47f3-9a33-aeda916cb30b'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:41.345915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-6f34fa51-e857-47f3-9a33-aeda916cb30b admin admin] The token cache is being invalidate because project 166f91d68b524d9994fdee07e3347136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:39:41.346197 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-6f34fa51-e857-47f3-9a33-aeda916cb30b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:41.346812 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-6f34fa51-e857-47f3-9a33-aeda916cb30b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:41.348350 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1388/2805] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:39:41 2022] DELETE /identity/v3/projects/166f91d68b524d9994fdee07e3347136 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:41.353836 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f025480-b804-4d39-ad38-07745119ee73 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:41.354327 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f025480-b804-4d39-ad38-07745119ee73 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:41.354429 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f025480-b804-4d39-ad38-07745119ee73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:41.371693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-3f025480-b804-4d39-ad38-07745119ee73 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:41.372909 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3f025480-b804-4d39-ad38-07745119ee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:41.432345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1418/2806] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:41.440084 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d24de-2350-4846-890b-944ea7e61f07 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:41.440382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d24de-2350-4846-890b-944ea7e61f07 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:41.440669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d24de-2350-4846-890b-944ea7e61f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:41.459729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-548d24de-2350-4846-890b-944ea7e61f07 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:41.460934 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-548d24de-2350-4846-890b-944ea7e61f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:41.468821 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1389/2807] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:41.472998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f025480-b804-4d39-ad38-07745119ee73 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:41.483289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f025480-b804-4d39-ad38-07745119ee73 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:41.487733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac7c60-a1a7-4a0a-808a-1d8609e7a81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:41.488385 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7c60-a1a7-4a0a-808a-1d8609e7a81e admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:41.488675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7c60-a1a7-4a0a-808a-1d8609e7a81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:41.489074 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7c60-a1a7-4a0a-808a-1d8609e7a81e admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:41.490397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac7c60-a1a7-4a0a-808a-1d8609e7a81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:39:41.490702 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac7c60-a1a7-4a0a-808a-1d8609e7a81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:41.492286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac7c60-a1a7-4a0a-808a-1d8609e7a81e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:41.503578 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1419/2808] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:39:41.508212 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d24de-2350-4846-890b-944ea7e61f07 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:41.517456 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d24de-2350-4846-890b-944ea7e61f07 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:41.522020 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6324157-6ea6-4f7c-a16b-a416eed9a1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:41.522662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6324157-6ea6-4f7c-a16b-a416eed9a1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:41.522948 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6324157-6ea6-4f7c-a16b-a416eed9a1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:41.523228 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6324157-6ea6-4f7c-a16b-a416eed9a1b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:41.523920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6324157-6ea6-4f7c-a16b-a416eed9a1b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:41.525831 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6324157-6ea6-4f7c-a16b-a416eed9a1b9 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:41.597225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:41.604948 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1390/2809] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:39:41 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:41.608973 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac7c60-a1a7-4a0a-808a-1d8609e7a81e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:41.615984 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:41.619734 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac7c60-a1a7-4a0a-808a-1d8609e7a81e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:41.676887 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d812d9a-aa72-4327-adfc-bf0da1af9b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:41.677581 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d812d9a-aa72-4327-adfc-bf0da1af9b04 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:41.677868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d812d9a-aa72-4327-adfc-bf0da1af9b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:41.678146 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d812d9a-aa72-4327-adfc-bf0da1af9b04 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:41.678897 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d812d9a-aa72-4327-adfc-bf0da1af9b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:41.680855 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d812d9a-aa72-4327-adfc-bf0da1af9b04 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:41.760627 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1420/2810] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:39:41 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:39:41.764739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6324157-6ea6-4f7c-a16b-a416eed9a1b9 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:41.775577 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6324157-6ea6-4f7c-a16b-a416eed9a1b9 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:41.780104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b187b-92ca-40fc-8126-5039b05d38cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:41.780747 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b187b-92ca-40fc-8126-5039b05d38cf admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:41.781028 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b187b-92ca-40fc-8126-5039b05d38cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:41.781334 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b187b-92ca-40fc-8126-5039b05d38cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:41.782050 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b187b-92ca-40fc-8126-5039b05d38cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:41.783623 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b187b-92ca-40fc-8126-5039b05d38cf admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:41.794101 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1391/2811] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:41.798042 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d812d9a-aa72-4327-adfc-bf0da1af9b04 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:41.807919 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d812d9a-aa72-4327-adfc-bf0da1af9b04 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:41.812562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39294cb0-42b7-402b-b539-3414bf2093c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:41.813247 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39294cb0-42b7-402b-b539-3414bf2093c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:41.813533 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39294cb0-42b7-402b-b539-3414bf2093c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:41.813812 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39294cb0-42b7-402b-b539-3414bf2093c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:41.814540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39294cb0-42b7-402b-b539-3414bf2093c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:41.816143 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39294cb0-42b7-402b-b539-3414bf2093c5 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:41.826691 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1421/2812] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:41.830773 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b187b-92ca-40fc-8126-5039b05d38cf admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:41.841443 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b187b-92ca-40fc-8126-5039b05d38cf admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:41.846160 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6931dcb-7580-41f4-92c6-c5c67561695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:41.847097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6931dcb-7580-41f4-92c6-c5c67561695d admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:41.847382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6931dcb-7580-41f4-92c6-c5c67561695d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:41.847662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6931dcb-7580-41f4-92c6-c5c67561695d admin admin] PATH_INFO: `/v3/projects/35e4f693de184341ac7a49e4ae284b41/users/0c32fd1e74024fd0af5b002c750a7482/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:41.862097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6931dcb-7580-41f4-92c6-c5c67561695d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e4f693de184341ac7a49e4ae284b41, user_id=0c32fd1e74024fd0af5b002c750a7482, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:41.864811 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6931dcb-7580-41f4-92c6-c5c67561695d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:41.971517 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1392/2813] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:39:41 2022] PUT /identity/v3/projects/35e4f693de184341ac7a49e4ae284b41/users/0c32fd1e74024fd0af5b002c750a7482/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:39:41.989791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f4de7-e337-47ae-9b37-f38b2902c6ed None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:41.990091 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f4de7-e337-47ae-9b37-f38b2902c6ed None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:41.990377 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f4de7-e337-47ae-9b37-f38b2902c6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:42.016690 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-927f4de7-e337-47ae-9b37-f38b2902c6ed None None] MFA Rules not processed for user `0c32fd1e74024fd0af5b002c750a7482`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:42.017934 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-927f4de7-e337-47ae-9b37-f38b2902c6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:42.080421 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1422/2814] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:42.085016 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6931dcb-7580-41f4-92c6-c5c67561695d admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:42.145800 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6931dcb-7580-41f4-92c6-c5c67561695d admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:42.150531 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb0266-606f-4731-b64d-f1259fa685ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:42.151178 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb0266-606f-4731-b64d-f1259fa685ac admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:42.151461 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb0266-606f-4731-b64d-f1259fa685ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:42.151738 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb0266-606f-4731-b64d-f1259fa685ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:42.152447 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb0266-606f-4731-b64d-f1259fa685ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:42.154364 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb0266-606f-4731-b64d-f1259fa685ac admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:42.255591 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1393/2815] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:39:42 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:42.259625 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f4de7-e337-47ae-9b37-f38b2902c6ed None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:42.270436 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f4de7-e337-47ae-9b37-f38b2902c6ed None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:42.326207 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd81fa-749a-46a5-a9ce-6dcf5485911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:42.326878 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd81fa-749a-46a5-a9ce-6dcf5485911c admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:42.327165 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd81fa-749a-46a5-a9ce-6dcf5485911c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:42.327442 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd81fa-749a-46a5-a9ce-6dcf5485911c admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:42.328142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd81fa-749a-46a5-a9ce-6dcf5485911c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:42.330172 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd81fa-749a-46a5-a9ce-6dcf5485911c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:42.446581 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1423/2816] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:39:42 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:42.450564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb0266-606f-4731-b64d-f1259fa685ac admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:42.461227 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb0266-606f-4731-b64d-f1259fa685ac admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:42.465958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41724e83-bc1b-4128-897f-50fb5e7c8c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:42.466746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41724e83-bc1b-4128-897f-50fb5e7c8c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:42.467039 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41724e83-bc1b-4128-897f-50fb5e7c8c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:42.467318 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41724e83-bc1b-4128-897f-50fb5e7c8c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:42.468079 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41724e83-bc1b-4128-897f-50fb5e7c8c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:42.469746 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41724e83-bc1b-4128-897f-50fb5e7c8c59 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:42.480944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1394/2817] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:42.485265 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd81fa-749a-46a5-a9ce-6dcf5485911c admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:42.491183 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:42.496366 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd81fa-749a-46a5-a9ce-6dcf5485911c admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:42.500930 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25093b5-6768-406f-aa1c-5eeacda5e830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:42.501880 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25093b5-6768-406f-aa1c-5eeacda5e830 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:42.502162 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25093b5-6768-406f-aa1c-5eeacda5e830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:42.502437 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25093b5-6768-406f-aa1c-5eeacda5e830 admin admin] PATH_INFO: `/v3/projects/c9bb8a6f2ca941f7a8dff2e8bb484bfd/users/66a691aa429f43a59a8f13319e9558b4/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:42.516488 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25093b5-6768-406f-aa1c-5eeacda5e830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bb8a6f2ca941f7a8dff2e8bb484bfd, user_id=66a691aa429f43a59a8f13319e9558b4, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:42.519307 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25093b5-6768-406f-aa1c-5eeacda5e830 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:42.588472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1424/2818] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:39:42 2022] PUT /identity/v3/projects/c9bb8a6f2ca941f7a8dff2e8bb484bfd/users/66a691aa429f43a59a8f13319e9558b4/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:42.592431 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41724e83-bc1b-4128-897f-50fb5e7c8c59 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:42.602943 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41724e83-bc1b-4128-897f-50fb5e7c8c59 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:42.657593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b60ee-7a0e-46d7-aeb0-dc8875f7807a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:42.658322 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b60ee-7a0e-46d7-aeb0-dc8875f7807a admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:42.658605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b60ee-7a0e-46d7-aeb0-dc8875f7807a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:42.658886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b60ee-7a0e-46d7-aeb0-dc8875f7807a admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:42.659598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b60ee-7a0e-46d7-aeb0-dc8875f7807a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:42.661686 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b60ee-7a0e-46d7-aeb0-dc8875f7807a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:42.671359 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1395/2819] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:42.675383 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25093b5-6768-406f-aa1c-5eeacda5e830 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:42.686240 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25093b5-6768-406f-aa1c-5eeacda5e830 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:42.690842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5020cda-0d89-4c1d-a0ef-12a04d7ef3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:42.691713 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5020cda-0d89-4c1d-a0ef-12a04d7ef3de admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:42.691997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5020cda-0d89-4c1d-a0ef-12a04d7ef3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:42.692272 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5020cda-0d89-4c1d-a0ef-12a04d7ef3de admin admin] PATH_INFO: `/v3/projects/c9bb8a6f2ca941f7a8dff2e8bb484bfd/users/66a691aa429f43a59a8f13319e9558b4/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:42.694276 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5020cda-0d89-4c1d-a0ef-12a04d7ef3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bb8a6f2ca941f7a8dff2e8bb484bfd, user_id=66a691aa429f43a59a8f13319e9558b4, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:42.697006 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5020cda-0d89-4c1d-a0ef-12a04d7ef3de admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:42.706999 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1425/2820] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:39:42 2022] PUT /identity/v3/projects/c9bb8a6f2ca941f7a8dff2e8bb484bfd/users/66a691aa429f43a59a8f13319e9558b4/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:42.718671 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed65fa-a8ab-405b-bfa7-c9dd02257e6f None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:42.718971 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed65fa-a8ab-405b-bfa7-c9dd02257e6f None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:42.719255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed65fa-a8ab-405b-bfa7-c9dd02257e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:42.745490 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-dbed65fa-a8ab-405b-bfa7-c9dd02257e6f None None] MFA Rules not processed for user `66a691aa429f43a59a8f13319e9558b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:42.746699 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-dbed65fa-a8ab-405b-bfa7-c9dd02257e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:42.766177 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:42.814592 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1396/2821] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:42.825905 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5020cda-0d89-4c1d-a0ef-12a04d7ef3de admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:42.827605 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b5020cda-0d89-4c1d-a0ef-12a04d7ef3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:42.885572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5020cda-0d89-4c1d-a0ef-12a04d7ef3de admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:42.889181 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346d7d0-0ddf-4a52-a4be-cc3828344f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:42.889821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346d7d0-0ddf-4a52-a4be-cc3828344f28 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:42.890106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346d7d0-0ddf-4a52-a4be-cc3828344f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:42.890385 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346d7d0-0ddf-4a52-a4be-cc3828344f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:42.899743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346d7d0-0ddf-4a52-a4be-cc3828344f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:42.901225 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346d7d0-0ddf-4a52-a4be-cc3828344f28 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:42.910502 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1426/2822] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:39:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:39:43.871478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed65fa-a8ab-405b-bfa7-c9dd02257e6f None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:43.933502 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed65fa-a8ab-405b-bfa7-c9dd02257e6f None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:43.937976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:43.938839 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:43.939152 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:43.939430 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] PATH_INFO: `/v3/users/0c32fd1e74024fd0af5b002c750a7482` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:43.940612 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c32fd1e74024fd0af5b002c750a7482)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:43.942694 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:44.115682 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c32fd1e74024fd0af5b002c750a7482'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:44.173644 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c32fd1e74024fd0af5b002c750a7482'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:44.186382 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c32fd1e74024fd0af5b002c750a7482'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:44.187073 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c32fd1e74024fd0af5b002c750a7482'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:44.193906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c32fd1e74024fd0af5b002c750a7482'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:44.199758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1397/2823] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:39:43 2022] DELETE /identity/v3/users/0c32fd1e74024fd0af5b002c750a7482 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:44.204273 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2100-e0a8-4e45-ad6b-734ac7d71b8e None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:44.204755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2100-e0a8-4e45-ad6b-734ac7d71b8e None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:44.204896 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2100-e0a8-4e45-ad6b-734ac7d71b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:44.222434 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e18e2100-e0a8-4e45-ad6b-734ac7d71b8e None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:44.224291 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e18e2100-e0a8-4e45-ad6b-734ac7d71b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:44.281189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1427/2824] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:44.291585 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:44.293038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:44.334765 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:44.350140 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be35d4b-7c69-4200-ad21-f613fe053018 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:44.353954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f1485-9e03-4e14-920d-171d6edfcc6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:44.354593 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f1485-9e03-4e14-920d-171d6edfcc6c service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:44.354881 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f1485-9e03-4e14-920d-171d6edfcc6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:44.355156 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f1485-9e03-4e14-920d-171d6edfcc6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:44.364173 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f1485-9e03-4e14-920d-171d6edfcc6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:44.365659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f1485-9e03-4e14-920d-171d6edfcc6c service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:44.375188 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1398/2825] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:39:44.741935 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e2100-e0a8-4e45-ad6b-734ac7d71b8e None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:44.743354 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e18e2100-e0a8-4e45-ad6b-734ac7d71b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:44.755441 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e2100-e0a8-4e45-ad6b-734ac7d71b8e None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:44.760140 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:44.761020 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:44.761348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:44.761626 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] PATH_INFO: `/v3/projects/35e4f693de184341ac7a49e4ae284b41` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:44.762906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e4f693de184341ac7a49e4ae284b41)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:44.764963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:44.880430 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e4f693de184341ac7a49e4ae284b41', 'request_id': 'req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:44.945327 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e4f693de184341ac7a49e4ae284b41', 'request_id': 'req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:44.950058 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:44.952363 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e4f693de184341ac7a49e4ae284b41', 'request_id': 'req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:44.962949 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] The token cache is being invalidate because project 35e4f693de184341ac7a49e4ae284b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:39:44.963237 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:44.963863 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:44.965520 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1428/2826] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:39:44 2022] DELETE /identity/v3/projects/35e4f693de184341ac7a49e4ae284b41 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:44.969472 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f1485-9e03-4e14-920d-171d6edfcc6c service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:44.980026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f1485-9e03-4e14-920d-171d6edfcc6c service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:45.036162 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cc351-eddc-4bc3-8278-9eddd19624b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:45.037930 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cc351-eddc-4bc3-8278-9eddd19624b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:45.038471 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cc351-eddc-4bc3-8278-9eddd19624b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:45.038471 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cc351-eddc-4bc3-8278-9eddd19624b8 admin admin] PATH_INFO: `/v3/users/66a691aa429f43a59a8f13319e9558b4` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:45.040060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cc351-eddc-4bc3-8278-9eddd19624b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a691aa429f43a59a8f13319e9558b4)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:45.042033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cc351-eddc-4bc3-8278-9eddd19624b8 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:45.205219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ce1cc351-eddc-4bc3-8278-9eddd19624b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a691aa429f43a59a8f13319e9558b4'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:45.271259 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ce1cc351-eddc-4bc3-8278-9eddd19624b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a691aa429f43a59a8f13319e9558b4'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:45.283744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ce1cc351-eddc-4bc3-8278-9eddd19624b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a691aa429f43a59a8f13319e9558b4'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:45.284399 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ce1cc351-eddc-4bc3-8278-9eddd19624b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a691aa429f43a59a8f13319e9558b4'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:45.291662 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ce1cc351-eddc-4bc3-8278-9eddd19624b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a691aa429f43a59a8f13319e9558b4'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:45.297637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1399/2827] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:39:44 2022] DELETE /identity/v3/users/66a691aa429f43a59a8f13319e9558b4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:45.712963 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:45.714442 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:45.727334 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb0ba8-ebfd-4f98-8fc1-be06608dd73b admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:45.785368 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fa79f-abac-48c9-8bf3-816148f4bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:45.786200 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fa79f-abac-48c9-8bf3-816148f4bc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:45.786490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fa79f-abac-48c9-8bf3-816148f4bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:45.786888 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fa79f-abac-48c9-8bf3-816148f4bc7c admin admin] PATH_INFO: `/v3/projects/c9bb8a6f2ca941f7a8dff2e8bb484bfd` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:45.788306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fa79f-abac-48c9-8bf3-816148f4bc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9bb8a6f2ca941f7a8dff2e8bb484bfd)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:45.790298 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fa79f-abac-48c9-8bf3-816148f4bc7c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:45.894585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-119fa79f-abac-48c9-8bf3-816148f4bc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9bb8a6f2ca941f7a8dff2e8bb484bfd', 'request_id': 'req-119fa79f-abac-48c9-8bf3-816148f4bc7c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:45.959850 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-119fa79f-abac-48c9-8bf3-816148f4bc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9bb8a6f2ca941f7a8dff2e8bb484bfd', 'request_id': 'req-119fa79f-abac-48c9-8bf3-816148f4bc7c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:45.965922 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-119fa79f-abac-48c9-8bf3-816148f4bc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9bb8a6f2ca941f7a8dff2e8bb484bfd', 'request_id': 'req-119fa79f-abac-48c9-8bf3-816148f4bc7c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:45.977062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-119fa79f-abac-48c9-8bf3-816148f4bc7c admin admin] The token cache is being invalidate because project c9bb8a6f2ca941f7a8dff2e8bb484bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:39:45.977397 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-119fa79f-abac-48c9-8bf3-816148f4bc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:45.978027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-119fa79f-abac-48c9-8bf3-816148f4bc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:45.979612 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1429/2828] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:39:45 2022] DELETE /identity/v3/projects/c9bb8a6f2ca941f7a8dff2e8bb484bfd => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:39:45.984614 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5aeb-84c6-419d-8fc6-a079bfb5f97b None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:45.985149 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5aeb-84c6-419d-8fc6-a079bfb5f97b None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:45.985308 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5aeb-84c6-419d-8fc6-a079bfb5f97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:46.003110 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-18bb5aeb-84c6-419d-8fc6-a079bfb5f97b None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:46.004321 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-18bb5aeb-84c6-419d-8fc6-a079bfb5f97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:46.055400 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:46.063734 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1400/2829] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:46.072191 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a7154-5a39-41e3-82e4-adfdc97c3a9f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:46.072483 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a7154-5a39-41e3-82e4-adfdc97c3a9f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:46.072765 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a7154-5a39-41e3-82e4-adfdc97c3a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:46.091638 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-866a7154-5a39-41e3-82e4-adfdc97c3a9f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:46.092836 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-866a7154-5a39-41e3-82e4-adfdc97c3a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:46.101461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1430/2830] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:46.105622 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb5aeb-84c6-419d-8fc6-a079bfb5f97b None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:46.116044 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb5aeb-84c6-419d-8fc6-a079bfb5f97b None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:46.121155 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9b3e7-0e14-41cf-87cd-44e199b8f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:46.121798 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9b3e7-0e14-41cf-87cd-44e199b8f83a admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:46.122082 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9b3e7-0e14-41cf-87cd-44e199b8f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:46.122389 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9b3e7-0e14-41cf-87cd-44e199b8f83a admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:46.123100 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9b3e7-0e14-41cf-87cd-44e199b8f83a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:39:46.123405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9b3e7-0e14-41cf-87cd-44e199b8f83a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:46.124978 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9b3e7-0e14-41cf-87cd-44e199b8f83a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:46.136261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1401/2831] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:39:46.140477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a7154-5a39-41e3-82e4-adfdc97c3a9f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:46.149585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a7154-5a39-41e3-82e4-adfdc97c3a9f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:46.154173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15005cee-3504-49bf-b3d8-bb45fb14f646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:46.154816 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005cee-3504-49bf-b3d8-bb45fb14f646 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:46.155099 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005cee-3504-49bf-b3d8-bb45fb14f646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:46.155376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005cee-3504-49bf-b3d8-bb45fb14f646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:46.156067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15005cee-3504-49bf-b3d8-bb45fb14f646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:46.158004 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15005cee-3504-49bf-b3d8-bb45fb14f646 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:46.242805 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1431/2832] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:39:46 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:46.247125 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9b3e7-0e14-41cf-87cd-44e199b8f83a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:46.257271 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9b3e7-0e14-41cf-87cd-44e199b8f83a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:46.313026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08479b8f-f68b-42e0-9238-9878a6f44fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:46.313719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08479b8f-f68b-42e0-9238-9878a6f44fbf admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:46.314012 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08479b8f-f68b-42e0-9238-9878a6f44fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:46.314294 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08479b8f-f68b-42e0-9238-9878a6f44fbf admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:46.314977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08479b8f-f68b-42e0-9238-9878a6f44fbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:46.316913 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08479b8f-f68b-42e0-9238-9878a6f44fbf admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:46.383067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1402/2833] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:39:46 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:46.387196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15005cee-3504-49bf-b3d8-bb45fb14f646 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:46.397509 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15005cee-3504-49bf-b3d8-bb45fb14f646 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:46.402137 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eff90b-8cda-49fe-bc22-b3e798b3e473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:46.402794 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eff90b-8cda-49fe-bc22-b3e798b3e473 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:46.403077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eff90b-8cda-49fe-bc22-b3e798b3e473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:46.403351 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eff90b-8cda-49fe-bc22-b3e798b3e473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:46.404081 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eff90b-8cda-49fe-bc22-b3e798b3e473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:46.405709 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eff90b-8cda-49fe-bc22-b3e798b3e473 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:46.416889 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1432/2834] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:46.420927 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08479b8f-f68b-42e0-9238-9878a6f44fbf admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:46.431574 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08479b8f-f68b-42e0-9238-9878a6f44fbf admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:46.436251 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf64cd-43d4-47c4-b529-c71775e84307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:46.436905 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf64cd-43d4-47c4-b529-c71775e84307 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:46.437304 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf64cd-43d4-47c4-b529-c71775e84307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:46.437595 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf64cd-43d4-47c4-b529-c71775e84307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:46.438319 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf64cd-43d4-47c4-b529-c71775e84307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:46.439915 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf64cd-43d4-47c4-b529-c71775e84307 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:46.450131 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1403/2835] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:46.454066 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eff90b-8cda-49fe-bc22-b3e798b3e473 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:46.464751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eff90b-8cda-49fe-bc22-b3e798b3e473 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:46.469440 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225de58a-3ae5-4c6b-85ad-c0b923b8a00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:46.476590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225de58a-3ae5-4c6b-85ad-c0b923b8a00a admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:46.476590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225de58a-3ae5-4c6b-85ad-c0b923b8a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:46.476590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225de58a-3ae5-4c6b-85ad-c0b923b8a00a admin admin] PATH_INFO: `/v3/projects/ed23c36555f64ed78563ffa7eadd372d/users/b1244ad958c242528e361fbff8b613ad/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:46.486379 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225de58a-3ae5-4c6b-85ad-c0b923b8a00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed23c36555f64ed78563ffa7eadd372d, user_id=b1244ad958c242528e361fbff8b613ad, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:46.489007 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225de58a-3ae5-4c6b-85ad-c0b923b8a00a admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:46.577252 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1433/2836] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:39:46 2022] PUT /identity/v3/projects/ed23c36555f64ed78563ffa7eadd372d/users/b1244ad958c242528e361fbff8b613ad/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:46.587954 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b001f0-ed16-4180-af1b-3e1d6b775e85 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:46.588256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b001f0-ed16-4180-af1b-3e1d6b775e85 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:46.588559 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b001f0-ed16-4180-af1b-3e1d6b775e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:46.615277 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-d1b001f0-ed16-4180-af1b-3e1d6b775e85 None None] MFA Rules not processed for user `b1244ad958c242528e361fbff8b613ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:46.616495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-d1b001f0-ed16-4180-af1b-3e1d6b775e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:46.679422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1404/2837] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:46.684069 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225de58a-3ae5-4c6b-85ad-c0b923b8a00a admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:46.702793 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:46.744693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225de58a-3ae5-4c6b-85ad-c0b923b8a00a admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:46.749364 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001064f-61f4-4782-9869-fd299bc35db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:46.750014 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001064f-61f4-4782-9869-fd299bc35db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:46.750297 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001064f-61f4-4782-9869-fd299bc35db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:46.750573 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001064f-61f4-4782-9869-fd299bc35db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:46.751257 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001064f-61f4-4782-9869-fd299bc35db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:46.753233 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001064f-61f4-4782-9869-fd299bc35db1 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:46.824308 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1434/2838] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:39:46 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:46.828464 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b001f0-ed16-4180-af1b-3e1d6b775e85 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:46.839799 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b001f0-ed16-4180-af1b-3e1d6b775e85 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:46.887476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:46.894263 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcb627-bdcc-45a4-a0cc-3c344608fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:46.894921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb627-bdcc-45a4-a0cc-3c344608fd05 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:46.895206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb627-bdcc-45a4-a0cc-3c344608fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:46.896235 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb627-bdcc-45a4-a0cc-3c344608fd05 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:46.896956 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcb627-bdcc-45a4-a0cc-3c344608fd05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:46.898934 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcb627-bdcc-45a4-a0cc-3c344608fd05 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:46.988788 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1405/2839] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:39:46 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:46.992743 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001064f-61f4-4782-9869-fd299bc35db1 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:47.002987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001064f-61f4-4782-9869-fd299bc35db1 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:47.008128 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76497c69-68c7-41cc-a5ac-bf6c80a97c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:47.008785 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76497c69-68c7-41cc-a5ac-bf6c80a97c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:47.009067 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76497c69-68c7-41cc-a5ac-bf6c80a97c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:47.009395 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76497c69-68c7-41cc-a5ac-bf6c80a97c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:47.010153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76497c69-68c7-41cc-a5ac-bf6c80a97c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:47.011740 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76497c69-68c7-41cc-a5ac-bf6c80a97c11 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:47.023184 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1435/2840] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:47.027420 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcb627-bdcc-45a4-a0cc-3c344608fd05 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:47.038010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcb627-bdcc-45a4-a0cc-3c344608fd05 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:47.042724 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cc61f-ce35-48a4-954d-2835d27c80f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:47.043603 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cc61f-ce35-48a4-954d-2835d27c80f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:47.043889 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cc61f-ce35-48a4-954d-2835d27c80f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:47.044169 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cc61f-ce35-48a4-954d-2835d27c80f5 admin admin] PATH_INFO: `/v3/projects/ca17d5a81445414293c4fae748f81a76/users/08df0fa6f1d04ff3bd8cc20e51c893a9/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:47.059257 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cc61f-ce35-48a4-954d-2835d27c80f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca17d5a81445414293c4fae748f81a76, user_id=08df0fa6f1d04ff3bd8cc20e51c893a9, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:47.062000 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cc61f-ce35-48a4-954d-2835d27c80f5 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:47.146158 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1406/2841] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:39:47 2022] PUT /identity/v3/projects/ca17d5a81445414293c4fae748f81a76/users/08df0fa6f1d04ff3bd8cc20e51c893a9/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:47.150030 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76497c69-68c7-41cc-a5ac-bf6c80a97c11 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:47.159824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76497c69-68c7-41cc-a5ac-bf6c80a97c11 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:47.216241 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f6f66-d809-430d-8376-d9bc963e5475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:47.216900 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f6f66-d809-430d-8376-d9bc963e5475 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:47.217209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f6f66-d809-430d-8376-d9bc963e5475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:47.217486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f6f66-d809-430d-8376-d9bc963e5475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:47.218203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f6f66-d809-430d-8376-d9bc963e5475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:47.219791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f6f66-d809-430d-8376-d9bc963e5475 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:47.229701 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1436/2842] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:47.234034 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cc61f-ce35-48a4-954d-2835d27c80f5 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:47.244976 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cc61f-ce35-48a4-954d-2835d27c80f5 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:47.249614 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d0cdb-992b-48bc-8172-aab7c5421474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:47.253280 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d0cdb-992b-48bc-8172-aab7c5421474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:47.253280 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d0cdb-992b-48bc-8172-aab7c5421474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:47.253280 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d0cdb-992b-48bc-8172-aab7c5421474 admin admin] PATH_INFO: `/v3/projects/ca17d5a81445414293c4fae748f81a76/users/08df0fa6f1d04ff3bd8cc20e51c893a9/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:47.253280 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d0cdb-992b-48bc-8172-aab7c5421474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca17d5a81445414293c4fae748f81a76, user_id=08df0fa6f1d04ff3bd8cc20e51c893a9, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:47.256207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d0cdb-992b-48bc-8172-aab7c5421474 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:47.266438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1407/2843] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:39:47 2022] PUT /identity/v3/projects/ca17d5a81445414293c4fae748f81a76/users/08df0fa6f1d04ff3bd8cc20e51c893a9/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:47.327309 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8201371-d4a2-4bec-b5bd-48f03d73d04a None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:47.327602 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8201371-d4a2-4bec-b5bd-48f03d73d04a None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:47.327884 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8201371-d4a2-4bec-b5bd-48f03d73d04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:47.354920 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-a8201371-d4a2-4bec-b5bd-48f03d73d04a None None] MFA Rules not processed for user `08df0fa6f1d04ff3bd8cc20e51c893a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:47.356170 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a8201371-d4a2-4bec-b5bd-48f03d73d04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:47.422784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1437/2844] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:47.434192 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d0cdb-992b-48bc-8172-aab7c5421474 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:47.435972 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-569d0cdb-992b-48bc-8172-aab7c5421474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:47.493458 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d0cdb-992b-48bc-8172-aab7c5421474 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:47.497109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44232201-4407-432b-806a-a834ff7e8be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:47.497789 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232201-4407-432b-806a-a834ff7e8be8 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:47.498074 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232201-4407-432b-806a-a834ff7e8be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:47.498353 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232201-4407-432b-806a-a834ff7e8be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:47.553540 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44232201-4407-432b-806a-a834ff7e8be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:47.554998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44232201-4407-432b-806a-a834ff7e8be8 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:47.563701 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1408/2845] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:39:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:39:49.264180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8201371-d4a2-4bec-b5bd-48f03d73d04a None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:49.264180 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-a8201371-d4a2-4bec-b5bd-48f03d73d04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:49.276614 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8201371-d4a2-4bec-b5bd-48f03d73d04a None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:49.280106 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7eb44-333b-4a79-86b1-792b5c0145b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:49.280751 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7eb44-333b-4a79-86b1-792b5c0145b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:49.281035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7eb44-333b-4a79-86b1-792b5c0145b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:49.281346 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7eb44-333b-4a79-86b1-792b5c0145b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:49.291670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7eb44-333b-4a79-86b1-792b5c0145b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:49.293142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7eb44-333b-4a79-86b1-792b5c0145b3 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:49.298095 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:49.303339 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1438/2846] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:39:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:39:53.510707 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44232201-4407-432b-806a-a834ff7e8be8 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:53.571452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44232201-4407-432b-806a-a834ff7e8be8 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:53.575899 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:53.576823 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:53.577109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:53.577413 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] PATH_INFO: `/v3/users/b1244ad958c242528e361fbff8b613ad` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:53.578580 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1244ad958c242528e361fbff8b613ad)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:53.580510 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:53.582804 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:53.761878 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1244ad958c242528e361fbff8b613ad'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:53.836770 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1244ad958c242528e361fbff8b613ad'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:53.848928 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1244ad958c242528e361fbff8b613ad'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:53.850102 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1244ad958c242528e361fbff8b613ad'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:53.856942 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1244ad958c242528e361fbff8b613ad'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:53.863026 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1409/2847] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:39:53 2022] DELETE /identity/v3/users/b1244ad958c242528e361fbff8b613ad => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:53.868314 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c35ca-683a-46e9-aa5a-87166776c2c7 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:53.868814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c35ca-683a-46e9-aa5a-87166776c2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:53.868931 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c35ca-683a-46e9-aa5a-87166776c2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:53.886173 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-982c35ca-683a-46e9-aa5a-87166776c2c7 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:53.887385 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-982c35ca-683a-46e9-aa5a-87166776c2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:53.945873 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1439/2848] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:53.955626 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:53.957042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:54.013328 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1694eed-3ee5-4874-94ae-50894dbb6965 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:54.017065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31b200-a182-467e-83bf-74edc2f66cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:54.017785 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31b200-a182-467e-83bf-74edc2f66cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:54.018067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31b200-a182-467e-83bf-74edc2f66cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:54.018365 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31b200-a182-467e-83bf-74edc2f66cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:54.027582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31b200-a182-467e-83bf-74edc2f66cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:54.029040 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31b200-a182-467e-83bf-74edc2f66cc7 service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:54.039345 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1410/2849] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:39:54.404401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c35ca-683a-46e9-aa5a-87166776c2c7 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:54.405833 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-982c35ca-683a-46e9-aa5a-87166776c2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:54.419071 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c35ca-683a-46e9-aa5a-87166776c2c7 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:54.423692 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:54.424676 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:54.424962 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:54.425275 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] PATH_INFO: `/v3/projects/ed23c36555f64ed78563ffa7eadd372d` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:54.426453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed23c36555f64ed78563ffa7eadd372d)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:54.428981 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:54.520330 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed23c36555f64ed78563ffa7eadd372d', 'request_id': 'req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:54.577240 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed23c36555f64ed78563ffa7eadd372d', 'request_id': 'req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:54.582951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed23c36555f64ed78563ffa7eadd372d', 'request_id': 'req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:54.594386 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] The token cache is being invalidate because project ed23c36555f64ed78563ffa7eadd372d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:39:54.594668 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:54.595306 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:54.596862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1440/2850] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:39:54 2022] DELETE /identity/v3/projects/ed23c36555f64ed78563ffa7eadd372d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:54.601596 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31b200-a182-467e-83bf-74edc2f66cc7 service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:54.611103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31b200-a182-467e-83bf-74edc2f66cc7 service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:54.666512 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cd99e-5904-44d1-843c-e65c595f4bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:54.667405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cd99e-5904-44d1-843c-e65c595f4bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:54.667692 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cd99e-5904-44d1-843c-e65c595f4bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:54.667973 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cd99e-5904-44d1-843c-e65c595f4bcc admin admin] PATH_INFO: `/v3/users/08df0fa6f1d04ff3bd8cc20e51c893a9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:54.669165 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cd99e-5904-44d1-843c-e65c595f4bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=08df0fa6f1d04ff3bd8cc20e51c893a9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:54.671075 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cd99e-5904-44d1-843c-e65c595f4bcc admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:54.791653 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:54.917245 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-375cd99e-5904-44d1-843c-e65c595f4bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08df0fa6f1d04ff3bd8cc20e51c893a9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:55.002254 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-375cd99e-5904-44d1-843c-e65c595f4bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08df0fa6f1d04ff3bd8cc20e51c893a9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:55.014546 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-375cd99e-5904-44d1-843c-e65c595f4bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08df0fa6f1d04ff3bd8cc20e51c893a9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:55.015190 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-375cd99e-5904-44d1-843c-e65c595f4bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08df0fa6f1d04ff3bd8cc20e51c893a9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:55.022357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-375cd99e-5904-44d1-843c-e65c595f4bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08df0fa6f1d04ff3bd8cc20e51c893a9'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:55.028295 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1411/2851] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:39:54 2022] DELETE /identity/v3/users/08df0fa6f1d04ff3bd8cc20e51c893a9 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:55.445749 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:55.446275 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:55.460686 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bad0d5-9141-4ab1-aaa0-eaaac08ad523 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:55.525440 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:55.526357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:55.526670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:55.526950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229 admin admin] PATH_INFO: `/v3/projects/ca17d5a81445414293c4fae748f81a76` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:55.528225 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca17d5a81445414293c4fae748f81a76)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:55.530401 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:55.633371 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:55.649540 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca17d5a81445414293c4fae748f81a76', 'request_id': 'req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:55.714387 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca17d5a81445414293c4fae748f81a76', 'request_id': 'req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:55.720087 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca17d5a81445414293c4fae748f81a76', 'request_id': 'req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:55.730814 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229 admin admin] The token cache is being invalidate because project ca17d5a81445414293c4fae748f81a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:39:55.731102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:55.731727 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-7d06ea8a-f233-47ff-b5bf-d66ad88ce229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:55.733289 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1441/2852] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:39:55 2022] DELETE /identity/v3/projects/ca17d5a81445414293c4fae748f81a76 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:55.738256 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34e6d6-d951-479e-8fac-14091cc941e2 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:55.738754 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34e6d6-d951-479e-8fac-14091cc941e2 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:55.738876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34e6d6-d951-479e-8fac-14091cc941e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:55.756183 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-0d34e6d6-d951-479e-8fac-14091cc941e2 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:55.758112 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0d34e6d6-d951-479e-8fac-14091cc941e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:55.816944 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1412/2853] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:55.825477 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341389d-24c0-4885-a695-e3472b96a6d2 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:55.825787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341389d-24c0-4885-a695-e3472b96a6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:55.826083 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341389d-24c0-4885-a695-e3472b96a6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:55.843871 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-1341389d-24c0-4885-a695-e3472b96a6d2 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:55.845068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1341389d-24c0-4885-a695-e3472b96a6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:55.853062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1442/2854] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:55.857299 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34e6d6-d951-479e-8fac-14091cc941e2 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:55.867475 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34e6d6-d951-479e-8fac-14091cc941e2 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:55.872080 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d346f-1dd6-4afb-90bc-93088edd8512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:55.872763 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d346f-1dd6-4afb-90bc-93088edd8512 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:55.873065 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d346f-1dd6-4afb-90bc-93088edd8512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:55.877489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d346f-1dd6-4afb-90bc-93088edd8512 admin admin] PATH_INFO: `/v3/domains` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:55.877489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d346f-1dd6-4afb-90bc-93088edd8512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:39:55.877489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d346f-1dd6-4afb-90bc-93088edd8512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:55.877489 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d346f-1dd6-4afb-90bc-93088edd8512 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:55.888591 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1413/2855] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:39:55.892717 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341389d-24c0-4885-a695-e3472b96a6d2 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:55.902590 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341389d-24c0-4885-a695-e3472b96a6d2 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:55.907407 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4d1fa-e874-48a1-a388-c31b60793388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:55.908103 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4d1fa-e874-48a1-a388-c31b60793388 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:55.908391 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4d1fa-e874-48a1-a388-c31b60793388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:55.908674 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4d1fa-e874-48a1-a388-c31b60793388 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:55.909463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4d1fa-e874-48a1-a388-c31b60793388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:55.911404 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4d1fa-e874-48a1-a388-c31b60793388 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:56.000728 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1443/2856] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:39:55 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:56.004855 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d346f-1dd6-4afb-90bc-93088edd8512 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:56.015372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d346f-1dd6-4afb-90bc-93088edd8512 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:56.070329 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f446ca8-ec5e-4c4d-85f5-29ec6636e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:56.070999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f446ca8-ec5e-4c4d-85f5-29ec6636e580 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:56.071288 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f446ca8-ec5e-4c4d-85f5-29ec6636e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:56.071566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f446ca8-ec5e-4c4d-85f5-29ec6636e580 admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:56.072261 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f446ca8-ec5e-4c4d-85f5-29ec6636e580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:56.074221 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f446ca8-ec5e-4c4d-85f5-29ec6636e580 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:56.166446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1414/2857] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:39:56 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:56.170598 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4d1fa-e874-48a1-a388-c31b60793388 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:56.180857 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4d1fa-e874-48a1-a388-c31b60793388 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:56.185579 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698104-1a9a-41ca-993f-a9c6ad34171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:56.186237 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698104-1a9a-41ca-993f-a9c6ad34171e admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:56.186527 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698104-1a9a-41ca-993f-a9c6ad34171e admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:56.186807 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698104-1a9a-41ca-993f-a9c6ad34171e admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:56.187538 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd698104-1a9a-41ca-993f-a9c6ad34171e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:56.189164 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd698104-1a9a-41ca-993f-a9c6ad34171e admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:56.199516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1444/2858] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:56.203495 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f446ca8-ec5e-4c4d-85f5-29ec6636e580 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:56.214033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f446ca8-ec5e-4c4d-85f5-29ec6636e580 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:56.218659 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d3b9e-dd21-47e9-9789-28bed7529ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:56.219311 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d3b9e-dd21-47e9-9789-28bed7529ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:56.219598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d3b9e-dd21-47e9-9789-28bed7529ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:56.219876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d3b9e-dd21-47e9-9789-28bed7529ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:56.220605 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d3b9e-dd21-47e9-9789-28bed7529ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:56.222215 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d3b9e-dd21-47e9-9789-28bed7529ff6 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:56.232614 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1415/2859] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:56.237109 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698104-1a9a-41ca-993f-a9c6ad34171e admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:56.246864 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698104-1a9a-41ca-993f-a9c6ad34171e admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:56.251572 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d955d6-990e-41e6-8c0f-414e6f945765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:56.252387 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d955d6-990e-41e6-8c0f-414e6f945765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:56.252673 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d955d6-990e-41e6-8c0f-414e6f945765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:56.252950 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d955d6-990e-41e6-8c0f-414e6f945765 admin admin] PATH_INFO: `/v3/projects/038b4532934f4d49ad4a2f7273f1f5c4/users/2184e292b11449ab98e0eac5ca6ee293/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:56.267430 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d955d6-990e-41e6-8c0f-414e6f945765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038b4532934f4d49ad4a2f7273f1f5c4, user_id=2184e292b11449ab98e0eac5ca6ee293, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:56.270150 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d955d6-990e-41e6-8c0f-414e6f945765 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:56.367735 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1445/2860] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:39:56 2022] PUT /identity/v3/projects/038b4532934f4d49ad4a2f7273f1f5c4/users/2184e292b11449ab98e0eac5ca6ee293/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:56.378071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0188ab-bbec-4c35-a8bc-7b2040bae558 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:56.378369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0188ab-bbec-4c35-a8bc-7b2040bae558 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:56.378654 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0188ab-bbec-4c35-a8bc-7b2040bae558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:56.396708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:56.405488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-1f0188ab-bbec-4c35-a8bc-7b2040bae558 None None] MFA Rules not processed for user `2184e292b11449ab98e0eac5ca6ee293`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:56.406716 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-1f0188ab-bbec-4c35-a8bc-7b2040bae558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:56.472146 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1416/2861] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:56.476726 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d955d6-990e-41e6-8c0f-414e6f945765 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:56.538003 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d955d6-990e-41e6-8c0f-414e6f945765 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:56.542518 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f124-6aba-4d39-9477-6b7e23665dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:56.543171 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f124-6aba-4d39-9477-6b7e23665dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:56.543481 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f124-6aba-4d39-9477-6b7e23665dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:56.543750 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f124-6aba-4d39-9477-6b7e23665dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:56.544453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526f124-6aba-4d39-9477-6b7e23665dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:56.546357 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526f124-6aba-4d39-9477-6b7e23665dd6 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:56.626688 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1446/2862] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:39:56 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:56.630786 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0188ab-bbec-4c35-a8bc-7b2040bae558 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:56.642035 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0188ab-bbec-4c35-a8bc-7b2040bae558 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:56.698613 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d950ab-6ed5-401b-a912-a82ff0ab440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:56.699279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d950ab-6ed5-401b-a912-a82ff0ab440a admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:56.699565 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d950ab-6ed5-401b-a912-a82ff0ab440a admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:56.699842 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d950ab-6ed5-401b-a912-a82ff0ab440a admin admin] PATH_INFO: `/v3/users` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:56.700536 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d950ab-6ed5-401b-a912-a82ff0ab440a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:56.702499 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d950ab-6ed5-401b-a912-a82ff0ab440a admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:56.790886 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1417/2863] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:39:56 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:56.794837 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f124-6aba-4d39-9477-6b7e23665dd6 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:56.804928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f124-6aba-4d39-9477-6b7e23665dd6 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:56.809514 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07eaa2-7e7b-470d-93c8-ca66a4a28dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:56.810223 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07eaa2-7e7b-470d-93c8-ca66a4a28dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:56.810506 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07eaa2-7e7b-470d-93c8-ca66a4a28dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:56.810778 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07eaa2-7e7b-470d-93c8-ca66a4a28dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:56.811500 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07eaa2-7e7b-470d-93c8-ca66a4a28dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:56.813084 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07eaa2-7e7b-470d-93c8-ca66a4a28dcf admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:56.823940 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1447/2864] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:56.827868 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d950ab-6ed5-401b-a912-a82ff0ab440a admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:56.838435 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d950ab-6ed5-401b-a912-a82ff0ab440a admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:56.843029 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397de89-b8bf-42dd-8f1c-c2602ada0837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:56.843902 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397de89-b8bf-42dd-8f1c-c2602ada0837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:56.844189 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397de89-b8bf-42dd-8f1c-c2602ada0837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:56.844471 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397de89-b8bf-42dd-8f1c-c2602ada0837 admin admin] PATH_INFO: `/v3/projects/c25d9e8f188842bb97c832191af8d2f7/users/3d6b087a66f34b05ab72452bd2d85402/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:56.859995 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397de89-b8bf-42dd-8f1c-c2602ada0837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25d9e8f188842bb97c832191af8d2f7, user_id=3d6b087a66f34b05ab72452bd2d85402, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:56.862697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397de89-b8bf-42dd-8f1c-c2602ada0837 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:56.961103 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1418/2865] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:39:56 2022] PUT /identity/v3/projects/c25d9e8f188842bb97c832191af8d2f7/users/3d6b087a66f34b05ab72452bd2d85402/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:56.965102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07eaa2-7e7b-470d-93c8-ca66a4a28dcf admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:56.975124 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07eaa2-7e7b-470d-93c8-ca66a4a28dcf admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:56.995077 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:57.032591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cfe6d-1b1f-4a05-b921-4f1e75c5777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:57.033296 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cfe6d-1b1f-4a05-b921-4f1e75c5777b admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:57.033592 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cfe6d-1b1f-4a05-b921-4f1e75c5777b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:57.033877 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cfe6d-1b1f-4a05-b921-4f1e75c5777b admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:57.034586 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cfe6d-1b1f-4a05-b921-4f1e75c5777b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:57.038913 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cfe6d-1b1f-4a05-b921-4f1e75c5777b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:57.051093 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1448/2866] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:39:57.054464 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397de89-b8bf-42dd-8f1c-c2602ada0837 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:57.065138 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397de89-b8bf-42dd-8f1c-c2602ada0837 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:57.070527 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebaab41-6eb3-4b2f-a859-ceb739b8978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:57.071421 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaab41-6eb3-4b2f-a859-ceb739b8978b admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:57.071709 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaab41-6eb3-4b2f-a859-ceb739b8978b admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:57.071992 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaab41-6eb3-4b2f-a859-ceb739b8978b admin admin] PATH_INFO: `/v3/projects/c25d9e8f188842bb97c832191af8d2f7/users/3d6b087a66f34b05ab72452bd2d85402/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:57.074213 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebaab41-6eb3-4b2f-a859-ceb739b8978b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25d9e8f188842bb97c832191af8d2f7, user_id=3d6b087a66f34b05ab72452bd2d85402, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:57.076906 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebaab41-6eb3-4b2f-a859-ceb739b8978b admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:57.088138 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1419/2867] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:39:57 2022] PUT /identity/v3/projects/c25d9e8f188842bb97c832191af8d2f7/users/3d6b087a66f34b05ab72452bd2d85402/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:39:57.099439 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa5ee1-3c05-49b0-9f5b-bb88f91c6e0b None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:57.099733 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa5ee1-3c05-49b0-9f5b-bb88f91c6e0b None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:57.100017 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa5ee1-3c05-49b0-9f5b-bb88f91c6e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:57.127195 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-bdaa5ee1-3c05-49b0-9f5b-bb88f91c6e0b None None] MFA Rules not processed for user `3d6b087a66f34b05ab72452bd2d85402`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:57.128450 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-bdaa5ee1-3c05-49b0-9f5b-bb88f91c6e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:57.196941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1449/2868] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:57.209340 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebaab41-6eb3-4b2f-a859-ceb739b8978b admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:57.211578 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-cebaab41-6eb3-4b2f-a859-ceb739b8978b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:57.269640 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebaab41-6eb3-4b2f-a859-ceb739b8978b admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:57.273916 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f127975-cb43-4260-ac94-7035399eb060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:57.274564 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127975-cb43-4260-ac94-7035399eb060 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:57.274852 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127975-cb43-4260-ac94-7035399eb060 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:57.275193 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127975-cb43-4260-ac94-7035399eb060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:57.281273 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:57.285275 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f127975-cb43-4260-ac94-7035399eb060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:57.286719 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f127975-cb43-4260-ac94-7035399eb060 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:57.296781 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1420/2869] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:39:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:39:58.200152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa5ee1-3c05-49b0-9f5b-bb88f91c6e0b None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:58.209463 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa5ee1-3c05-49b0-9f5b-bb88f91c6e0b None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:58.214716 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed64611-d13a-4342-a6b9-a7d16e2b2306 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6b087a66f34b05ab72452bd2d85402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25d9e8f188842bb97c832191af8d2f7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:58.215376 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed64611-d13a-4342-a6b9-a7d16e2b2306 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:58.215670 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed64611-d13a-4342-a6b9-a7d16e2b2306 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:58.215951 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed64611-d13a-4342-a6b9-a7d16e2b2306 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:58.216682 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed64611-d13a-4342-a6b9-a7d16e2b2306 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:39:58.216995 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed64611-d13a-4342-a6b9-a7d16e2b2306 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:58.218681 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed64611-d13a-4342-a6b9-a7d16e2b2306 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:58.230115 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1450/2870] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:39:58.234492 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f127975-cb43-4260-ac94-7035399eb060 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:58.243482 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f127975-cb43-4260-ac94-7035399eb060 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:58.248129 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f15fa-b5f7-42ad-9855-4adfa1b15e03 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6b087a66f34b05ab72452bd2d85402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25d9e8f188842bb97c832191af8d2f7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:58.248769 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f15fa-b5f7-42ad-9855-4adfa1b15e03 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:58.249060 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f15fa-b5f7-42ad-9855-4adfa1b15e03 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:58.249372 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f15fa-b5f7-42ad-9855-4adfa1b15e03 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:58.250059 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f15fa-b5f7-42ad-9855-4adfa1b15e03 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:58.251939 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f15fa-b5f7-42ad-9855-4adfa1b15e03 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:58.421923 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1421/2871] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:39:58 2022] POST /identity/v3/projects => generated 353 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:39:58.425991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed64611-d13a-4342-a6b9-a7d16e2b2306 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:58.436755 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed64611-d13a-4342-a6b9-a7d16e2b2306 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:58.493209 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda63cf-4ef4-487e-bc98-e010ed1a5e14 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6b087a66f34b05ab72452bd2d85402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25d9e8f188842bb97c832191af8d2f7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:58.493903 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda63cf-4ef4-487e-bc98-e010ed1a5e14 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:58.494194 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda63cf-4ef4-487e-bc98-e010ed1a5e14 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:58.494475 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda63cf-4ef4-487e-bc98-e010ed1a5e14 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:58.495201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda63cf-4ef4-487e-bc98-e010ed1a5e14 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:39:58.495512 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda63cf-4ef4-487e-bc98-e010ed1a5e14 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:58.497107 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda63cf-4ef4-487e-bc98-e010ed1a5e14 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:58.509132 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1451/2872] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:39:58.544840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f15fa-b5f7-42ad-9855-4adfa1b15e03 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:58.555415 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f15fa-b5f7-42ad-9855-4adfa1b15e03 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:58.559904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff225696-3125-46d7-8e5d-884871ce856b tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d6b087a66f34b05ab72452bd2d85402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25d9e8f188842bb97c832191af8d2f7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:58.560760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff225696-3125-46d7-8e5d-884871ce856b tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:58.561047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff225696-3125-46d7-8e5d-884871ce856b tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:58.561357 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff225696-3125-46d7-8e5d-884871ce856b tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] PATH_INFO: `/v3/projects/e5678caf8c104075be4efc89212aeb3a` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:58.562534 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff225696-3125-46d7-8e5d-884871ce856b tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e5678caf8c104075be4efc89212aeb3a)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:58.564412 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff225696-3125-46d7-8e5d-884871ce856b tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:58.737203 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ff225696-3125-46d7-8e5d-884871ce856b tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5678caf8c104075be4efc89212aeb3a', 'request_id': 'req-ff225696-3125-46d7-8e5d-884871ce856b'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:58.805214 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ff225696-3125-46d7-8e5d-884871ce856b tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5678caf8c104075be4efc89212aeb3a', 'request_id': 'req-ff225696-3125-46d7-8e5d-884871ce856b'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:58.811987 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ff225696-3125-46d7-8e5d-884871ce856b tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5678caf8c104075be4efc89212aeb3a', 'request_id': 'req-ff225696-3125-46d7-8e5d-884871ce856b'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:58.822892 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ff225696-3125-46d7-8e5d-884871ce856b tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] The token cache is being invalidate because project e5678caf8c104075be4efc89212aeb3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:39:58.823180 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ff225696-3125-46d7-8e5d-884871ce856b tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:58.823825 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-ff225696-3125-46d7-8e5d-884871ce856b tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:58.825404 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1422/2873] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:39:58 2022] DELETE /identity/v3/projects/e5678caf8c104075be4efc89212aeb3a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:59.380769 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda63cf-4ef4-487e-bc98-e010ed1a5e14 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:59.386832 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-7cda63cf-4ef4-487e-bc98-e010ed1a5e14 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:59.413707 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=100 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:59.448998 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda63cf-4ef4-487e-bc98-e010ed1a5e14 tempest-VolumeQuotaClassesTest-1257248230 tempest-VolumeQuotaClassesTest-1257248230-project-admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:59.505787 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:59.507261 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:59.507547 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:59.507824 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] PATH_INFO: `/v3/users/2184e292b11449ab98e0eac5ca6ee293` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:59.509065 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2184e292b11449ab98e0eac5ca6ee293)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:59.511027 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:59.676528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2184e292b11449ab98e0eac5ca6ee293'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:59.744675 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2184e292b11449ab98e0eac5ca6ee293'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:59.745328 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2184e292b11449ab98e0eac5ca6ee293'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:59.757443 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2184e292b11449ab98e0eac5ca6ee293'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:59.764141 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2184e292b11449ab98e0eac5ca6ee293'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:39:59.770101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1452/2874] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:39:59 2022] DELETE /identity/v3/users/2184e292b11449ab98e0eac5ca6ee293 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:39:59.774582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150498d-3e94-4a01-8847-bb6bc1e1b424 None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:59.775057 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150498d-3e94-4a01-8847-bb6bc1e1b424 None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:59.775168 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150498d-3e94-4a01-8847-bb6bc1e1b424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:59.792284 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-0150498d-3e94-4a01-8847-bb6bc1e1b424 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:39:59.793508 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0150498d-3e94-4a01-8847-bb6bc1e1b424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:59.849600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1423/2875] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:39:59.859544 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:39:59.860928 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:39:59.918035 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aad02a-9ce3-4b09-9d01-b37b061819a8 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:39:59.921665 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c9c0e-aa6b-438c-ad95-3be79108a489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:39:59.922310 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c9c0e-aa6b-438c-ad95-3be79108a489 service neutron] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:39:59.922591 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c9c0e-aa6b-438c-ad95-3be79108a489 service neutron] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:39:59.922863 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c9c0e-aa6b-438c-ad95-3be79108a489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:39:59.929969 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:39:59.932203 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c9c0e-aa6b-438c-ad95-3be79108a489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:39:59.933691 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c9c0e-aa6b-438c-ad95-3be79108a489 service neutron] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:39:59.943197 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1453/2876] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:40:00.384737 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150498d-3e94-4a01-8847-bb6bc1e1b424 None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:00.386281 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0150498d-3e94-4a01-8847-bb6bc1e1b424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:00.399067 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150498d-3e94-4a01-8847-bb6bc1e1b424 None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:00.404864 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:00.405758 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:00.409999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:00.409999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] PATH_INFO: `/v3/projects/038b4532934f4d49ad4a2f7273f1f5c4` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:00.409999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=038b4532934f4d49ad4a2f7273f1f5c4)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:00.409999 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:00.509287 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038b4532934f4d49ad4a2f7273f1f5c4', 'request_id': 'req-e6ed9f03-d85c-418a-8f05-e3a74cfed833'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:00.510942 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:40:00.610945 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038b4532934f4d49ad4a2f7273f1f5c4', 'request_id': 'req-e6ed9f03-d85c-418a-8f05-e3a74cfed833'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:00.617450 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038b4532934f4d49ad4a2f7273f1f5c4', 'request_id': 'req-e6ed9f03-d85c-418a-8f05-e3a74cfed833'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:00.627797 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] The token cache is being invalidate because project 038b4532934f4d49ad4a2f7273f1f5c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:40:00.628087 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:00.628739 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:00.631042 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1424/2877] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:40:00 2022] DELETE /identity/v3/projects/038b4532934f4d49ad4a2f7273f1f5c4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 16:40:00.635546 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c9c0e-aa6b-438c-ad95-3be79108a489 service neutron] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:00.645057 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c9c0e-aa6b-438c-ad95-3be79108a489 service neutron] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:00.701916 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f108a9-404f-4f05-a2b1-b783d4a7d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:00.702800 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f108a9-404f-4f05-a2b1-b783d4a7d68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:00.703068 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f108a9-404f-4f05-a2b1-b783d4a7d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:00.703344 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f108a9-404f-4f05-a2b1-b783d4a7d68b admin admin] PATH_INFO: `/v3/users/3d6b087a66f34b05ab72452bd2d85402` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:00.704517 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f108a9-404f-4f05-a2b1-b783d4a7d68b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6b087a66f34b05ab72452bd2d85402)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:00.706461 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f108a9-404f-4f05-a2b1-b783d4a7d68b admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:00.839679 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-34f108a9-404f-4f05-a2b1-b783d4a7d68b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6b087a66f34b05ab72452bd2d85402'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:00.893153 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-34f108a9-404f-4f05-a2b1-b783d4a7d68b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6b087a66f34b05ab72452bd2d85402'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:00.893780 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-34f108a9-404f-4f05-a2b1-b783d4a7d68b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6b087a66f34b05ab72452bd2d85402'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:00.905843 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-34f108a9-404f-4f05-a2b1-b783d4a7d68b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6b087a66f34b05ab72452bd2d85402'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:00.912974 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-34f108a9-404f-4f05-a2b1-b783d4a7d68b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6b087a66f34b05ab72452bd2d85402'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:00.918959 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1454/2878] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:40:00 2022] DELETE /identity/v3/users/3d6b087a66f34b05ab72452bd2d85402 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:40:01.492638 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:01.494206 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:01.507583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed9f03-d85c-418a-8f05-e3a74cfed833 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:01.564460 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1011765-ad20-4ee7-8324-6abe8aa2f003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:01.565369 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1011765-ad20-4ee7-8324-6abe8aa2f003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:01.565656 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1011765-ad20-4ee7-8324-6abe8aa2f003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:01.565932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1011765-ad20-4ee7-8324-6abe8aa2f003 admin admin] PATH_INFO: `/v3/projects/c25d9e8f188842bb97c832191af8d2f7` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:01.567093 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1011765-ad20-4ee7-8324-6abe8aa2f003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c25d9e8f188842bb97c832191af8d2f7)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:01.568983 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1011765-ad20-4ee7-8324-6abe8aa2f003 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:01.690991 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d1011765-ad20-4ee7-8324-6abe8aa2f003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c25d9e8f188842bb97c832191af8d2f7', 'request_id': 'req-d1011765-ad20-4ee7-8324-6abe8aa2f003'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:01.756863 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d1011765-ad20-4ee7-8324-6abe8aa2f003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c25d9e8f188842bb97c832191af8d2f7', 'request_id': 'req-d1011765-ad20-4ee7-8324-6abe8aa2f003'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:01.763462 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d1011765-ad20-4ee7-8324-6abe8aa2f003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c25d9e8f188842bb97c832191af8d2f7', 'request_id': 'req-d1011765-ad20-4ee7-8324-6abe8aa2f003'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:01.774477 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d1011765-ad20-4ee7-8324-6abe8aa2f003 admin admin] The token cache is being invalidate because project c25d9e8f188842bb97c832191af8d2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:40:01.774767 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d1011765-ad20-4ee7-8324-6abe8aa2f003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:01.775446 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-d1011765-ad20-4ee7-8324-6abe8aa2f003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:01.777027 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1425/2879] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:40:01 2022] DELETE /identity/v3/projects/c25d9e8f188842bb97c832191af8d2f7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:40:01.782022 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda73af-e195-4459-9435-6e76e7f70d76 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:01.782486 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda73af-e195-4459-9435-6e76e7f70d76 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:01.782610 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda73af-e195-4459-9435-6e76e7f70d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:01.801585 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-3cda73af-e195-4459-9435-6e76e7f70d76 None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:40:01.802791 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-3cda73af-e195-4459-9435-6e76e7f70d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:01.861019 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1455/2880] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:40:01.868643 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90fbfc-d488-40d7-87e1-6a41d127ebbf None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:01.868932 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90fbfc-d488-40d7-87e1-6a41d127ebbf None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:01.869236 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90fbfc-d488-40d7-87e1-6a41d127ebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:01.887476 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-8c90fbfc-d488-40d7-87e1-6a41d127ebbf None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:40:01.888680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-8c90fbfc-d488-40d7-87e1-6a41d127ebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:01.896529 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1426/2881] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:40:01.901258 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda73af-e195-4459-9435-6e76e7f70d76 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:01.910804 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda73af-e195-4459-9435-6e76e7f70d76 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:01.915553 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046e226-453f-4b09-884f-c01a81ce47a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:01.916189 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046e226-453f-4b09-884f-c01a81ce47a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:01.916472 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046e226-453f-4b09-884f-c01a81ce47a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:01.916744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046e226-453f-4b09-884f-c01a81ce47a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:01.917528 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046e226-453f-4b09-884f-c01a81ce47a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 16:40:01.917836 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046e226-453f-4b09-884f-c01a81ce47a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:01.919423 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046e226-453f-4b09-884f-c01a81ce47a9 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:01.930882 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1456/2882] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 16:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 16:40:01.935033 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90fbfc-d488-40d7-87e1-6a41d127ebbf None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:01.944210 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90fbfc-d488-40d7-87e1-6a41d127ebbf None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:01.949279 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76c521-ea6a-49d5-a611-6f0018ed3dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:01.949920 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76c521-ea6a-49d5-a611-6f0018ed3dde admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:01.950207 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76c521-ea6a-49d5-a611-6f0018ed3dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:01.950478 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76c521-ea6a-49d5-a611-6f0018ed3dde admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:01.951159 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76c521-ea6a-49d5-a611-6f0018ed3dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:01.953041 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76c521-ea6a-49d5-a611-6f0018ed3dde admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:02.037937 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1427/2883] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:40:01 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:40:02.042045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046e226-453f-4b09-884f-c01a81ce47a9 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:02.047126 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:40:02.052291 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046e226-453f-4b09-884f-c01a81ce47a9 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:02.108707 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b97f19-50d2-4905-a219-1de7e3b890c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:02.109408 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b97f19-50d2-4905-a219-1de7e3b890c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:02.109700 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b97f19-50d2-4905-a219-1de7e3b890c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:02.109978 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b97f19-50d2-4905-a219-1de7e3b890c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:02.110663 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b97f19-50d2-4905-a219-1de7e3b890c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:02.112584 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b97f19-50d2-4905-a219-1de7e3b890c0 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:02.203015 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1457/2884] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:40:02 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:40:02.206963 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76c521-ea6a-49d5-a611-6f0018ed3dde admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:02.217144 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76c521-ea6a-49d5-a611-6f0018ed3dde admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:02.221697 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc5854-7578-433c-9963-080abb05f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:02.222376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc5854-7578-433c-9963-080abb05f579 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:02.223839 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc5854-7578-433c-9963-080abb05f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:02.223839 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc5854-7578-433c-9963-080abb05f579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:02.223839 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc5854-7578-433c-9963-080abb05f579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:02.225229 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc5854-7578-433c-9963-080abb05f579 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:02.235506 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1428/2885] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:40:02.239406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b97f19-50d2-4905-a219-1de7e3b890c0 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:02.250070 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b97f19-50d2-4905-a219-1de7e3b890c0 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:02.254761 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f522089-df3a-46a5-9535-b6d4b521c0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:02.255415 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f522089-df3a-46a5-9535-b6d4b521c0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:02.255702 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f522089-df3a-46a5-9535-b6d4b521c0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:02.255984 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f522089-df3a-46a5-9535-b6d4b521c0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:02.256719 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f522089-df3a-46a5-9535-b6d4b521c0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:02.259028 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f522089-df3a-46a5-9535-b6d4b521c0e9 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:02.269188 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1458/2886] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 16:40:02.273191 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc5854-7578-433c-9963-080abb05f579 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:02.283037 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc5854-7578-433c-9963-080abb05f579 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:02.288198 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f0893-99d4-45b8-aaec-94b0f75f33d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:02.289066 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f0893-99d4-45b8-aaec-94b0f75f33d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:02.289376 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f0893-99d4-45b8-aaec-94b0f75f33d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:02.289655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f0893-99d4-45b8-aaec-94b0f75f33d8 admin admin] PATH_INFO: `/v3/projects/90e8461fb578478bbf66e65711826b83/users/f0714495db3c47d7a9ccd406e986e78e/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:02.303840 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f0893-99d4-45b8-aaec-94b0f75f33d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e8461fb578478bbf66e65711826b83, user_id=f0714495db3c47d7a9ccd406e986e78e, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:02.307049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f0893-99d4-45b8-aaec-94b0f75f33d8 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:02.368940 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1429/2887] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:40:02 2022] PUT /identity/v3/projects/90e8461fb578478bbf66e65711826b83/users/f0714495db3c47d7a9ccd406e986e78e/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:40:02.380356 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062ca5-8b95-4026-bacb-eed05befe426 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:02.380653 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062ca5-8b95-4026-bacb-eed05befe426 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:02.380941 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062ca5-8b95-4026-bacb-eed05befe426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:02.407549 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-1b062ca5-8b95-4026-bacb-eed05befe426 None None] MFA Rules not processed for user `f0714495db3c47d7a9ccd406e986e78e`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:40:02.408795 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1b062ca5-8b95-4026-bacb-eed05befe426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:02.472821 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1459/2888] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:40:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:40:02.477338 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f0893-99d4-45b8-aaec-94b0f75f33d8 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:02.482977 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:40:02.537537 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f0893-99d4-45b8-aaec-94b0f75f33d8 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:02.542959 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a866a-9148-44d1-a5da-b8e52c7ded10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:02.543675 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a866a-9148-44d1-a5da-b8e52c7ded10 admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:02.544010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a866a-9148-44d1-a5da-b8e52c7ded10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:02.544313 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a866a-9148-44d1-a5da-b8e52c7ded10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:02.545047 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a866a-9148-44d1-a5da-b8e52c7ded10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:02.547021 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a866a-9148-44d1-a5da-b8e52c7ded10 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:02.621049 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1430/2889] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:40:02 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:40:02.624901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b062ca5-8b95-4026-bacb-eed05befe426 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:02.635530 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b062ca5-8b95-4026-bacb-eed05befe426 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:02.690202 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f90f7f-6ee3-4e62-aae4-20f116f59ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:02.690862 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f90f7f-6ee3-4e62-aae4-20f116f59ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:02.691145 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f90f7f-6ee3-4e62-aae4-20f116f59ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:02.691419 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f90f7f-6ee3-4e62-aae4-20f116f59ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:02.692102 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f90f7f-6ee3-4e62-aae4-20f116f59ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:02.694041 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f90f7f-6ee3-4e62-aae4-20f116f59ea1 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:02.746120 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:40:02.750901 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1460/2890] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:40:02 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:40:02.754874 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a866a-9148-44d1-a5da-b8e52c7ded10 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:02.765876 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a866a-9148-44d1-a5da-b8e52c7ded10 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:02.770582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba45917-2e2b-44d0-94b6-a7285f129304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:02.771238 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba45917-2e2b-44d0-94b6-a7285f129304 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:02.771526 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba45917-2e2b-44d0-94b6-a7285f129304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:02.771807 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba45917-2e2b-44d0-94b6-a7285f129304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:02.772614 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba45917-2e2b-44d0-94b6-a7285f129304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:02.774793 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba45917-2e2b-44d0-94b6-a7285f129304 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:02.786194 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1431/2891] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:40:02.790414 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f90f7f-6ee3-4e62-aae4-20f116f59ea1 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:02.800906 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f90f7f-6ee3-4e62-aae4-20f116f59ea1 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:02.808130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d4569-828a-41e2-a396-ee4bb91244b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:02.808130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d4569-828a-41e2-a396-ee4bb91244b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:02.808130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d4569-828a-41e2-a396-ee4bb91244b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:02.808130 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d4569-828a-41e2-a396-ee4bb91244b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:02.808582 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d4569-828a-41e2-a396-ee4bb91244b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:02.809010 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d4569-828a-41e2-a396-ee4bb91244b7 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:02.819016 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1461/2892] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:40:02.823384 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba45917-2e2b-44d0-94b6-a7285f129304 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:02.833420 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba45917-2e2b-44d0-94b6-a7285f129304 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:02.838829 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9348b5-6723-4b7e-bced-15c3d8547563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:02.839708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9348b5-6723-4b7e-bced-15c3d8547563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:02.839998 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9348b5-6723-4b7e-bced-15c3d8547563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:02.840280 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9348b5-6723-4b7e-bced-15c3d8547563 admin admin] PATH_INFO: `/v3/projects/e1b702a70c7f4d389357fb673c439c32/users/15aa27cfd40c4d8daaeebd7a8790da11/roles/1b578241384b4a3698242fde91cc1769` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:02.854974 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9348b5-6723-4b7e-bced-15c3d8547563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b702a70c7f4d389357fb673c439c32, user_id=15aa27cfd40c4d8daaeebd7a8790da11, role_id=1b578241384b4a3698242fde91cc1769)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:02.857681 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9348b5-6723-4b7e-bced-15c3d8547563 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:02.925438 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1432/2893] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:40:02 2022] PUT /identity/v3/projects/e1b702a70c7f4d389357fb673c439c32/users/15aa27cfd40c4d8daaeebd7a8790da11/roles/1b578241384b4a3698242fde91cc1769 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:40:02.936029 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1190a-0fe0-44cf-9fba-4d34440bc018 None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:02.936318 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1190a-0fe0-44cf-9fba-4d34440bc018 None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:02.936594 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1190a-0fe0-44cf-9fba-4d34440bc018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:02.964763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-e3a1190a-0fe0-44cf-9fba-4d34440bc018 None None] MFA Rules not processed for user `15aa27cfd40c4d8daaeebd7a8790da11`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:40:02.965979 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-e3a1190a-0fe0-44cf-9fba-4d34440bc018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:03.027848 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1462/2894] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:40:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:40:03.032244 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9348b5-6723-4b7e-bced-15c3d8547563 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:03.093838 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9348b5-6723-4b7e-bced-15c3d8547563 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:03.098488 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fa41f-ae3c-423c-aef0-13cbd2bbd9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:03.099142 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fa41f-ae3c-423c-aef0-13cbd2bbd9cc admin admin] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:03.099433 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fa41f-ae3c-423c-aef0-13cbd2bbd9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:03.099715 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fa41f-ae3c-423c-aef0-13cbd2bbd9cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:03.100411 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fa41f-ae3c-423c-aef0-13cbd2bbd9cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:03.102351 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fa41f-ae3c-423c-aef0-13cbd2bbd9cc admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:03.192330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1433/2895] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 16:40:03 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 16:40:03.197286 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1190a-0fe0-44cf-9fba-4d34440bc018 None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:03.207868 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1190a-0fe0-44cf-9fba-4d34440bc018 None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:03.262125 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dea97-2942-4604-a2f9-a4a58e63c5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:03.262792 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dea97-2942-4604-a2f9-a4a58e63c5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:03.263073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dea97-2942-4604-a2f9-a4a58e63c5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:03.263348 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dea97-2942-4604-a2f9-a4a58e63c5b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:03.264045 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dea97-2942-4604-a2f9-a4a58e63c5b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:03.266018 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dea97-2942-4604-a2f9-a4a58e63c5b4 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:03.388066 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1463/2896] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 16:40:03 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 16:40:03.391952 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fa41f-ae3c-423c-aef0-13cbd2bbd9cc admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:03.402312 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fa41f-ae3c-423c-aef0-13cbd2bbd9cc admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:03.406933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022ebb6-be12-43be-ad22-ddd02c85670f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:03.407599 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022ebb6-be12-43be-ad22-ddd02c85670f admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:03.407883 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022ebb6-be12-43be-ad22-ddd02c85670f admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:03.408166 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022ebb6-be12-43be-ad22-ddd02c85670f admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:03.408925 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022ebb6-be12-43be-ad22-ddd02c85670f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:03.410610 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022ebb6-be12-43be-ad22-ddd02c85670f admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:03.421950 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1434/2897] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:40:03.425997 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dea97-2942-4604-a2f9-a4a58e63c5b4 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:03.436493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dea97-2942-4604-a2f9-a4a58e63c5b4 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:03.441048 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1d669-1cd8-45f8-a680-40efb001f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:03.441952 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1d669-1cd8-45f8-a680-40efb001f5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:03.442238 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1d669-1cd8-45f8-a680-40efb001f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:03.442516 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1d669-1cd8-45f8-a680-40efb001f5a3 admin admin] PATH_INFO: `/v3/projects/de90a717f1074853b82f5841f48a2ce7/users/d3d73a73a726487e86a22fa0202dd306/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:03.460037 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1d669-1cd8-45f8-a680-40efb001f5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de90a717f1074853b82f5841f48a2ce7, user_id=d3d73a73a726487e86a22fa0202dd306, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:03.462744 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1d669-1cd8-45f8-a680-40efb001f5a3 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:03.568055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1464/2898] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:40:03 2022] PUT /identity/v3/projects/de90a717f1074853b82f5841f48a2ce7/users/d3d73a73a726487e86a22fa0202dd306/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:40:03.572505 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022ebb6-be12-43be-ad22-ddd02c85670f admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:03.582791 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022ebb6-be12-43be-ad22-ddd02c85670f admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:03.608814 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:40:03.639421 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54601e9a-836d-4ecf-85b1-36007b662617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:03.640013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54601e9a-836d-4ecf-85b1-36007b662617 admin admin] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:03.640301 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54601e9a-836d-4ecf-85b1-36007b662617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:03.640583 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54601e9a-836d-4ecf-85b1-36007b662617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:03.641343 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54601e9a-836d-4ecf-85b1-36007b662617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:03.642933 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54601e9a-836d-4ecf-85b1-36007b662617 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:03.652452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1435/2899] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 16:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 16:40:03.656698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1d669-1cd8-45f8-a680-40efb001f5a3 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:03.667112 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1d669-1cd8-45f8-a680-40efb001f5a3 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:03.671693 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5a6f1-199d-4aaa-b380-c89f77d93818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:03.672562 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5a6f1-199d-4aaa-b380-c89f77d93818 admin admin] REQUEST_METHOD: `PUT` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:03.672842 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5a6f1-199d-4aaa-b380-c89f77d93818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:03.673135 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5a6f1-199d-4aaa-b380-c89f77d93818 admin admin] PATH_INFO: `/v3/projects/de90a717f1074853b82f5841f48a2ce7/users/d3d73a73a726487e86a22fa0202dd306/roles/eaa9f23967bd48ac9f6683ba56d1e9f9` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:03.675119 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5a6f1-199d-4aaa-b380-c89f77d93818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de90a717f1074853b82f5841f48a2ce7, user_id=d3d73a73a726487e86a22fa0202dd306, role_id=eaa9f23967bd48ac9f6683ba56d1e9f9)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:03.677779 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5a6f1-199d-4aaa-b380-c89f77d93818 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:03.688407 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1465/2900] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 16:40:03 2022] PUT /identity/v3/projects/de90a717f1074853b82f5841f48a2ce7/users/d3d73a73a726487e86a22fa0202dd306/roles/eaa9f23967bd48ac9f6683ba56d1e9f9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:40:03.698844 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7354318-6820-4a34-8c9c-beec08b410ac None None] REQUEST_METHOD: `POST` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:03.699139 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7354318-6820-4a34-8c9c-beec08b410ac None None] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:03.699422 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7354318-6820-4a34-8c9c-beec08b410ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:03.725937 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.auth.core [None req-e7354318-6820-4a34-8c9c-beec08b410ac None None] MFA Rules not processed for user `d3d73a73a726487e86a22fa0202dd306`. Rule list: `[]` (Enabled: `True`). {{(pid=80379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:40:03.728596 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e7354318-6820-4a34-8c9c-beec08b410ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:03.794566 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1436/2901] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:40:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:40:03.804987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5a6f1-199d-4aaa-b380-c89f77d93818 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:03.807213 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-68e5a6f1-199d-4aaa-b380-c89f77d93818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:03.841232 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:40:03.863700 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5a6f1-199d-4aaa-b380-c89f77d93818 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:03.867327 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420a2fd-cdce-4605-a284-3164a1ae3c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:03.867969 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420a2fd-cdce-4605-a284-3164a1ae3c89 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:03.868784 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420a2fd-cdce-4605-a284-3164a1ae3c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:03.869062 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420a2fd-cdce-4605-a284-3164a1ae3c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:03.877991 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420a2fd-cdce-4605-a284-3164a1ae3c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:03.879422 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420a2fd-cdce-4605-a284-3164a1ae3c89 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:03.889822 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1466/2902] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:40:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:40:04.900600 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7354318-6820-4a34-8c9c-beec08b410ac None None] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:04.902013 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-e7354318-6820-4a34-8c9c-beec08b410ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:04.914092 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7354318-6820-4a34-8c9c-beec08b410ac None None] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:04.917666 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb46b2-baef-4bc2-8686-258037cb7d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:04.918306 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb46b2-baef-4bc2-8686-258037cb7d44 service cinder] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:04.918592 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb46b2-baef-4bc2-8686-258037cb7d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:04.918869 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb46b2-baef-4bc2-8686-258037cb7d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:04.973669 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb46b2-baef-4bc2-8686-258037cb7d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:04.975099 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb46b2-baef-4bc2-8686-258037cb7d44 service cinder] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:04.983891 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1437/2903] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:40:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:40:09.695624 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420a2fd-cdce-4605-a284-3164a1ae3c89 service cinder] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:09.704834 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420a2fd-cdce-4605-a284-3164a1ae3c89 service cinder] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:09.708534 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39481e50-3138-4a90-b55c-b8db69d7ecf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835679599bc74ed5b1b481e9be4700c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:09.709201 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481e50-3138-4a90-b55c-b8db69d7ecf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:09.709490 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481e50-3138-4a90-b55c-b8db69d7ecf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:09.709770 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481e50-3138-4a90-b55c-b8db69d7ecf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:09.765196 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39481e50-3138-4a90-b55c-b8db69d7ecf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:09.767644 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39481e50-3138-4a90-b55c-b8db69d7ecf8 service cinder] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:09.776531 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1467/2904] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:40:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 16:40:13.679893 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb46b2-baef-4bc2-8686-258037cb7d44 service cinder] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:13.726958 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=100 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:40:13.740186 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb46b2-baef-4bc2-8686-258037cb7d44 service cinder] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:13.744568 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:13.745460 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:13.745744 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:13.746018 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] PATH_INFO: `/v3/users/f0714495db3c47d7a9ccd406e986e78e` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:13.747179 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0714495db3c47d7a9ccd406e986e78e)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:13.749071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:13.883607 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0714495db3c47d7a9ccd406e986e78e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:13.967684 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0714495db3c47d7a9ccd406e986e78e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:13.979598 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0714495db3c47d7a9ccd406e986e78e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:13.981163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0714495db3c47d7a9ccd406e986e78e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:13.987126 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0714495db3c47d7a9ccd406e986e78e'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:13.992921 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1438/2905] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:40:13 2022] DELETE /identity/v3/users/f0714495db3c47d7a9ccd406e986e78e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:40:13.997557 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c62469-269d-46f0-887c-2c149a59538f None None] REQUEST_METHOD: `POST` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:13.998036 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c62469-269d-46f0-887c-2c149a59538f None None] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:13.998147 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c62469-269d-46f0-887c-2c149a59538f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:14.015671 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.auth.core [None req-70c62469-269d-46f0-887c-2c149a59538f None None] MFA Rules not processed for user `8b9c6c8e314d439cb5330941f3032bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 16:40:14.016854 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-70c62469-269d-46f0-887c-2c149a59538f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:14.075320 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1468/2906] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 16:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 16:40:14.084760 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:14.086280 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:14.141518 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46919210-1203-4634-8b47-949972da4e9d admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:14.145097 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d87011-c432-471b-b2eb-6ce2d502f24a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6a4da4c1dca40f5bb5d158a6f33d9dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:14.145757 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d87011-c432-471b-b2eb-6ce2d502f24a service neutron] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:14.146038 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d87011-c432-471b-b2eb-6ce2d502f24a service neutron] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:14.146310 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d87011-c432-471b-b2eb-6ce2d502f24a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:14.155774 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d87011-c432-471b-b2eb-6ce2d502f24a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:14.157224 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d87011-c432-471b-b2eb-6ce2d502f24a service neutron] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:14.166701 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1439/2907] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:40:14.569341 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c62469-269d-46f0-887c-2c149a59538f None None] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:14.570723 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-70c62469-269d-46f0-887c-2c149a59538f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:14.583105 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c62469-269d-46f0-887c-2c149a59538f None None] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:14.587825 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:14.588698 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:14.588987 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:14.589300 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] PATH_INFO: `/v3/projects/90e8461fb578478bbf66e65711826b83` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:14.591086 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e8461fb578478bbf66e65711826b83)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:14.592990 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:14.693350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e8461fb578478bbf66e65711826b83', 'request_id': 'req-d2593156-23a9-4f75-a105-5100343f4065'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:14.790493 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e8461fb578478bbf66e65711826b83', 'request_id': 'req-d2593156-23a9-4f75-a105-5100343f4065'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:14.796428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e8461fb578478bbf66e65711826b83', 'request_id': 'req-d2593156-23a9-4f75-a105-5100343f4065'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:14.798294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:40:14.807599 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] The token cache is being invalidate because project 90e8461fb578478bbf66e65711826b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:40:14.807888 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:14.808566 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:14.810659 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1469/2908] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:40:14 2022] DELETE /identity/v3/projects/90e8461fb578478bbf66e65711826b83 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:40:14.814725 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d87011-c432-471b-b2eb-6ce2d502f24a service neutron] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:14.824327 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d87011-c432-471b-b2eb-6ce2d502f24a service neutron] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:14.880405 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:14.881361 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:14.881640 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:14.881911 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] PATH_INFO: `/v3/users/15aa27cfd40c4d8daaeebd7a8790da11` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:14.883071 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15aa27cfd40c4d8daaeebd7a8790da11)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:14.885010 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:14.899250 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:40:15.053051 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15aa27cfd40c4d8daaeebd7a8790da11'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:15.108225 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15aa27cfd40c4d8daaeebd7a8790da11'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:15.121045 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15aa27cfd40c4d8daaeebd7a8790da11'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:15.121708 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15aa27cfd40c4d8daaeebd7a8790da11'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:15.129219 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15aa27cfd40c4d8daaeebd7a8790da11'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:15.135163 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1440/2909] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:40:14 2022] DELETE /identity/v3/users/15aa27cfd40c4d8daaeebd7a8790da11 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:40:15.532896 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:15.534453 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:15.549001 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2593156-23a9-4f75-a105-5100343f4065 admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:15.605333 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:15.606124 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:15.606409 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:15.607256 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] PATH_INFO: `/v3/projects/e1b702a70c7f4d389357fb673c439c32` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:15.608468 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b702a70c7f4d389357fb673c439c32)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:15.610432 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:15.704155 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b702a70c7f4d389357fb673c439c32', 'request_id': 'req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:15.767571 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b702a70c7f4d389357fb673c439c32', 'request_id': 'req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:15.773294 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b702a70c7f4d389357fb673c439c32', 'request_id': 'req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:15.785406 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] The token cache is being invalidate because project e1b702a70c7f4d389357fb673c439c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:40:15.785699 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:15.786345 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:15.788152 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1470/2910] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:40:15 2022] DELETE /identity/v3/projects/e1b702a70c7f4d389357fb673c439c32 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:40:15.792109 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:15.793553 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:15.806729 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fee57-691c-4e6c-81f9-0be60dc317b2 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:15.863582 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:15.864392 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:15.864680 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:15.864961 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] PATH_INFO: `/v3/users/d3d73a73a726487e86a22fa0202dd306` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:15.866196 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d73a73a726487e86a22fa0202dd306)` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:15.868104 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:16.012705 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d73a73a726487e86a22fa0202dd306'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:16.076554 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d73a73a726487e86a22fa0202dd306'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:16.088688 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d73a73a726487e86a22fa0202dd306'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:16.089366 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d73a73a726487e86a22fa0202dd306'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:16.096637 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.notifications [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d73a73a726487e86a22fa0202dd306'} {{(pid=80379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:16.102452 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1441/2911] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 16:40:15 2022] DELETE /identity/v3/users/d3d73a73a726487e86a22fa0202dd306 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:40:16.541072 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] Authenticating user token {{(pid=80380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:40:16.542609 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.fernet_utils [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:40:16.555142 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8de7c-7472-4dc2-8cc5-10d2400f45bc admin admin] Validating token access rules against request {{(pid=80380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:40:16.620881 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b9c6c8e314d439cb5330941f3032bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20bec087d7d4867acdc2fcb7538cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:40:16.621752 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:40:16.622043 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c admin admin] SCRIPT_NAME: `/identity` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:40:16.622826 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c admin admin] PATH_INFO: `/v3/projects/de90a717f1074853b82f5841f48a2ce7` {{(pid=80380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:40:16.624101 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c admin admin] RBAC: Authorizing `identity:delete_project(project_id=de90a717f1074853b82f5841f48a2ce7)` {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:40:16.626055 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c admin admin] RBAC: Authorization granted {{(pid=80380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:40:16.727428 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:40:16.742255 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de90a717f1074853b82f5841f48a2ce7', 'request_id': 'req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:16.830764 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de90a717f1074853b82f5841f48a2ce7', 'request_id': 'req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:16.836704 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de90a717f1074853b82f5841f48a2ce7', 'request_id': 'req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c'} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:16.847763 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c admin admin] The token cache is being invalidate because project de90a717f1074853b82f5841f48a2ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 16:40:16.848073 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:16.848712 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG keystone.notifications [None req-d1f29f1c-0651-48a6-a0a2-1435cd0c646c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 16:40:16.850350 dv-cinder-797608-56-smb devstack@keystone.service[80380]: [pid: 80380|app: 0|req: 1471/2912] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 16:40:16 2022] DELETE /identity/v3/projects/de90a717f1074853b82f5841f48a2ce7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 16:40:26.098979 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=75,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:40:27.050781 dv-cinder-797608-56-smb devstack@keystone.service[80380]: DEBUG dbcounter [-] [80380] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 16:43:10.076904 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] Authenticating user token {{(pid=80379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 16:43:10.078330 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:43:10.146655 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095eb11-a198-4af4-af00-34515b586851 admin admin] Validating token access rules against request {{(pid=80379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 16:43:10.204673 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d42403-fd0d-4488-9f2f-efa6669198cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b62795a6111a4c05a24e69efc7a0faba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2101dde305df44bc90d33b01976e8265', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 16:43:10.205865 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d42403-fd0d-4488-9f2f-efa6669198cc service placement] REQUEST_METHOD: `GET` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 16:43:10.206153 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d42403-fd0d-4488-9f2f-efa6669198cc service placement] SCRIPT_NAME: `/identity` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 16:43:10.206429 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d42403-fd0d-4488-9f2f-efa6669198cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 16:43:10.208255 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.fernet_utils [None req-f0d42403-fd0d-4488-9f2f-efa6669198cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 16:43:10.219321 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d42403-fd0d-4488-9f2f-efa6669198cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 16:43:10.221522 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d42403-fd0d-4488-9f2f-efa6669198cc service placement] RBAC: Authorization granted {{(pid=80379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 16:43:10.231377 dv-cinder-797608-56-smb devstack@keystone.service[80379]: [pid: 80379|app: 0|req: 1442/2913] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 16:43:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 16:43:20.227114 dv-cinder-797608-56-smb devstack@keystone.service[80379]: DEBUG dbcounter [-] [80379] Writing DB stats keystone:SELECT=58 {{(pid=80379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}